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systems  strategy  alleviates  the  present  problems  associated  with  prosthetic  devices.  Finally,  by  investigating  into  the  issues  of 
the  inflammatory  responses  of  cells/tissues  in  response  to  an  artificial  implant  and  the  interference  with  signaling  of  the  artificial 
implant,  the  design  of  our  in-vitro  model  ultimately  improves  the  design  and  construction  of  a  functional  and  biocompatible 
artificial  limb. 
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INTRODUCTION 


Over  1.2  million  people  in  America  have  missing  limbs  resulting  from  combat  (e.g.,  wars  and  other  conflicts)  and 
non-combat  (e.g.,  accidents,  birth  defects)  operations.  Thus,  availability  of  artificial  limbs  will  help  these  people  to 
lead  a  more  normal  life.  Although  artificial  devices  have  been  around  for  the  last  30  years,  there  are  no  artificial 
hands  that  fully  simulate  the  various  natural/human-like  operations  of  moving,  grasping,  lifting,  and  twisting. 
Moreover,  prosthetic  devices  still  pose  significant  biocompatibility  problems,  that  need  to  be  addressed  and  tissues 
surrounding  implants  develop  “inflammatory  reactions”. 

The  present  Phase  II  of  Smart  Prosthetic  Hand  Technology  focuses  on  the  four  closely  connected  areas  of  EMG 
signal  identification  and  estimation,  hand  motion  estimation,  intelligent  embedded  systems  and  control,  robotic  hand 
and  biocompatibility  and  signaling.  The  developed  identification  algorithm  using  a  new  sensor  array,  a  proposed 
hybrid  estimation  algorithm  will  provide  for  the  decomposition  and  inference  of  multiple  signals.  Different 
categories  of  amputation  level  will  be  simulated  and  the  identification  of  EMG  signals  will  be  tested  and  adapted  to 
these  different  cases.  Next,  the  proposed  sensing  and  actuation  system  for  the  artificial  hand  overcomes  the 
limitations  on  dexterous  manipulation  of  the  prosthetic  hands.  Strategies  on  grasping  and  manipulation  will  be 
developed  to  complement  the  myoelectric  signals.  The  proposed  fusion  of  soft  and  hard  embedded  control  systems 
strategy  will  alleviate  the  present  problems  associated  with  prosthetic  devices.  Einally,  by  investigating  into  the 
issues  of  the  inflammatory  responses  of  cells/tissues  in  response  to  an  artificial  implant  and  the  interference  with 
signaling  of  the  artificial  implant,  the  design  of  our  in-vitro  model  will  ultimately  improve  the  design  and 
construction  of  a  functional  and  biocompatible  artificial  limb. 
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Goal  1:  EMG  Signal  Identification  and  Estimation 


Spatial  filter  Isolation  of  Motor  Unit  Sets  and 
Simulation  of  Degree  of  Amputation: 

Nonlinear  force-sEMG  modeling,  Hybrid  PSO-TS,  Optimization  of  nonlinear  filters,  Spatial  filtering  and 

Optimization,  Zone  Classification 


EMG-hand  motion  model  integration  and  optimization  for  degree  of  amputation  using  sensor  fusion 

strategies: 

Force  Modeling,  Force  fatigue  Modeling,  System  Identification,  Data  Fusion  Algorithms,  Finger  Motion 

Modeling 


Abbreviations  and  Acronyms 
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ARIMA 
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ARMAX 
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ATP 
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CHAPTER  ONE 


Spatial  filter  Isolation  of  Motor  Unit  Sets  and  Simulation  of  Degree  of  Amputation 

This  chapter  describes  the  signal  processing  techniques  used  for  post-processing  of  the  sEMG 
signal  and  the  modeling  methods  used  to  determine  sEMG-Force  relation. 


1.1  Experimental  Setup 

The  experiments  were  carried  out  on  a  healthy  male  subject  in  order  to  collect  sEMG  and  force 
data,  with  the  objective  to  extract  dynamical  models  describing  the  relationship  among  these  two  quantities. 
The  motor  point  of  the  subject  was  located  using  a  Muscle  Stimulator,  manufactured  by  Rich-Mar 
Corporation;  model  number  HV  1100.  The  motor  location  of  the  ring  finger  was  identified  and  chosen  for 
the  experiments.  The  EMG  detection  system  used  was  the  Delsys,  Bagnoli-16  channel  EMG,  DS-160,  S/N- 
1116,  which  has  an  internal  amplification  and  noise  reduction  technology  built  into  it.  The  sensors  used  for 
measuring  the  surface  EMG  action  potentials  were  two  pronged  DE  2.1  differential  surface  electrodes.  The 
material  for  the  contacts  of  the  electrode  is  99.9%  pure  silver,  while  the  contacts  are  10mm  long,  1mm  in 
diameter  and  spaced  10mm  apart.  The  subjects’  skin  was  prepared  before  the  sensors  were  placed  over  the 
motor  point  location  of  the  forearm  musculature  being  measured.  Hair  around  the  area  was  shaved  and  an 
alcohol  swab  was  used  to  clean  the  skin.  The  Delsys  Electrode  Interface  SC-F02-3  was  used,  which 
promotes  a  quality  electrical  connection  between  the  electrode  and  the  skin,  minimizing  motion  artifacts 
and  line  interference.  The  electrodes  were  placed  along  the  muscle  fibers  (Flexor  Digitorum  Superficialis) 
for  recording  surface  EMG.  The  force  was  recorded  using  a  force  sensitive  resistor  (FSR).  The  data 
acquisition  for  the  force  and  the  EMG  signal  was  done  at  2000  samples  per  second.  NI  DAQ  6024  E  Series 
boards  were  used. 

The  procedure  mentioned  in  this  section  was  used  for  all  of  the  experiments,  which  involved 
modeling  of  the  sEMG  from  a  single  motor  point,  of  a  particular  finger,  to  the  corresponding  force  the 
finger  generated. 

The  most  widely  accepted  standard  for  filtering  and  recording  surface  EMG  signals  is  published 
by  the  International  Society  of  Electromyography  and  Kinesiology  (ISEK),  [1].  Other  filtering  methods 
commonly  include  low-pass  or  band-pass  filtering.  Some  researchers  have  also  employed  notch  filtering  to 
remove  power  line  noise  from  the  recorded  EMG  signal,  [2].  Whitening  filters  have  also  been  employed  in 
order  to  increase  the  quality  of  the  amplitude  estimates  of  the  surface  EMG  signals,  [3].  Many  signal 
processing  methods  can  be  found  in  the  literature  to  extract  useful  information  from  surface  EMG  signals. 
Some  of  these  include  using  Markov  models,  [4]  and  fuzzy  logic  control,  [5]  -  for  classification  of  EMG, 
wavelet  processing  [6],  and  Bayesian  estimators,  [7]. 

In  our  initial  work,  nonlinear  system  identification  was  used  to  extract  dynamical  models  relating 
the  force  generated  by  an  individual  finger  from  measured  surface  EMG  signals.  The  surface  EMG  signal  is 
measured  in  milli-volts  and  is  a  function  the  muscle  activity.  In  particular,  investigation  of  the  optimal 
Bayesian  filter  parameter  settings  were  carried  out  aimed  at  identifying  a  dynamical  model.  Bayesian  filters 
were  utilized  for  processing  the  measured  surface  EMG  signals,  as  done  by  T.  D.  Sanger,  [8].  The  filter 
parameters  of  the  Bayesian  filters  were  optimized  using  elitism  based  Genetic  Algorithm  to  search  for  the 
optimal  values.  Since,  changes  in  the  processed  EMG  signal,  with  respect  to  the  expected  rates  in  sudden 
shifts  and  gradual  drift  have  direct  implication  on  the  expected  extraction  of  the  underlying  dynamics,  the 
optimal  setting  was  found  by  defining  an  objective  function  that  is  directly  related  to  the  nonlinear  model 
fit  obtained  from  system  identification  results.  Also,  GA  is  used  to  find  the  optimal  parameters  for  the 
Hammerstein- Wiener  models  used  for  system  identification. 

1.2  Bayesian  Filtering 

In  [8]  T.  D.  Sanger  proposed  using  a  nonlinear  recursive  filter  based  on  Bayesian  estimation.  The 
desired  filtered  signal  was  modeled  as  a  combined  diffusion  and  jump  process  and  the  measured 
electromyographic  (EMG)  signal  was  modeled  as  a  random  process  with  a  density  in  the  exponential 
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family  and  rate  given  by  the  desired  signal.  The  rate  is  estimated  on-line  by  calculating  the  full  conditional 
density  given  all  past  measurements  from  a  single  electrode.  The  Bayesian  estimate  gives  a  filtered  signal 
that  best  describes  the  observed  EMG  signal.  This  estimate  yields  results  with  very  low  short-time 
variability  but  also  with  the  capability  of  very  rapid  response  to  change.  The  estimate  approximates 
isometric  joint  torque  with  lower  error  and  higher  signal-to-noise  ratio  than  current  linear  methods.  Use  of 
the  nonlinear  filter  significantly  reduces  noise  compared  with  current  algorithms,  and  it  may  therefore 
permit  more  effective  use  of  the  EMG  signal  for  prosthetic  control,  biofeedback,  and  neurophysiology 
research.  This  filtering  technique  was  adopted  for  modeling  the  relation  between  the  sEMG  and  the  finger 
force  produced.  As  sEMG  is  plagued  by  a  multitude  of  non-physiological  and  physiological  factors  as 
investigated  by  Farina  et  al.  in  [9],  the  Bayesian  filtering  technique  described  was  investigated  to  determine 
its  usefulness  and  to  investigate  if  it  would  help  in  reducing  the  inherent  variability  of  sEMG  signals  and 
facilitate  dynamic  modeling  of  the  sEMG  and  force  relation  using  system  identification.  A  brief  outline  of 
the  Bayesian  filtering  procedure  is  mentioned  here.  The  variables  used  in  the  theory  of  Bayesian  filtering 
are  given  below. 


Bj,i(s),  Fj,i(s)  Polynomials  in  the  linear  block. 

C  Constant  chosen  so  that  the  density  integrates  to  1 . 

F  Nonlinear  Regression  command. 

N  Number  of  events. 

P[x(t)]  Probability  density  for  . 

f(rpc)  Fitness  function  for  each  chromosome. 

fiO  Input  nonlinearity  function. 

f( •)  Static  nonlinear  function 

h()  Output  nonlinearity  function. 

n  Integer  proportional  to  the  magnitude  of  the  rectified  EMG  signal. 

q(t)  Regressors 

rpc  random  population  of  chromosomes. 

^  Backward  shift  operator. 

u(t)  Input  of  a  system. 

v(t),  w(%)  Internal  variables. 

X  Measured  surface  EMG  signal. 

y(t)  Output  of  a  system. 

y(t)  Predicted  or  Estimated  output. 

a  Expected  rate  of  gradual  drift. 

^  Expected  rate  of  sudden  shifts  in  surface  EMG. 

s  Width  of  discretizing  bin. 

6  Finite  dimensional  vector  used  to  parameterize  the  mapping. 

fj  Physical  parameters  of  non-linear  function  f(*). 


The  instantaneous  relation  between  the  measured  surface  EMG  -  represented  by  the  variable  ‘x’ 
and  the  resulting  sEMG  -  represented  by  EMG  after  filtration  can  be  described  by  a  conditional  probability 
density  function  p(£'MG|x)  .  Under  the  assumption  that  the  rectified  EMG  signal  results  from  random 

depolarization  events  of  multiple  muscle  fibers,  then  the  average  amplitude  in  a  small  time  window  will  be 
proportional  to  the  number  of  depolarization  events  during  that  time,  [8].  The  number  of  events  A,  can  be 
modeled  as  a  Poisson  process  given  by  Equation  1.1.  The  rectified  emg  =  jAMGl  is  used  in  most  of  the 
equations  from  here  on  forth  and  n  is  an  integer  proportional  to  the  magnitude  of  the  rectified  EMG  signal. 

P{emg  I  x)  «  (x"e~^)/ A!  .  (1.1) 

However,  empirical  observations  of  EMG  signals  have  led  to  the  common  assumption  that  it  can  be 
described  as  amplitude  modulated  zero-mean  Gaussian  noise  [10],  [11].  For  rectified  EMG  signals  i.e. 
emg  >  0  the  expression  is: 

P{emg  I  x)  =  2  X  Qxp(-emg^  I2x^)l{27rx^''^ .  (1.2) 
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Also,  under  close  observation  of  EMG  signals,  the  density  function  can  be  better  approximated  using  a 
Laplacian  density,  which  for  a  rectified  EMG  signal  is  as  follows: 

P(emg  I  x)  =  Qxp(-emg / x)/x  .  (1.3) 

SsLy,emg(t)is  a  single  measurement  of  the  rectified  EMG  signal  at  a  given  time  t,  and  x(f)  is  the 
measured  surface  EMG  at  time  t ,  then  the  function  P\^emg{t)  \  x(^)]  specifies  the  likelihood  of  each 
possible  value  of  x(^) .  Bayes  rule  gives  the  posterior  density  as, 

P{x{t)  I  erngity]  =  P{emg{t)  \  x{t)]  x  P{x{t)]  /  P[emg{t)],  (1,4) 

Where,  P[x(f)]  is  the  probability  density  for  x(^)  immediately  before  the  measurement  of  emg{t)  .  In 
general,  the  prior  P[x(^)]  will  depend  on  the  entire  past  history  of  the  measurements.  Estimation  of 
P[x(^)]  can  be  performed  using  a  recursive  algorithm  based  on  discrete  time  measurements. 

Using  Bayes’  rule  the  expression  can  be  rewritten  as, 

P[x{t)  I  emg{t),emg{t =P{emg{t)  \  x(t)]P[x(t)  \  emg{t  -  l),emg{t  -  2)...]/  C  (1.5) 

C  is  a  constant  chosen  to  make  the  density  integrate  to  1.  From  equation  1.5,  an  estimate  of 
P[x(t)  I  emg(t),emg(t -l),...]csLn  be  obtained  which  is  written  as  p(x,t  -1)  .  Also,  the  estimate  of  the 
conditional  density  of  x  at  time  t ,  immediately  before  the  measurement  of  emg{t)  is  written  as  p{x,  t-) , 
which  is  calculated  by  propagating  the  density  of  p{x,t  —  1)  forward  in  time  by  one  sampling  interval.  The 
recursive  algorithm  (numerical  integration  of  Fokker-Planck  equation  in  [8])  is  utilized  for  the  filtration  of 
the  recorded  EMG  signal.  The  mathematical  form  of  the  derived  probability  density  function  is  given  by: 

p{x, t-) « aP{x +  2a) p{xp-\)  +  ap{x  +  £p-\)  +  P  +  {\- P)p{xp-\)  .  (1.6) 

The  recursive  algorithm  follows  the  same  steps  as  in  [8].  But  in  the  case  of  [8],  the  values  of  a  and  P  are 
chosen  empirically.  Using  an  elitism  based  Genetic  Algorithm  (GA),  the  probability  of  choosing  the 
optimum  values  of  a  and  P  was  increased,  with  the  cost  function  in  GA  being  the  percentage  of  the  model 
fits  that  are  returned  by  the  system  identification  model  between  the  surface  EMG  and  the  force  data. 


The  following  sections  discuss  GA  and  System  Identification  (SI). 

1.3  Genetic  Algorithm: 

Genetic  Algorithm  is  a  class  of  evolutionary  methods  for  solving  both  constrained  and  unconstrained 
optimization  problems  that  are  based  on  natural  selection.  This  is  the  same  rule  that  governs  biological 
systems.  In  GA,  the  population  of  individual  solutions  is  modified  repeatedly.  Each  step  or  iteration  in  GA 
selects  individuals  (chromosomes)  in  some  fashion  that  may  include  some  randomness,  from  a  given 
population,  as  parents  and  uses  them  to  produce  offspring  for  the  next  generation.  Over  successive 
iterations  or  generations,  the  population  evolves  and  finally  reaches  an  optimal  solution. 

The  steps  that  make  up  GA  are  as  follows:  1)  Generate  a  random  population  of  chromosomes  ‘rpc’;  these 
chromosomes  carry  information  of  the  population  and  are  confined  in  the  feasible  solution  space.  2) 
Evaluate  the  objective  or  fitness  function  f{rpc)  for  each  chromosome.  3)  Create  a  new  population  or 
offspring  from  the  initial  population  by  using  certain  rules.  This  step  includes  a)  Selection  -  selection  of 
two  parent  chromosomes  from  the  population  according  to  their  fitness,  b)  Crossover  -  crossover  the 
parents  to  form  new  offspring,  if  no  crossover  is  performed  then  the  offspring  is  an  exact  copy  of  the 
parents,  c)  Mutation  -  involves  the  changing  of  a  variable  in  a  chromosome  or  some  other  change  in  the 
original  chromosome  as  defined  by  the  user,  d)  Acceptance  Condition  -  if  offspring  satisfies  the  acceptance 
condition,  include  offspring  in  the  new  population  or  else  discard.  4)  Use  the  offspring  as  the  parents  for 
the  generation  of  a  new  population. 
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Initial 


Crossover  Generation 


Mutated  Generation  1 


Figure  1.1:  Steps  in  a  Genetic  Algorithm 

5)  Continue  until  the  end  condition  is  satisfied  i.e.  the  number  of  iterations  specified.  Refer  Figure  1.1  for 
an  example  of  the  GA  steps.  Here,  GA  is  used  to  find  the  optimal  values  of  a  and  P  for  the  filtration  of  the 
surface  EMG  signal  using  the  Bayesian  filter.  The  cost  function  that  GA  tries  to  minimize  is  the  model  fit 
obtained  from  the  system  identification  of  the  surface  EMG  and  the  corresponding  force  data  collected. 

1.4  System  Identification:  [12] 

System  Identification  (SI)  has  its  roots  in  standard  statistical  techniques,  such  as  least  squares  and 
maximum  likelihood  methods.  SI  helps  the  user  to  build  mathematical  models  of  a  dynamic  system  based 
on  measured  data.  This  is  done  by  adjusting  the  parameters  within  a  given  model  until  its  output  emulates 
the  measured  input  in  some  minimum  fashion,  [13].  System  identification  is  especially  useful  for  modeling 
systems  that  cannot  be  easily  represented  in  terms  of  first  principles  or  know  physical  laws.  In  this  case, 
one  can  use  SI  to  perform  black-box  modeling,  where  the  measured  data  determines  the  model  structure. 
Black-box  modeling  has  the  following  advantages;  1)  the  structure  and  the  order  of  the  model  need  not  be 
known,  and  2)  many  model  structures  can  be  estimated  and  compared,  and  the  best  among  them  can  be 
selected  to  suit  the  measured  data  sets.  Systems  that  can  be  represented  using  ordinary  difference  or 
differential  equations  can  be  modeled  using  grey-box  models.  Grey-box  models  have  a  known 
mathematical  structure  and  unknown  parameters  and  they  have  the  following  advantages  over  black-box 
models;  1)  known  constraints  can  be  imposed  on  the  model  characteristics,  2)  there  are  fewer  model 
parameters  to  estimate,  3)  coupling  between  parameters  can  be  defined  in  the  model  structure,  and  4)  in  the 
non-linear  case  the  dynamic  equations  can  be  specified  dynamically. 

The  most  common  system  identification  models  in  engineering  are  Auto-Regressive  with  exogenous  input 
(ARX)  and  Auto-Regressive  Moving  Average  with  exogenous  input  (ARMAX).  The  more  recent  additions 
to  system  identification  have  been  black-box  models  with  a  non-linear  structure  such  as  Artificial  Neural 
Networks,  Fuzzy  models  and  so  on. 

The  most  basic  relationship  between  the  input  and  the  output  of  a  system  can  be  given  by  a  linear 
difference  equation,  [13]  such  as: 

y{t)  +  a^y{t  - 1) + . . .  +  a^^yit  -n)  =  b^u{t  - 1) + . .  b^u{t  -  m) ,  (1.7) 

where,  u{t)  andy(f)are  the  input  and  output  of  the  system  at  time  t  respectively,  and 
parameters  of  the  system. 

9  =  [ai,...,a„b^,...,bmf ,  (1.8) 

where,  6  is  the  parametric  vector  with  coefficients  and  . 
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(p{t)  - [-y{t n)u{t  m)Y  , 

where,  (p{t)  is  the  regression  vector,  then  we  can  write: 

yit)=(p^{t)e .  (1.9) 

Generally,  a  model  structure  is  a  parameterized  mapping  from  past  inputs  and  outputs  to  the  space  of 
the  model  outputs,  [14]: 

(1-10) 

Where,  y{t)  is  the  predicted  output. 

In  the  real  world,  almost  all  systems  are  nonlinear  and  the  output  is  a  non-linear  function  of  the  input 
variables.  However,  linear  models  often  sufficiently  and  accurately  describe  system  dynamics.  While 
modeling  a  system  using  grey-box  models,  the  linear  and  the  nonlinear  structures  can  be  set  using  its 
differential  or  difference  equations.  Since  linear  models  are  adequate  for  many  situations,  it  should  be  tried 
first  to  see  if  the  results  of  the  model  fit  are  satisfactory. 

Figure  1.2  shows  a  general  flow  chart  of  the  system  identification  procedure. 


Figure  1.2:  System  Identification  Loop  Flowchart 


1.5  Nonlinear  ARX  Models: 

Nonlinear  ARX  models  use  a  parallel  structure  to  combine  linear  and  nonlinear  blocks.  Figure  1.3  shows 
the  structure  of  a  nonlinear  ARX  model.  The  nonlinear  and  linear  functions  are  called  regressors. 

The  predicted  output  of  a  nonlinear  model  y  at  any  given  time  t  can  be  described  by, 

y{t)  =  F{q{t))  (1.11) 

F  can  include  linear  or  nonlinear  functions  of  q{t)  .  Where  F  is  a  non-linear  regression  command  which 
is  approximated  by  nonlinearity  estimators,  and  q{t)  represents  the  regressors. 
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Figure  1.3:  Nonlinear  ARX  Model  Structure 


There  are  different  types  of  regressors  for  nonlinear  ARX  models.  Standard  Regressors  -  for  specified 
model  orders,  the  past  input  and  output  signals  are  computed  automatically  as  delay  transformations. 
Custom  Regressors  -  input  and  output  variables  that  can  be  specified  for  example  as  products,  powers  etc. 

Nonlinear  ARX  model  regressors  can  be  computed  by  specifying  the  following  orders;  -  the  number  of 

past  output  terms  used  to  predict  the  current  output,  -  the  number  of  past  input  terms  used  to  predict  the 

current  output  and  -  the  delay  from  input  and  output  in  terms  of  the  number  of  samples.  The  various 

nonlinearity  estimators  that  can  be  used  for  nonlinear  ARX  models  are,  a)  Sigmoid  Network,  b)  Tree 
Partition,  c)  Wavelet  Network,  d)  Neural  Networks  and  d)  User  defined  custom  networks. 

1.6  Hammerstein  and  Wiener  Models: 

It  is  a  possible  and  quite  a  common  situation,  where  the  dynamics  of  the  system  can  be  well-described 
using  linear  models,  but  they  do  not  account  for  any  static  nonlinearities  at  the  input  and/or  at  the  output. 
This  might  be  the  case  if  the  actuators  are  nonlinear.  For  example,  when  saturation  occurs,  or  when  the 
sensors  employed  have  nonlinear  characteristics.  A  model  with  a  static  nonlinearity  accounted  for  at  the 
input  is  called  a  Hammerstein  model.  When  the  nonlinearity  is  at  the  output  a  Wiener  model  is  more 
appropriate.  The  combination  of  the  two  is  then  the  Hammerstein- Wiener  model,  [15].  Refer  Figure  1.4(a) 
and  (b)  for  Hammerstein  and  Wiener  models.  Consider  the  Hammerstein  case  where  the  static  nonlinear 
function  / (•)  can  be  parameterized,  either  in  terms  of  physical  parameters,  such  as  saturation  point  and 
saturation  level,  or  in  black-box  terms  such  as  spline-function  coefficients.  This  defines  /(•,77) ,  [15].  If  the 
linear  model  is  given  by  G{q,0) ,  the  predicted  output  model  will  be  in  the  following  form: 

y{t\9,r])  =  G{q,d)f{u{t),iii).  (1.12) 

The  Hammerstein- Wiener  representation  allows  us  to  model  the  dynamic  system  using  one  or  two  static 
nonlinear  blocks  in  series  with  a  linear  block.  The  static  non-linearity  could  represent  saturation  or  dead- 
zone  behavior.  Figure  1.5  represents  the  Hammerstein- Wiener  model  structure,  while  Equation  1.13 
describes  the  Hammerstein- Wiener  model  structure: 

=  v(t)  =  >v(0,  y(t)  =  h(v(t)),  (1.13) 

Where  w(t)  and  v{t)  are  internal  variables,  w{t)  has  the  same  dimensions  as  u{t) ,  and  v{t)  has  the  same 
dimensions  as  y{i)  . 
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Figure  1.4:  a)  Hammerstein  Model,  b)  Wiener  Model 


Input 


Output 

y{t) 


Figure  1.5:  Hammerstein- Wiener  Model 

The  linear  block  is  specified  using  the  terms  rif^  -  the  number  of  zeros  plus  one,  -  the  number  of  poles 

and  nj^-  the  delay  from  the  input  to  the  output  in  terms  of  the  number  of  samples.  The  commonly  used 

nonlinear  estimators  for  Hammerstein- Wiener  model  are,  a)  Dead  Zone,  b)  Piecewise  Linear,  c)  Saturation, 
d)  Sigmoid  Network,  and  e)  Wavelet  Network,  [16-18]. 

The  results  presented  in  this  section  are  for  the  implementation  of  Bayesian  filters  with  optimized  filter 
parameters  for  the  Bayesian  filters  and  optimized  Hammerstein- Wiener  model  parameters  for  the 
experiments,  where  the  subject  performed  a  random  series  of  flexion’s  of  the  ring  finger. 

Figure  1.6  shows  the  output  of  the  raw,  filtered  sEMG,  and  also  the  raw  and  filtered  force  data.  The  x- 
axis  in  the  figure  is  the  number  of  samples  and  the  y-axis  is  the  amplitude  of  the  sEMG  and  the  force  signal 
in  milli-volts.  The  randomness  -  as  depicted  in  Figure  1.6(e)  -  was  necessary  in  order  to  ensure  that  the 
system  is  excited  at  all  modes.  During  the  experiment  all  fingers  were  flexed  in  order  to  generate  the  force 
and  sEMG  signal.  A  result  of  this,  there  was  substantial  cross  talk  in  the  measurement. 
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Figure  1.6:  a)  Raw  EMG  Signal,  b)  Bayes’  Exponential  Filtered  EMG,  c)  Poisson  Filtered  EMG,  d)  Half- 
Gaussian  Filtered  EMG,  e)  Raw  Force  Signal,  f)  Filtered  Force  Signal 

Besides  Hammerstein- Wiener  models,  nonlinear  ARX  models  were  also  tested  with  the  recorded 
sEMG-force  data  with  varying  model  properties  for  system  identification.  The  results  were  very  poor  as 
compared  to  the  Hammerstein- Wiener  models. 

Table  1.1  lists  the  system  identification  results  using  nonlinear  ARX  models  with  random  parameter 
settings.  To  compute  the  model  fit  using  the  models  extracted  from  the  SI  algorithm,  the  following 
relationship  was  used: 

fit  =  \00^(\-norm{y-y)l norm(y  -  mean(y)))  (114) 

It  can  be  seen  from  Table  1.1,  the  variation  in  the  model  fits  that  were  obtained  for  the  nonlinear  ARX 
models  with  various  combinations  of  and  n^^w^is  very  large  and  also  the  majority  of  the  model  fits  that 

were  obtained  were  very  poor. 


Table  1.1:  Results  of  nonlinear  ARX  Model  Estimations 
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The  force  and  the  sEMG  data  collected  were  imported  to  MATFAB^.  The  results  of  the 
experiments  are  shown  in  Tables  1.2  and  1.3.  The  steps  for  running  the  nonlinear  filter  algorithms  were  the 
same  as  in  [8].  The  values  for  a  and  P  used  in  [8]  were  deduced  empirically.  Here,  the  filter  parameters  are 
chosen  from  among  a  large  search  space,  thereby  allowing  the  optimization  routine  to  find  the  best  settings 
within  a  large  range. 

An  elitism  continuous  GA  based  optimization  algorithm  was  run  for  10,  30,  and  80  generations.  The 
various  GA  parameters  set  were:  a)  Maximum  number  of  Iterations  -  10,  30,  80,  b)  Initial  Population  size  - 
98,  c)  Population  size  for  the  first  generation  -  48,  d)  Number  of  chromosomes  used  for  mating  -  24,  e) 
Mutation  rate  -  4%.  The  data  shown  in  Table  1.2  is  for  the  parameters  of  the  nonlinear  filtration  of  the  raw 
sEMG  data  with  the  three  different  types  of  filters:  namely  the  Bayes  Exponential,  the  Half-Gaussian  and 
the  Poisson.  The  values  of  a  and  P  were  chosen  as  given  in  [8].  The  subject  performed  the  experiment  for 
60  sec,  while  only  but  the  first  10  sec  of  the  recorded  data  was  used  for  model  estimation.  This  was  done  in 
order  to  avoid  the  onset  of  fatigue  which  would  influence  the  modeling  of  the  system. 

As  can  be  seen  from  Table  1.2,  the  range  of  model  fit  values  obtained  for  a=0.001  and  y^=le-24,  with 
Nonlinear  Hammerstein- Wiener  SI  was  between  39  -  72%.  We  have  a  range  of  values  here,  as  the  models 

parameters  were  randomly  chosen  and  25  different  combinations  of  and  n ^  were  tested  for  the  same 

values  of  a  and  p.  The  best  fit  was  obtained  for  the  Half-Gaussian  filtration  of  the  sEMG  signals  of  72.61%. 
With  GA  as  the  optimum  search  algorithm,  the  range  of  a  (0.005  -  0.009)  and  P  (lOe-24  -  lOe-23)  for  the 
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different  filters  could  be  expanded  and  correspondingly  the  nonlinear  Hammerstein- Wiener  SI  fit  obtained 
also  increased  to  around  85%. 

The  values  in  Table  1.2  are  read  as,  number  of  GA  iterations  -  10,  30  and  80  -  the  corresponding  a  values 
obtained  for  Bayes  Exponential  filter  were  2.2e-23,  3e-23  and  4e-23.  Similarly  the  ^  values  obtained  for  10, 
30  and  80  GA  iterations,  for  Bayes  Exponential  filter,  were  8.2067e-23,  1.5924e-23  and  1.4987e-23 
correspondingly.  The  model  fits  obtained  for  the  combination  of  a  and  P  values  after  80  GA  iterations  were 
68.18%,  83.65%  and  85.05%.  The  results  shown  in  Table  1.3  row  1,  indicates  the  range  for  which  and 

Uf  .  The  range  of  the  fits  obtained  for  the  nonlinear  Hammerstein- Wiener  SI  was  between  22.73  -  70.22%. 

The  force  signal  used  for  modeling  purposes,  was  filtered  using  a  low  pass  Butterworth  filter  using  a  cutoff 
frequency  of  15Hz.  The  EMG  signal  was  filtered  using  a  Chebyshev  Type  II  high  pass  filter  with  the 
following  filter  parameters,  Fstop=60Hz,  Fpass=70,  Astop=80,  Apass=l,  match=stopband,  to  remove  any  line 
frequencies  and  followed  by  a  low  pass  Chebyshev  Type  II  high  pass  filter  with  the  following  filter 
parameters,  Fstop=600Hz,  Fpass=650,  Astop=80,  Apass=l,  match=stopband.  This  was  done  since  EMG  signals 
have  an  effective  frequency  content  of  not  more  than  500Hz,  according  to  the  ISEK  standards,  [1].  Random 
combinations  of  and  uj-  were  used  for  the  Hammerstein- Wiener  SI  models. 


Table  1.2:  Model  outputs  after  Pre-processing  sEMG  data  using  Bayesian  Filtering  and  Filtered  force  data 


On  executing  the  GA  based  optimization,  for  the  model  parameters,  the  results  obtained  improved  to 
78.22%  from  70.22%,  the  best  fit  obtained  for  n^=5,  nf=9  and  %=1.  The  final  row  in  Table  1.3  shows 

the  model  fit  obtained  using  the  optimized  filter  parameters  for  the  Half-Gaussian,  with  the  GA  optimized 
model  parameters  for  Hammerstein- Wiener,  which  resulted  in  a  fit  of  81.64%. 
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Table  1.3:  Optimization  of  Nonlinear  Hammerstein- Wiener  Model  Parameters  using  GA 
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In  this  section,  a  set  of  filtering  approaches  were  investigated  for  the  explicit  use  of  system 
identification,  which  is  a  new  approach  in  the  field  of  sEMG  processing.  The  results  indicate  robust 
improvements  in  the  SI  outcomes  for  each  of  the  filters  used  when  optimized.  In  addition,  we  explored 
nonlinear  model  structures  to  describe  the  sEMG-force  relationship  for  finger  forces.  SI  results,  for  relating 
sEMG  signals  to  force  applied  by  individual  digits  of  the  hand,  were  improved  using  an  elitism  based  GA 
to  find  the  optimal  parameter  setting  for  Hammerstein- Wiener  models. 

In  the  next  section,  analysis  of  the  sEMG  signals,  obtained  from  specific  Motor  Unit  locations 
corresponding  to  the  index,  middle  and  ring  finger,  and  the  corresponding  force  data  is  presented.  This  is  a 
continuation  of  the  analysis  methods  that  were  used  in  the  previous  section,  i.e.  employing  system 
identification  and  various  filtering  techniques  to  glean  useful  information  from  the  sEMG  and  the 
corresponding  force  data.  Also,  one  of  the  shortcomings  of  our  previously  used  method  was  the  speed  of 
estimation  and  optimization  of  model  parameters  with  GA.  GA  is  inherently  slow  as  compared  to  most  of 
the  optimization  schemes  available  in  literature.  In  this  section,  replacing  GA  with  another  suitable  but 
faster  optimization  technique  was  investigated.  The  technique  that  was  tested  is  called  Particle  Swarm 
Optimization  (PSO).  Before  the  results  of  the  optimization  technique  applied  to  the  modeling  of  sEMG- 
force  relation  are  presented  a  brief  background  of  PSO  is  provided  in  section  1.7 


1.7  Particle  Swarm  Optimization  (PSO) 

In  1995,  a  new  evolutionary  algorithm  was  developed  by  J.  Kennedy,  a  social  psychologist,  and  R. 
Eberhart,  known  as  Particle  Swarm  Optimization  (PSO).  This  method  is  computationally  less  expensive 
and  has  been  used  in  this  section  to  optimize  the  Bayesian  filter  parameters  a  and  p.  Other  well  established 
optimization  algorithms  are;  a)  Genetic  Algorithm  (GA)  -  inspired  by  biological  evolution,  is  at  its  core, 
survival  of  the  fittest.  The  main  drawback  of  GA  being  that  it  is  computationally  very  expensive  especially 
for  large  search  spaces.  GA  has  been  paired  with  many  other  search  methods  in  order  to  improve  its  overall 
performance,  b)  Tabu  Search  on  the  other  hand  -  which  has  a  set  of  tabu  balls  and  promising  balls  or  a  tabu 
list  which  helps  it  to  reduce  the  search  space  is  not  very  computationally  expensive.  Particle  swarm 
optimization  has  a  simple  procedure;  1)  Defining  the  input  parameters:  This  includes  the  swarm  size 
(number  of  particles  of  the  swarm),  maximum  number  of  iterations,  the  limiting  velocity  of  the  particles, 
the  upper  and  lower  bounds  of  the  search  space  and  the  stopping  tolerance.  2)  Initializing  the  position  of  the 
particles  -  can  be  randomly  assigned  using  a  uniform  or  normal  distribution,  [1].  3)  Evaluating  the  fitness 
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function  fn  (objective  function)  for  the  7^*  particle.  This  depends  on  the  cost  function,  e.g.  the  local  best 
and  the  global  best  values  are  compared  and  suitably  updated.  Moreover,  the  difference  between 
\fn  {t)-  fn  {t  -  i.e.  the  current  (Oand(^-l)is  compared  to  the  tolerance  6*.  {t)-  fn  {t  -\)\<  s  , 

then  stop  the  loop;  otherwise  continue.  Figures  1.7  and  1.8  show  the  particles  of  the  PSO  in  the  search 
space  and  the  flow  chart  of  the  PSO  algorithm  respectively. 

Experiments  were  conducted  for  three  fingers,  the  index,  middle  and  the  ring  finger.  The  motions  simulated 
were  a)  pad  to  pad  grip  and  b)  a  power  grip,  while  measuring  the  force  developed  by  individual  fingers.  For 
the  ring  finger,  the  motion  to  generate  the  force  signal  was  randomized  (the  levels  of  force  signal  generated 
by  the  subject  varied  significantly  over  one  experiment,  in  all  six  experiments  were  carried  out).  This  was 
done  in  order  to  have  poor  correlation  between  the  sEMG-Force  signals  analyzed  for  various  time 
windows.  For  the  index  and  the  ring  finger  four  experiments  were  conducted  for  each.  The  motion  to 
generate  the  force  signal  was  made  cyclic  in  order  to  have  high  correlation  between  the  sEMG-Force 
signals.  Cyclic  motion  was  considered,  in  this  case,  to  study  the  effects  of  fatigue  as  time  progressed  on 
system  identification  and  the  Hammerstein- Wiener  modeling.  Data,  for  the  ring  finger  (random  motion), 
was  collected  for  30,  45  and  60  seconds. 

xj  {t)  The  component  position  of  the particle  in  time  t. 

^■flbest  local  best  position  of  the particle  in  generation  t. 

^j,gbest  The  global  best  position  of  the  particle  in  generation  t. 

v/  (t)  The  component  velocity  of  the  particle  in  time  t. 

t  time. 


Figure  1.7:  Previous  &  Updated  Position  of  particles  [19] 


Figure  1.8:  Particle  Swarm  Optimization  Algorithm  Loop 
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Data  for  the  middle  and  index  fingers  was  collected  for  30  and  45  seconds.  The  subject  performed  a 
cyclic  and  random  series  of  flexion’s  and  contractions  with  the  ring  finger  at  constant  and  random  speeds. 
Again,  the  randomness  was  necessary  in  order  to  ensure  that  the  system  is  excited  at  all  modes.  During  the 
experiment  all  fingers  were  flexed  in  order  to  generate  the  force  and  sEMG  signal.  As  a  consequence  of 
which  there  was  substantial  cross  talk  in  the  measurements. 

Cyclic  and  Random  Data  Analysis: 

As  mentioned  earlier,  experiments  were  carried  out  a)  in  a  cyclic  motion,  to  have  a  cyclic  change  in  the 
sEMG  and  force  signal  so  that  the  effects  of  fatigue  could  be  studied  and  b)  in  a  random  manner  (with 
fatigue  induced  by  repetition)  to  investigate  how  the  Hammerstein- Wiener  model  parameters  (model  order) 
change  with  time.  For  the  cyclic  case,  experiments  were  conducted  on  the  index  and  the  middle  finger, 
while  the  ring  finger  was  used  for  the  random  case.  In  all,  for  the  cyclic  case  four  experiments  each  were 
conducted  on  the  index  and  middle  finger  and  the  data  analyzed.  The  sEMG  data  was  filtered  using  a 
Chebyshev  filter  and  a  Half-Gaussian  filter.  Hammerstein- Wiener  models  were  tested  by  varying  nj^  and 
n j-  values  for  both  the  cases.  The  data  sets  for  the  cyclic  variation  were  collected  for  30  seconds.  This  data 

set  was  then  split  into  smaller  windows;  an  example  of  the  windows  used  for  estimation  and  validation  of 
the  modeling  is  shown  in  Table  1.4,  where  'ze’  is  the  time  interval  that  was  used  for  the  model  estimation 
and  ‘zv’  is  the  time  interval  used  for  model  validation.  A  small  overlapping  time  window,  with  the 
estimated  model  is  used  for  the  validation  model. 

Table  1.4:  Modeling  Time  Windows  Cyclic  Motion  (Index  &  Middle  Fingers) 


ze  (sec) 

zv  (sec) 

0.5-6.5 

2.5-8.5 

6.5-13.5 

9.5-16.5 

13.5-19.5 

16.5-22.5 

17.0-23.0 

20.0-26.0 

In  all,  the  total  time  intervals  for  which  models  and  fits  were  computed  for  the  index  finger  alone,  were 
4(time  intervals  per  experiment)  x  4(experiments)  x  49  (models  per  window  by  varying and  nj-)  x  2 

(filtering  methods)  =  1,568  different  models.  This  was  also  repeated  for  the  middle  finger  (1,568  different 
models).  For  the  random  motion/force  variation  scenario;  8(time  intervals  per  experiment)  x  7(experiments) 
X  49  (models  per  window  by  varying and  n^)  x  2  (filtering  methods)  =  5,488  different  models  were 

analyzed.  It  is  not  feasible  to  show  all  the  results  of  all  the  models  here,  but  examples  are  provided  along 
with  some  of  the  results  in  the  following  tables  as  to  how  the  modeling  was  affected  for  the  various  time 
intervals  and  motion/force  variations.  Also,  for  the  random  scenario,  PSO  was  used  to  investigate  a  relation 
between  the  filter  parameters  a  and  ^  and  also  to  investigate  the  effect  of  fatigue  on  the  model  outputs.  The 
results  of  the  PSO  optimization  are  summarized  in  Figure  1.9.  From  the  results  it  can  be  concluded  that  a 
values  between  1.5  to  2.9e-6  and  ^  values  between  2.6-3.7e-26  are  more  likely  to  give  better  fits  for 
nonlinear  Hammerstein- Wiener  models.  The  fits  are  not  very  conclusive,  as  the  fit  values  for  experiment  1 
are  not  very  high  (probably  the  search  space  for  a  and  P  would  need  to  be  expanded)  as  compared  to  the 
other  experiments  for  the  initial  time  windows,  where  one  would  not  expect  any  fatigue. 
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Figure  1.9:  Results  of  PSO  for  six  experiments.  Axes  are  Alpha,  Beta  and  Fit  values 

But  a  trend  could  be  observed,  as  fatigue  sets  in  towards  the  last  time  window  of  almost  all  the 
experiments,  the  fit  %  dropped,  except  for  experiments  5  and  6  where  the  fit  values  remained  high.  This 
indicates  that  as  the  muscle  fatigue  increases,  it  directly  deteriorates  the  input  sEMG  signals  relation  to 
force.  This  casts  a  doubt  on  the  effectiveness  of  the  nonlinear  blocks  in  the  Hammerstein- Wiener  models 
investigated.  From  these  results,  it  could  be  concluded  that  a  thorough  investigation  into  the  nonlinear 
block  would  be  needed  to  capture  the  dynamics  of  fatigue  and  to  compensate  for  the  detrimental  effects  it 
has  on  modeling  the  sEMG-force  signals.  Figure  7  shows  some  of  the  results  for  the  index  finger,  nonlinear 
Hammerstein- Wiener  models  investigated  for  the  experiments.  The  red  plot  is  of  the  signal  used  for  model 
estimation,  the  green  plot  is  of  the  signal  used  for  validation  of  the  model  and  the  blue  plot  is  of  the  entire 
data  spectrum  for  that  experiment  for  Figure  1.10  (a)  &  (b).  Figure  1.10(a)  captures  the  data  spectrum  of 
the  input  and  output  signal,  1.10b)  is  of  the  amplitude  and  the  frequency  content  of  the  data  sets,  1.10(c) 
plots  the  model  residuals  and  the  autocorrelation  and  the  cross-correlation  of  the  signals,  1.10(d)  shows  the 
model  outputs  to  the  original  signal,  1.10(e),  (f)  and  (g)  are  the  input  nonlinearities,  the  linear  block  and  the 
output  nonlinearity  blocks  of  the  Hammerstein- Wiener  models.  1.10(h)  represents  a  contour  plot  of  the  fit 
values  for  the  various  models. 
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Figure  1.10:  a)  EMG  Index  Finger  Data  Spectrum,  b)  Frequency  content  of  signals  c)  Model  Residuals  & 
Auto-correlation  and  Cross-correlation  of  signals,  D)  Model  outputs,  e)  Input  nonlinearity,  f)  Finear  block, 

g)  Output  nonlinearity 


The  description  given  previously  is  applicable  to  Figure  1.11.  The  results  shown  in  Figure  1.11  are  for  the 
Middle  finger. 
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Figure  1.11:  a)  EMG  index  Finger  Data  Spectrum,  b)  Frequency  content  of  signals,  c)  Model  residuals  & 
Auto-correlation  and  Cross-correlation  of  signals,  D)  Model  outputs,  e)  Input  nonlinearity,  f)  Finear  block, 

g)  Output  nonlinearity 


From  the  experiments  and  the  Hammerstein- Wiener  modeling  it  was  concluded  that,  a)  the 
Hammerstein- Wiener  models  do  capture  the  dynamics  of  the  sEMG-Force  data,  very  well,  for  all  the  three 
fingers  tested  (in  the  range  of  65  to  82%  model  fits).  This  statement  holds  true  for  all  the  initial  time 
windows  in  the  experiments.  But  the  model  fits  deteriorate  (between  17-25%)  as  fatigue  in  the  muscle 
increases  b)  The  Half-Gaussian  filtering  of  the  sEMG  signal,  used  for  modeling,  yielded  better  results  than 
the  Chebyshev  filtering  of  sEMG  (about  7-12%  more),  c)  A  change  in  the  piecewise  linearity  hinction  in 
the  Hammerstein- Wiener  modeling  did  have  a  significant  effect  on  the  model  fit  value,  d)  Although  the 
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PSO  did  not  offer  concrete  results  about  the  effect  of  fatigue  on  the  filter  parameters  a  and  it  did  throw 
some  light  on  the  possibility  of  expanding  the  search  area  for  these  parameters,  which  could  assist  in 
modeling  the  sEMG-force  signals,  especially  with  muscle  fatigue. 


One  of  the  results  of  this  study  was  further  expanded;  the  optimization  scheme  of  PSO.  A  hybridized 
PSO  and  Tabu  Search  (TS)  algorithm  was  developed  and  tested  for  unconstrained  and  optimization 
problems.  This  hybrid  algorithm  was  tested  for  some  commonly  used  benchmark  problems  from  literature. 
The  next  section  1.8  presents  a  brief  background  of  the  hybrid  PSO-TS  algorithm  developed  and  the  results 
obtained  for  various  benchmark  problems. 

1.8  Hybrid  PSO-TS  Algorithm 

Meta-heuristic  approaches  such  as  Particle  Swarm  Optimization  (PSO)  and  Tabu  Search  (TS) 
algorithms  have  been  around  for  a  few  years.  They  present  alternative  approaches  to  find  optimality  for  a 
diverse  set  of  optimization  problems,  such  as  estimation  and  system  identification,  among  others.  PSO  and 
TS  based  approaches  stand  in  contrast  to  hard  computing  methods  such  as  gradient  based  methods  by 
vastly  reducing  the  computational  complexity,  especially  for  higher  dimensional  problems.  A  key 
motivation  for  using  these  soft-computing  algorithms  is  the  ability  to  escape  local  optimal  points  in  pursuit 
of  the  global  optimum  during  the  search  process.  The  PSO  algorithm  searches  the  cost-surface  with  a  set  of 
individual  particles,  each  representing  a  solution  to  the  optimization  problem.  The  particles  orient 
themselves  via  influence  components  such  as  inertia,  current  best  solution  found  by  the  entire  flock,  and  the 
particle’s  best  position.  TS  was  presented  by  Glover,  [20],  as  an  iterative  optimization  procedure  that 
attempts  to  avoid  the  shortfalls  of  the  Local  Search  (LS)  algorithm.  TS  is  a  single  agent  algorithm  that 
progresses  through  the  cost  surface  by  creating  a  set  of  neighbors  (which  are  potential  new  locations)  and 
moves  to  a  new  location  by  evaluating  these  neighbors  and  comparing  them  to  a  list  of  previously  visited 
locations.  This  list,  the  tabu  list,  ensures  that  no  cycling  will  occur  and  local  optimal  points  are  overcome. 

Recent  efforts  in  improving  PSO  and  TS  have  led  to  a  number  of  propositions  that  include  concepts 
from  other  optimization  philosophies.  In  [21]  the  authors  proposed  a  TS-Genetic  Algorithm  based  scheme 
to  find  best  parameter  estimates  in  colored  noise  environments.  Higashitani  et  al,  [22]  proposed  a  predator- 
prey  based  PSO.  The  Constriction  Factor  Method  (CFM)  proposed  by  Clerc  [23]  reduces  the  velocity  of  the 
particles  with  duration  of  the  search  process  in  order  to  facilitate  the  intensification  over  the  diversification 
mission  with  time.  Combinations  of  PSO  and  TS  have  also  been  investigated,  such  as  in  [24],  where  PSO 
and  TS  are  switched  at  each  step  to  explore  the  vicinity  of  the  particles,  and  in  [25]  where  TS  and  PSO  and 
sequential  quadratic  programming  are  combined.  In  [26]  concepts  of  TS  are  used  to  create  two  swarms  in 
PSO,  one  responsible  for  intensification,  the  other  for  diversification. 

In  this  hybrid  algorithm,  various  elements  of  the  TS  algorithm  were  applied  to  the  PSO  scheme.  In 
particular,  the  TS  concept  is  used  to  adapt  the  PSO  parameters  to  the  given  problem  using  a  parallel  scheme 
of  hybridization.  The  optimization  problems  addressed  in  this  section  are  of  the  unconstrained  type. 

The  problem  statement  is  as  follows: 

Consider  a  real  valued  objective  function  / (x)  defined  on  a  set  X  G  iS  in  i?”  .  We  are  tasked  to  find 
a  point  X  corresponding  to  the  value  of  /  (x  )  such  that 
/(x*)  =  min{/(x)|xG  5}  (1.15) 

The  difficulty  of  finding  such  a  point  arises  when  f  (x)  or  the  feasible  domain  S  is  non-convex.  For 

such  problems,  gradient  based  methods  will  result  in  local  optimums.  Soft  computing  methods  such  as  PSO 
and  TS  allow  for  an  escape  from  local  optimums  and  the  continued  search  for  a  better  optimum,  in  the 
extreme  case  the  global  optimum.  For  PSO  algorithms,  we  consider  a  set  of  particles  p  and  their 

associated  location  X^  where  i  is  the  index  for  the  particles.  The  particles  explore  S  in  an  incremental 
fashion.  Their  position  is  altered  at  each  step  by  the  following  update  rule: 

x'  -h  l)  =  x'  (^)  -h  v'  -h  l),  (1-16) 

where,  k  is  the  increment  number  and  the  velocity  associated  with  the  particle,  which  can  be  computed 
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(1.17) 


as  follows: 

v'  (A:  + 1)  =  wV{k)  +  qr;  [b’^  -  x'  (A:)]  +  Cjrj  [b^  -  x'  (A:)] . 

In  the  velocity  update  formula,  and  represent  the  best  ever  position  of  the  particle  i  and  the  global 

best  position  of  the  swarm  up  to  iteration  k,  respectively.  ri  and  r2  are  uniformly  distributed  random 
numbers  between  0  and  1,  while  w,  cj  and  q  are  weighting  coefficients  that  manage  the  three  tendencies  of 
Equation  (1.17).  These  tendencies  as  given  by  the  three  terms  in  the  velocity  equation  are  characterized  as: 
audacious  for  following  your  own  way;  conservative,  for  going  back  towards  your  best  previous  position; 
and  sheep-like,  for  being  pulled  to  the  best  overall  position.  The  weighting  coefficients  help  the  balancing 
act  of  combining  these  tendencies  in  order  to  be  globally  efficient.  The  PSO  scheme  described  so  far  is 
rather  simple  and  computationally  very  efficient,  especially  when  compared  to  a  GA  or  any  gradient  based 

methods.  To  further  this  algorithm,  a  limitation  on  the  maximum  value  of  V  can  be  imposed,  say  . 

This  type  of  velocity  clamping  balances  the  exploration  and  intensification  and  also  avoids  excessive 
velocities  that  are  responsible  for  particles  overshooting  their  targets,  [27].  Also,  the  CFM  method  can  be 
employed,  where  the  velocity  update  is  modified  -  reduced  -  as  the  search  progresses. 

For  this.  Equation  (1.17)  is  altered  as  follows: 

v'  (A:  +  l)  =  .^:x[v'(A:)  +  Cjr,  (b;,  -x'(A:))]  +  .^:x[+c2r2(b;  -x'(A:))]  (1.18) 

2 

Where,  K  = - .  and  (p  =  ,  as  given  by  [23]. 

2-(p-^p  -Acp 

The  inertia  weight  w  has  a  competing  purpose  to  the  velocity  clamping  method  [28],  and  is  responsible 
for  balancing  the  exploration  and  intensification  part  of  the  PSO.  In  [29]  it  is  also  shown  that  w  is  problem 
dependent.  Here  we  investigate  the  option  of  adapting  iv  using  a  TS  based  scheme  such  that  the  PSO 
algorithm  becomes  less  problem  dependent.  Besides  w  ,  q  and  C2  control  the  stochastic  influence, 
analogous  to  the  mutation  operator  in  GA.  In  [30],  it  is  stated  that  for  most  problems  the  popular  choice  in 
literature  is,  q  =  C2  ,  but  the  ratio  is  also  problem  dependent,  i.e.  for  unimodal  problems  with  smooth 

surfaces,  usually  one  selects  C2  >  ,  while  for  multimodal  problems  these  coefficients  are  chosen  to  be 

Cj  >  C2  .  Also  the  optimization  of  these  coefficients  is  implemented  using  TS  scheme  in  parallel  to  the 
PSO. 

The  TS  algorithm  has  the  same  objective  as  PSO-  given  by  Equation  1.15.  A  TS  algorithm  employs  one 
candidate  point,  which  moves  incrementally  on  S  .  The  moves  between  increments  are  defined  by  selecting 
the  best  update  from  a  set  of  candidate  points.  This  set  is  created  by  forming  R  ^  n  -dimensional  spheres 
about  the  current  position,  and  randomly  place  a  point  in  each  section  (sphere).  These  points  are  evaluated 
on  /(x)  and  then  compared  to  a  list  T  e  of  previously  visited  places.  The  list  length  q  basically 

represents  the  memory  of  the  algorithm.  Around  each  element  in  T  a  n -dimensional  sphere  is  created 
serving  as  a  tabu-ball,  where  no  new  solution  can  be  located.  The  best  performing  candidate  point  not 
violating  the  restricted  spaces  given  by  the  q  tabu  balls  is  selected  as  the  new  position  of  the  search.  An 
aspiration  criterion  can  be  formulated  as  an  escape  clause  to  circumvent  the  restrictions  imposed  by  the 
tabu-balls,  often  in  the  form  of  having  an  improved  cost  to  the  current  solution.  All  of  the  past  best 
solutions  are  stored  in  a  new  list  -  the  promising  list,  which  is  assembled  as  the  TS  algorithm  processes. 
The  optimum  of  the  entries  of  that  list  will  be  used  as  the  final  optimal  value  of  the  algorithm. 

Usually,^,/?  ,  and  the  dimension  of  the  individual  s  are  considered  the  control  parameters  of  the 
TS  algorithm,  which  are  all  problem  dependent. 

The  selection  of  w ,  ,  and  C2  have  rather  large  implication  on  the  update  of  the  new  velocity  vector 

v'  (A:  +  1)  ,  as  is  illustrated  in  Figure  1.12.  Here,  the  three  influence  vectors  with  regard  to  the  global  best 

solution,  “X  ^  and  with  regard  to  the  particles  best  solution  -x  (A:)  as  well  as  the  inertia  vector 
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v'  (^  + 1)  are  depicted  for  an  instant  k  and  a  single  particle  i.  Each  of  these  vectors  are  pre-multiplied  by 
w ,  Cj ,  and  C2  respectively,  resulting  into  some  variation  of  the  vectors,  denoted  by  A  in  Figure  1.12. 


Location  of 


Figure  1.12:  Adaptation  of  proposed  PSO-TS  Algorithm 

As  stated  earlier,  these  three  influence  coefficients  are  problem  dependent.  Here  the  optimal 
coefficients  are  found  by  utilizing  TS.  This  is  accomplished  by  using  the  variation  of  the  influence  vectors 

to  describe  a  new  search  area,  in  which  the  original  cost  function  f  is  prescribed.  In  Figure  1.12,  this 
area  is  symbolized  in  the  shaded  ellipsoid.  The  best  combination  of  coefficient  along  with  the  influence 
vectors  will  then  determine  the  velocity  update  v'  (^  + 1)  .  This  optimization  is  repeated  at  each  increment. 

TS  lends  itself  well  for  this  purpose,  since  it  is  computationally  very  efficient.  Since  rj  and  r2  are 
superimposed  to  the  influence  coefficients,  we  will  investigate  an  option  where  this  randomization  is 
suppressed. 

Parameter  estimation  is  an  important  concept  in  engineering  where  a  mathematical  model  of  a  system  is 
identified  with  the  help  of  input  and  output  signals.  The  classical  Feast-Squares  (FS)  algorithm  gives  an 
unbiased  estimate  of  the  parameters  when  the  system  noise  is  white.  A  bias  result  may  occur  if  the  residual 
=  y{k)  —  y{k)  is  not  white,  where  y  is  the  system  output,  y  is  the  estimated  output,  and  k  is  the 

discrete  time  index.  For  such  instances,  one  can  use  a  whitening  filter,  i.e.  C{q~^)£{k)  -  e{k) ,  where 

C(z~  )  is  the  coefficient  polynomial  of  the  whitening  filter  and  z  ^  is  the  backward  shift  operator.  The 
corresponding  cost  function  for  the  estimation  becomes,  [21]: 

J  =  Y,e\k)  =  Y,[C{z')A{z')y{k)  +  C{z)B{z')u{k)-i  (I.19) 

where,  i/(A:)  is  the  input  sequence,  A(z~^)  and  B(z~^)  are  the  numerator  and  denominator  polynomials  of 
the  system  transfer  function,  respectively.  As  the  signal  to  noise  ratio  becomes  large,  the  cost  function  J 
may  become  multimodal.  This  was  shown  by  Soderstrom  et  al.  [31].  In  order  to  obtain  the  global  minimum 
an  intelligent  optimization  technique  needs  to  be  employed.  Here  the  proposed  hybrid  PSO-TS  algorithm  is 
also  tested  against  such  a  parameter  estimation  problem  with  a  colored  noise  environment  and  compared  to 
the  traditional  FS  method. 

The  proposed  hybrid  algorithm  was  tested  on  a  set  of  standard  optimization  benchmark  problems,  which 
are  listed  below: 


Spherical: 

i=i 


(also  known  as  De  Jong’s  hinction)  and 
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Figure  1.13:  Plot  of  the  Sphere  or  De  Jong’s  Function,  [32-33] 
Quadratic:  /  =  ? 

Where  x.  e  [-100,100]  and  /(x*)  =  [0,0]. 


n 

Hyperellipsoid:  / (x)  =  ^  where  Xj  e  [-1, l]  and  /  =  [O,  O] . 

7=1 


Figure  1.14:  Plot  of  the  Hyper-Ellipsoid  Function,  [32] 

Bohachevsky  1: 

/  (x)  =  -h  2X2  -  0.3  cos  (3;rx^ )  -  0.4  cos  (4;z-X2 )  +  0.7  where  Xj  e  [-50, 50]  and  /  (^x*  ^  =  [O,  O] . 
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Figure  1.15:  Plot  of  the  Bohachevsky  I  Function,  [33] 


Figure  1.16:  Plot  of  the  Rastrigin  Function,  [33] 


^  r  2  2 

Rosenbrock:  /  (x)  =  ^  100  {^x^.  -  xl._^  ^  ) 

/K)=[u]^ 


2=1 


where  e  [-2.048, 2.048]  and 
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Figure  1.17:  Plot  of  the  Rosenbrock  Function,  [32] 


Haupt  &  Haupt:  f  (x)  =  sin(4x^ )  +  l.lx^  sin(2x2 )  ,  where  Xj  e  [0,10]  and 

/(x*)  =  [9.0389,8.6674]. 


Figure  1.18:  Plot  of  the  Haupt  &  Haupt  Function 


In  addition  to  these  benchmark  problems,  the  proposed  algorithm  was  also  tested  for  a  parameter 
estimation  problem  with  a  colored  noise  environment.  In  particular  the  simple  parametric  model  given  by 
Equation  (1.20): 

j;(^)  =  0.5j(A:-I)-0.5j;(^-2)  +  w(A:)  +  ^(^)  (1.20) 

The  simulation  was  carried  out  by  using  the  following  set  of  parameters  and  conditions:  uniformly 
distributed  initial  locations  of  particles,  number  of  neighborhoods  created  at  each  step  for  each  particle 
R  =  25  ,  uniform  initial  velocity  of  magnitude  1  for  all  particles,  p  =  40  ,  q  =  5  ,  radius  of  the  n 

dimensional  Tabu  balls:  r  -  O.OlSix  -x  .  ),  where  x  and  x  .  are  the  dimensions  of  S ,  radius  of 

neighborhood  =  0.5r  ,  and  radius  of  promising  balls  =  0.5r^  .  The  PSO  portion  utilized  100 

iterations,  while  the  embedded  TS  section  used  10  iterations.  Since  randomness  is  a  factor  in  the  used  and 
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proposed  algorithms,  and  in  order  to  gain  some  kind  of  understanding  of  consistency,  the  simulations  were 
carried  out  100  times  for  each  cost  function  listed  above. 


Table  1.5:  Simulation  results  for  Benchmark  Problems  using  Hybrid  PSO-TS  Algorithm  (Random  rj  and 

^2) 


Cost  Function 

PSO 

Hybrid  PSO-TS 

w 

w,  cl 

W,CiC2 

Spherical 

0.55135 

0.17214 

0.0555 

0.2216 

Quadratic 

0.50718 

0.25637 

0.12497 

0.1347 

Bohachevsky 

0.80852 

0.17689 

0.15473 

0.01617 

Hyperellipsoid 

0.03252 

0.00436 

0.00745 

0.00069 

Rastrigin 

0.07168 

0.16678 

0.16728 

0.16021 

Rosenbrock 

1.4261 

1.43255 

1.47011 

1.44042 

Haupt 

12.4736 

10.5563 

10.5329 

11.5222 

Table  1.5  lists  the  results  for  the  unconstraint  optimization  problems  in  comparison  with  the  original  PSO 
algorithm.  In  this  set  of  simulations,  ry  and  r2  were  selected  to  be  uniform  random  between  0  and  1. 

Table  1.6  lists  the  results  for  the  unconstraint  optimization  problems  in  comparison  with  the  original  PSO 
algorithm.  In  this  set  of  simulations,  ry  and  r2  were  set  equal,  at  all  times,  to  1.  It  is  interesting  to  note  that 
for  almost  all  the  cases,  the  proposed  hybrid  optimization  algorithm,  regardless  of  which  set  of  coefficients 
are  optimized,  performs  significantly  better  in  comparison  to  the  standard  PSO  for  the  Hyperellipsoid,  the 
Bohachevsky  cost  function.  For  this  case  too,  the  spherical  and  the  quadratic  functions  produced  better 
results.  In  both  the  cases  there  was  no  improvement  in  the  Rosenbrock  function  values  and  the  Rastrigin 
still  showed  poor  results  as  compared  to  the  standard  PSO  algorithm. 

The  distinction  between  the  characteristics  of  the  cost  function  and  the  performance  of  the  proposed 
algorithm  can  be  made  by  associating  the  presented  results  with  unimodal  and  multimodal  cost  functions. 
As  listed  above,  the  improved  performance  given  by  the  proposed  hybrid  algorithm  is  found  for  unimodal 
cost  functions.  While  the  proposed  algorithm  does  work  well  for  multimodal  cost  functions,  it  does  excel  in 
comparison  to  the  standard  PSO  algorithm  with  regard  to  unimodal  functions. 


Table  1.6:  Simulation  results  for  Benchmark  Problems  using  Hybrid  PSO-TS  Algorithm 
, _ ^ _ (ri  =  r2) _ ^ 


Cost  Function 

PSO 

Hybrid  PSOTS 

w 

w,  cl 

W,CiC2 

Spherical 

0.55135 

0.08975 

0.19801 

0.81325 

Quadratic 

0.50718 

0.31023 

0.14124 

0.07529 

Bohachevsky 

0.80852 

0.13091 

0.20773 

0.15158 

Hyperellipsoid 

0.03252 

0.01464 

0.01736 

0.00278 

Rastrigin 

0.07168 

0.13648 

0.23206 

0.4902 

Rosenbrock 

1.4261 

1.44026 

1.44147 

1.39044 

Haupt 

12.4736 

10.6342 

10.8366 

10.8408 

The  hybrid  algorithm  was  also  tested  to  estimate  the  parameters  of  the  system  given  by  equation  (1.20). 
The  estimated  system  parameters  are  given  in  Table  1.7  for  the  two  cases  a)  Random  ry  and  r2  and  b)  Fixed 
V]  and  r2  to  unity.  In  addition,  we  distinguished  two  cases  where  we  either  computed  the  instantaneous 
optimum  value  of  the  influence  coefficients  and  the  accumulated  “averaged”  optimum.  The  variance  in  the 
noise  was  set  at  1%,  while  the  input  sequence  was  a  white  noise  sequence  with  variance  of  30%. 
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Table  1.7:  Simulation  results  for  Estimation  Problem 


1  Random 

Accumulative 

w 

0.5898 

-0.4583 

1.0425 

w,cl 

0.5319 

-0.3717 

1.1217 

w,cl,c2 

0.4704 

-0.4666 

0.8921 

Just  Optimum 

w 

0.5340 

-0.5159 

1.0025 

w,cl 

0.5339 

-0.5234 

1.0550 

w,cl,c2 

0.4820 

-0.4622 

1.0110 

1  Fixed 

Accumulative 

w 

0.5289 

-0.3794 

1.0061 

w,cl 

0.5018 

-0.3799 

1.0777 

w,cl,c2 

0.478 

-0.4917 

0.9182 

Just  Optimum 

w 

0.4707 

-0.4827 

1.0515 

w,cl 

0.4797 

-0.4397 

1.0260 

w,cl,c2 

0.5074 

-0.5164 

0.9794 

The  hybrid  algorithm  gave  the  best  estimated  values  of  the  system  parameters  for  the  following 
combination;  Fixed  ry  and  r2,  just  optimum,  w,  Cj,  C2  optimized,  and  40  particles.  Table  1.7  is  giving  the 
average  values  based  on  10  sample  points.  This  combination  was  then  used  to  compare  the  results  of  the 
hybrid  algorithm  with  Least  Squares  (LS).  Table  1.8  shows  the  comparison  between  LS  and  the  proposed 
hybrid  algorithm  for  various  variances  in  the  noise  level.  The  hybrid  PSOTS  again  outperforms  the  LS 
method  in  almost  all  the  cases  and  in  some  estimated  values.  These  cases  are  highlighted  in  bold  italics. 
Simulation  runs,  for  the  hybrid  algorithm,  for  variances  0.05,  0.09,  0.1  and  0.2  were  increased  from  10  to 
30  which  gave  slightly  better  results  once  again  in  comparison  to  the  LS. 


Table  1.8:  Comparison  of  Hybrid  PSOTS  &  Least  Squares 


Simulation  Options:  Optimized  w,cl,c2,  Fixed  n  and  rz 
and  Just  Optimum,  Simulation  Runs  :  10 

Hybrid  PSOTS 

Least  Squares 

Variance:  0.001 

[0.5265,-0.4688,0. 9695] 

[-0.00640,-0.4238,0.8794] 

Variance:  0.005 

[0.5256,-0.5206,1.0531 ] 

[0.0005,-0.5050,0.8703] 

Variance:  0.009 

[0.5289,-0.4394,0.9640] 

[0.0640,-0.5395,0.8626] 

Variance:  0.01 

[0.5074,-0.5164,0.9794] 

[0.0208,-0.4711,0.8592] 

Variance:  0.05 

[0.4183,-0.3988,0.9539] 

[0.1354,-0.5345,0.8100] 

Variance:  0.09 

[0.3300,-0.2699,0.9840] 

[0.0981,-0.7102,0.9573] 
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Variance:  0.1 

[0.4035,-0.3056,1.0322] 

[0.1276,-0.6684,0.8821] 

Variance:  0.2 

[0.2952,-0.1684,0.9861] 

[0.0418,-0.7096,0.9323] 

Variance:  0.05,  Simulation  runs:30 

[0.4476,-0.3844,1.0049] 

[0.1354,-0.5545,0.8100] 

Variance:  0.09,  Simulation  runs:30 

[0.3852,-0.3505,0. 9672] 

[0.0981,-0.7102,0.9573] 

Variance:  0.1,  Simulation  runs:30 

[0.4129,-0.3550,0.9922] 

[0.1276,-0.6604,0.8821] 

Variance:  0.2,  Simulation  runs:30 

[0.3072,-0.2769,0.9970] 

[0.0418,-0.7096,0.9323] 

A  key  objective  of  this  hybridization  was  to  make  the  proposed  algorithm  adaptive  in  nature  to  the 
subjected  problem,  i.e.  cost  function.  As  discussed  earlier  the  choice  of  the  influence  coefficients  is 
dependent  on  the  characteristics  of  the  cost  surface.  The  proposed  hybrid  algorithm  optimizes  these 
coefficients  as  well  as  the  inertia  coefficient  w  at  each  iteration.  Hence  we  can  plot  these  coefficients  in 
order  to  determine  if  they  show  adaptation  and  consistency.  This  is  done  in  Figure  1.19. 
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Figure  1.19:  Plot  of  the  Optimized  Influence  Coefficients 


- cl 

- c2 

w 


The  plot  is  a  representative  characterization  of  the  simulation  results  obtained  for  the  tested  multimodal 
cost  functions.  It  can  be  observed  from  the  plot  that  the  proposed  algorithm  adapts  fast  to  the  cost  function 

and  selects  q  >  C2  as  determined  in  the  literature,  indicating  that  each  particle  is  dominated  by  its  own 

personal  best,  and  the  algorithm  is  searching  wider  ranges.  The  rather  non-smooth  convergence  plot  is  due 
to  the  fact  that  rj  and  r2  are  kept  random  and  impose  a  perturbation  to  the  optimal  location  of  the  influence 
coefficients.  In  comparison,  the  same  plots  are  generated  for  some  multimodal  cost  functions,  i.e.  the 
Hyperellipsoid  in  Figure  1.20  and  Spherical  as  depicted  in  Figure  1.21.  In  both  cases  for  the  unimodal  cost 

functions,  the  coefficients  move  quickly  to  the  case  where  C2  >  as  given  in  the  literature,  but  after  a  few 
iterations,  the  weighting  is  switched  and  >  <^2  * 
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Figure  1.20:  Plot  of  the  Optimized  Influence  Coefficients  for  the  Hyperellipsoid  Cost  Function 
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Figure  1.21:  Plot  of  the  Optimized  Influence  Coefficients  for  the  Spherical  Cost  Function 

This  implies  that  the  particles  are  no  longer  are  dominated  by  the  global  optimum,  but  rather  by  their 
own  personal  best  performance  and  try  to  improve  their  performances.  An  explanation  for  this  is  found  by 
considering  the  convergence  plot,  as  detailed  in  Figure  1.22.  Here  we  can  see  that  most  of  the  convergence 
is  achieved  after  the  first  few  iterations. 

Once  not  much  improvement  is  found,  the  algorithm  tries  to  spread  out  and  search  larger  regions  rather 
than  concentrating  to  the  area  dominated  by  the  current  global  best  solution.  This  adaptation  may  explain 
the  cause  for  the  improved  performance  of  the  proposed  algorithm  for  unimodal  functions  compared  to 
standard  PSO  algorithms. 
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Figure  1.22:  Plot  of  the  Global  Best  Cost  vs.  Iteration  Index  for  the  Spherical  Cost  Function 

The  algorithm  developed  here  adapts  to  the  underlying  cost  surface  by  adjusting  the  influence 
coefficients  at  each  step.  The  proposed  algorithm  was  tested  on  a  series  of  benchmark  problems  and 
showed  improved  performance  for  the  unimodal  cost  functions.  In  addition,  the  hybrid  PSO-TS  algorithm 
was  tested  on  a  parameter  estimation  problem  where  colored  noise  influence  causes  bias  estimates  when  the 
LS  algorithm  is  used.  The  simulations  indicate  an  improved  estimate  when  the  proposed  PSO-TS  algorithm 
was  used. 

Another  area  of  research  focused  on  the  use  of  spatial  filters,  applied  to  an  array  of  sEMG  sensors,  to 
look  at  the  distribution  of  the  sEMG  signal  on  the  hand  near  muscles  of  interest  and  also  develop  or  modify 
the  currently  existing  spatial  filters  to  extract  useful  information  from  the  setup  we  were  using.  The 
objective  was  to  obtain  an  insight  into  the  ideal  placement  of  the  sensor  array  over  the  arm.  And  if  a  sensor 
array,  in  the  form  of  a  glove  is  developed,  this  research  could  be  expanded  to  accommodate  the  desired 
sensor  array  density  and  would  also  help  in  computing  the  spatial  filter  masks  to  be  applied  to  the  array. 
The  next  section  provides  a  detailed  description  of  the  spatial  filters  used,  comparison  of  the  seven  linear 
and  4  nonlinear  spatial  filters  to  4  HR  filters,  and  the  optimization  of  the  filter  masks  to  the  setup  that  we 
are  using. 

1.9  Spatial  Filtering: 

"Spatial  filtering"  is  broadly  defined  as  methods,  which  compute  spatial  density  estimates  for  events 
that  have  been  observed  at  individual  locations.  This  type  of  filtering  describes  a  set  of  tools  for  displaying 
functions  estimated  from  these  data  points,  which  are  generally  distributed  in  two-dimensional  space. 
Spatial  filtering  can  also  be  thought  of  as  a  form  of  data  smoothing  method,  which  is  designed  to  give  us  a 
clearer  view  of  the  general  underlying  information. 

Spatial  filtering  is  a  non-parametric  analysis  method,  which  belongs  within  the  field  of  exploratory 
spatial  analysis,  which  relies,  to  a  large  degree,  on  graphical  methods  of  analysis.  Spatial  filters  are  used 
when  there  is  no  a  priori  curve  to  fit  to  a  data  series.  Instead,  it  relies  on  nearby  or  adjacent,  values  to 
estimate  the  value  at  a  given  point.  These  filters  take  out  variability  in  a  data  set  while  retaining  the  local 
features  of  data.  By  varying  the  size  of  the  filter,  features  in  the  data  that  vary  at  different  spatial  scales  can 
be  differentially  removed.  Spatial  filtering  is  useful  as  an  exploratory  technique  for  identifying  areas  that 
are  homogeneous  or  areas  that  have  larger  or  smaller  values  than  which  generally  occurs. 

Spatial  filtering  is  principally  associated  with  digital  image  processing.  This  method  may  be  applied  to 
almost  any  type  of  grid/data  set  or  image  (which  contains  the  gray  scale  values  or  pixel  data  in  the  form  of 
a  grid).  This  term  can  also  be  used,  in  a  related  manner,  in  the  area  of  spatial  statistics.  The  most  commonly 
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provided  functions  of  spatial  filtering  are  the  so-called  low-pass  and  high-pass  spatial  filters.  These  are 
focal  functions  whose  operation  is  determined  by  a  kernel  or  neighborhood  of  NxN  cells  around  each 
pixel  or  grid  position,  [34].  Grid  cells  “covered”  by  a  kernel  are  multiplied  by  the  matching  kernel  entry 
and  then  the  weighted  average  is  calculated  and  assigned  as  the  value  for  the  central  cell,  G.  For  example, 
asymmetric  3x3  kernel  may  look  like  the  one  shown  in  (20),  or  any  combination  of  the  weights.  Typically 
a,  b  are  positive  integers.  If  a=b=l,  then  the  kernel  provides  a  simple  smoothing  or  averaging  operation. 
The  weights  in  the  kernel  can  be  modified  for  specific  cases  or  data  sets.  In  any  case  the  weighted  average 
is  divided  by  the  sum  of  the  elements  of  the  kernel.  Filters  of  this  type  are  sometimes  referred  to  as  low- 
pass  filters. 


a  a  a 


Symmetric  Kernel 


aba 


C1.21)) 


a  a  a 


If  the  weights  in  the  kernel  looks  like  the  one  in  (1.21)  and  a,  b,  and  c  are  positive  integers. 

c  a  c 

Symmetric  Kernel  with  different  weights  =  a  b  a 

c  a  c 


[1.22] 


And  if  the  following,  b>a>c,  is  true  then  the  kernel  is  described  as  a  Gaussian  filter  which  is  symmetric  but 
center-weighted. 

The  filtered  grid  value  ‘G'  of  an  m=AxA  kernel  matrix,  with  Q  set  of  coefficients  and  Pi  -  set  of  source  grid 
values,  is  calculated  as; 


G  =  ^ - +  B 

m 

ZC, 

i=\ 

Where,  B  is  often  set  to  0.  5  is  a  bias  term  to  increase  or  decrease  the  resulting  value  of  ‘G' 


C1.23] 


There  are  many  different  forms  of  spatial  filters  depending  on  the  weights  and  the  symmetry  associated 
with  the  kernel.  This  kernel  is  also  sometimes  referred  to  as  the  'filter  mask’.  Some  of  the  other  examples 
are  given  in  Table  1.8. 


Linear  Spatial  Filtering: 

Linear  spatial  filtering  modifies  an  image  ‘f  by  replacing  the  value  at  each  pixel  with  a  linear  function 
of  the  values  of  nearby  pixels  (This  same  analogy  can  be  applied  to  data  set  in  a  grid  format;  similar  to  the 
case  of  multiple  sEMG  sensors  placed  in  grid).  Moreover,  this  linear  function  is  assumed  to  be  independent 
of  the  pixel's  location  {k,  /),  where  {k,  1)  are  the  indices  of  the  pixels  in  f  which  is  represented  by  a  data 
matrix.  This  kind  of  operation  can  be  expressed  as  convolution  or  correlation.  For  spatial  filtering,  it's  often 
more  intuitive  to  work  with  correlation. 

The  filtered  result  g(k,  1)  is  obtained  by  centering  the  mask  over  pixel  {k,  1)  and  multiplying  the  elements  of 
/  with  the  overlapping  elements  of  the  mask  and  then  adding  them  up.  A  special  case  exists  when  the 
special  when  the  center  of  the  mask  is  on  the  boundary  of  f.  The  common  assumption  in  this  case  is  that  the 
data  matrix  is  periodic.  But  this  assumption  does  not  always  hold  true.  In  such  cases  the  non-existing 
entries  assumed  to  be  zero. 


Application  of  Spatial  Filters  to  sEMG  data  Array: 

Recording  and  analysis  of  Surface  EMG  (sEMG)  has  been  around  for  almost  a  century  now.  Surface 
electrodes  have  been  routinely  used  to  record  the  gross  electrical  activity  of  skeletal  muscles.  However, 
when  specific  information  about  individual  motor  unit  discharge  rates  or  recruitment  needs  to  be  extracted, 
sEMG  signal  have  been  treated  with  some  reservation.  So  previously,  in  most  cases,  intramuscular  EMG 
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recording  using  fine  wire  or  needle  electrodes  were  employed  to  selectively  record  the  single  motor  unit 
activity.  Invasive  recordings  of  sEMG  are  inconvenient,  do  induce  pain  to  the  subject  and  may  potentially 
damage  muscle  tissues  and  nerves.  In  recent  years,  considerable  efforts  have  been  directed  towards 
effectively  recording  single  motor  unit  activity  noninvasively  i.e.  using  surface  EMG  sensors. 

The  principle  underlying  this  approach  is  to  be  increasingly  selective  in  recording  the  information 
using  surface  EMG  electrodes.  In  other  words,  the  objective  is  to  amplify  the  activity  of  motor  unit/s 
located  closest  to  the  recording  site  (generally  the  actual  motor  location  for  the  particular  limb)  and 
reducing  the  EMG  signal  generated  by  other  motor  units  located  further  away. 


Table  1.8:  Linear  Spatial  Filters 


Filter  Type 


Filter 


Kernel 


a 

a 

a 

'0 

a 

0 

a 

b 

a 

9 

a 

b 

a 

a 

a 

a 

0 

a 

0 

Description 


Low-pass 

(symmetric) 


Averaging 


Smoothing,  Noise 
Reduction  or  Blurring 
Filter  (focal  mean) 


Gaussian 


c  a  c 
aba 
c  a  c 


Smoothing,  Noise 
Reduction  or  Blurring 
Filter  (focal  weighted 
mean) 


High-pass 

(symmetric) 


Sharpening 


-a 

— 

a 

-a 

-a 

+b 

-a 

-a 

- 

a 

-a 

“  0 

a 

0 

-a 

b 

-a 

0 

- 

a 

0 

a 

b 

a 

-a 

0 

0 

0 

9 

-b 

-a 

— 

b  ■ 

-a 

-a 

~  0 

-\-a 

+a 

-a 

-\-a 

+a 

-a 

- 

a 

0 

Mean  effect 
removal /sharpening 
filter  (focal  sum). 
Provides  limited  edge 
detection.  Typically 
entries  sum  to  1  but 
may  be  greater. 


Edge  Detection 


Kernel  highlights 
vertical  and  horizontal 
edges.  Typically  a=l, 
and  h=l  or  2  and 
entries  sum  to  0. 


Embossing 


Gradient 

(asymmetric) 


Enhance  edges  in  a 
selected  direction  to 
provide  embossed 
effect. 


Directional 


-1 

1 

r 

■  1 

1 

1  ■ 

-1 

-2 

1 

9 

1 

-2 

1 

-1 

1 

1 

-1 

1 

0 


2 

0 


1 

0 
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Many  types  of  linear  and  nonlinear  spatial  filters  have  also  been  studied  in  the  past  [35].  In  this  section 
comparison  of  a  few  linear  and  non-linear  spatial  filters  is  presented. 

Experiments  were  performed  using  multiple  sEMG  sensors  in  the  array  configuration  as  shown  in 
Figure  1.23.  Nine  different  experiments  were  conducted  and  the  corresponding  sEMG  was  measured 
simultaneously  from  all  the  different  sensors.  Information  regarding  the  various  experiments  is  given 
below; 


Figure  1.23:  Experimental  Setup  -  Location  of  sEMG  sensors  (3x3  Array) 


Experiment  1  -  Baseline  -  30  sec  -  No  Motion/  Force  -  Red  Stress  ball 
Experiment  2  -  Baseline  -  30  sec  -  No  Motion/  Force  -  Red  Stress  ball 
Experiment  3  -  30  sec  -  Ring  Finger  Grasping  Motion  -  Red  Stress  ball 
Experiment  4  -  30  sec  -  Ring  Finger  Grasping  Motion  -  Red  Stress  ball 

Experiment  5-45  sec  -  Ring  Finger  Grasping  Motion  with  Thumb  Restrained  -  Red  Stress  ball 
Experiment  6-45  sec  -  Ring  Finger  Grasping  Motion  with  Thumb  Restrained  -  Red  Stress  ball 
Experiment  7-45  sec  -  Ring  Finger  Grasping  Motion  with  Thumb  Restrained  -  Yellow  Stress  ball 
Experiment  8-45  sec  -  Ring  Finger  Grasping  Motion  with  Thumb  Restrained  -  Yellow  Stress  ball 
Experiment  9-60  sec  -  Ring  Finger  Grasping  Motion  with  Thumb  Restrained  -  Red  Stress  ball 

The  sensors  used  for  measuring  the  sEMG  action  potentials  were  three  pronged  DE  3.1  differential 
surface  electrodes.  The  electrodes  were  placed  along  the  muscle  fibers  (Flexor  Digitorum  Superficialis)  for 
recording  sEMG.  Multiple  sEMG  sensors  in  an  array  configuration  were  mounted  on  and  around  the 
identified  motor  unit,  as  shown  in  Figure  1.23.  The  subjects’  hand  was  placed  on  a  flat  surface;  the 
reference  electrode  was  placed  on  the  elbow  where  there  is  no  sEMG  signal.  Sensor  CHI  was  placed  on  the 
identified  motor  unit  location.  CH2  and  CHS  were  placed  along  the  muscle  fiber  in  front  and  behind  CHI 
respectively.  Channels  4-9  were  placed  in  the  orientation  as  shown  in  Figure  1.23. 

Experiments  1  and  2  were  conducted  to  give  an  insight  into  the  sEMG  generated  by  the  subject’s  hand, 
in  the  absence  of  any  motion  or  force.  Also,  a  thumb  restrain  was  used  to  limit  the  influence  of  thumb  while 
application  of  force  to  the  stress  ball.  A  Force  Sensitive  Resistors  (FSR)  was  mounted  on  the  stress  ball  to 
record  force  levels  for  different  grasping  force  levels. 

Figure  1.24  shows  the  variables  associated  with  the  various  sEMG  locations.  Figure  1.25  shows  the 
thumb-restrain  in  use  during  various  contraction  experiments.  Figure  1.25  also  shows  the  location  of  the 
FSR.  Figure  1.26  shows  the  sEMG  data  acquisition  16  channel  Bagnoli  system. 
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Figure  1.24:  Experimental  Setup  -  Variables  associated  with  the  sEMG  channels 


kreyszig 


orce  Sensitive  Resistor  fFSRl 


Thumb  Restrain 


Figure  1.25:  Experimental  Setup  -  Location  of  Force  Sensitive  Resistor  (FSR)  and  Thumb  Restrain 
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Figure  1.26:  Experimental  Setup  -  Bagnoli  16  Channel  sEMG  Measuring  Device 

The  most  commonly  used  Linear  Spatial  filters  for  isolating  the  motor  unit  action  potentials  (MUAPs)  are; 

1)  Longitudinal  Single  Differential  (LSD) 

2)  Transverse  Single  Differential  (TSD) 

3)  Longitudinal  Double  Differential  (LDD) 

4)  Transverse  Double  Differential  (TDD) 

5)  Normal  Double  Differential  (NDD) 

6)  Inverse  Binomial  (IB2)  and  the 

7)  Inverse  Rectangular  (IR)  Filter. 

The  mask  of  these  filters  and  the  corresponding  resultant  equations  on  application  of  the  mask  to  the 
grid  data  obtained  from  the  sEMG  array  arrangement  are  given  below. 

CASE  1 

Longitudinal  Single  Differential  (LSD) 

EMG  array  Information 


Spatial  Filter  Mask 

sEMG  1  sEMG  5  sEMG  6 

0  0  0 

sEMG  2  sEMGl  sEMG  2 

-1  1  0 

sEMGS  sEMG  A  sEMG  9 

0  0  0 


Result  Equation:  -  sEMG  2  +  sEMGl  (1.24) 
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CASE  2 

Transverse  Single  Differential  (TSD) 


EMG  array  Information 
Spatial  Filter  Mask 

sEMGl  sEMG5  sEMG6 

0  -1  0 

sEMGl  sEMGl  sEMG3 

0  1  0 

sEMG^  sEMG4  sEMG9 

_  0  0  0  _ 

Result  Equation:  -  sEMGS  +  sEMGl 


CASE  3 

Longitudinal  Double  Differential  (LDP) 

EMG  array  Information 


Spatial  F ilter  M  ask 
~  sEMGl  sEMG5  sEMG6 

0  0  0 

sEMGl  sEMGl  sEMG3 

-I  2  -1 

sEMG^  sEMGA  sEMG9 

0  0  0 


Result  Equation:  -  sEMG  2  +  2  *  sEMG  1  -  sEMG  3 


CASE  4 

Transverse  Double  Differential  (TDD) 


(1.25) 


(1.26) 
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EMG  array  Information 
Spatial  F ilter  M  ask 


sEMGl 

sEMGS 

sEMG  6 

0 

-1 

0 

sEMG  2 

sEMGl 

sEMG  3 

0 

2 

0 

sEMG^ 

sEMGA 

sEMG  9 

0 

-1 

0 

Result  Equation:  -  sEMGS  +  2  *  sEMGl  -  sEMGA 


CASES 

Normal  Double  Differential  (NDD) 

EMG  array  Information 
Spatial  Filter  Mask 


Result  Equation: 


sEMGl 

sEMG  5 

sEMG  6 

0 

-1 

0 

sEMG  2 

sEMGl 

sEMG  3 

-1 

4 

-1 

sEMGS 

sEMGA 

sEMG  9 

0 

-1 

0 

-sEMGS  -  sEMGl  +  4  *  sEMGl  -  sEMG3  -  sEMGA 

CASE  6 

Inverse  Binomial  2-D  (IB2) 


(1.27) 


(1.28) 
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EMG  array  Information 


Spatial  F ilter  M  ask 


sEMG  1 

sEMG  5 

sEMG  6 

-1 

-2 

-1 

sEMG  2 

sEMGl 

sEMG  3 

-2 

12 

-2 

sEMG% 

sEMG  4 

sEMG  9 

-1 

-2 

-1 

Result  Equation: 

-sEMGl  -  2  *  sEMG5  -  sEMG6  -  2  * 

sEMGl  +  12  * 

sEMGl 

-2  *  sEMG3  -  sEMGS  -  2  * 

sEMG  A  -  , 

sEMG  9 

CASE? 

Inverse  Rectangle  Filter  (IR) 

EMG  array 

Inform  ation 

Spatial  Filter  Mask 

"  sEMG  1 

sEMG  5 

sEMG  6 

-1 

-1 

-1 

sEMG  2 

sEMG  1 

sEMG  3 

-1 

8 

-1 

sEMG  8 

sEMG  4 

sEMG  9 

-1 

-1 

-1 

Result  Equation: 

-sEMGl  -  sEMG5  -  sEMG6  -  sEMGl 

+  8  *  sEMGl 

(1.29) 


-sEMG3  -  sEMGS.  -  sEMGA  -  sEMG9  (1.30) 

Non-Linear  Spatial  Filtering  [351: 

The  Nonlinear  Spatial  Filters  use  the  Teager-Kaiser  Energy  (TKE)  Operator  [36],  [37].  This  operator  is 
derived  from  Teager’s  experiments  in  1983.  This  technique  is  a  threshold  ‘energy’  based  approach  where 
outliers  are  first  detected  and  then  replaced  by  their  estimated  values.  Based  on  Newton’s  law  of  motion,  a 
nonlinear  quadratic  operator  called  Teager-Kaiser  (TK)  operator  was  first  introduced  by  Teager  and  Kaiser 
[36],  [37]  to  measure  the  real  physical  energy  of  a  system.  This  nonlinear  operator  differs  from  the  common 
way  to  calculate  the  energy  of  a  discrete-time  signal  as  the  average  sum  of  its  squared  magnitudes.  The 
energy  of  a  generating  system  of  a  simple  oscillation  signal  was  computed  as  the  product  of  the  square  of 
the  amplitude  and  the  frequency  of  the  signal.  It  was  found  that  this  nonlinear  operator  exhibits  several 
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attractive  features  such  as  simplicity,  efficiency  and  ability  to  track  instantaneously-varying  special 
patterns.  Since  its  introduction,  several  applications  have  been  derived  for  one-dimensional  [38],  [39],  and 
two  dimensional  signal  processing  [40]. 

Before  the  Teager-Kaiser  operator  was  introduced,  various  filtering  methods  were  proposed  both  linear 
and  nonlinear  alternatives.  Filtering  is  often  a  trade-off  between  different  features,  such  as  performance  in 
Gaussian  and  non-Gaussian  environments,  ability  to  adapt  in  case  of  non-stationary  signals,  edge 
preservation  and  computational  complexity.  Two  typical  methods  were  running  mean  and  median  filters, 
which  exploit  a  sliding  fixed  length  window.  Mean  filters  are  known  to  remove  the  additive  Gaussian  noise 
very  well,  but  they  tend  to  soften  edges  and  cannot  fully  cope  with  impulsive  noise.  Median  filters  on  the 
other  hand  are  nonlinear,  which  involve  sorting  of  the  data,  and  are  able  to  eliminate  impulses  at  the 
expense  of  some  streaking  and  edge  jittering  [41].  De-noising  deals  with  the  same  problem  of  estimating 
the  underlying  signal  from  the  noisy  observations,  but  now  the  data  is  not  needed  to  process  online  or  is  not 
time-dependent  at  all.  De-noising  is  not  restricted  to  the  methods  acting  in  time  domain,  the  signal  is  often 
processed  in  some  transform  domain.  Wavelet  transform  has  recently  gained  research  interest  in  several 
fields  of  signal  processing,  using  thresholding  of  (orthogonal)  wavelet  coefficients  and  taking  the  inverse 
wavelet  transform  has  been  proposed  to  solve  de-noising  problem. 

The  nonlinear  spatial  filters  with  the  TKE  operator  incorporated  are  given  as  follows; 

a)  General  Form  of  Nonlinear  Spatial  Filter  using  the  Teager-Kaiser  (TKE)  operator 

^[x(w)]  =  {n)  -  x(n  +  \)x{n  - 1)  (1.31) 

b)  1-D  Nonlinear  Transverse  Spatial  Filter 

^ ^  J^x{m,n)'\  =  x^ {m,n)-  x{m  -  \,n)x{m  +  \,n)  (1.32) 

c)  1-D  Nonlinear  Longitudinal  Spatial  Filter 

Jx(m,^)]  =  x^{m,n)  -x{m,  n  -  \)x{m,  n  +  \)  (1.33) 

d)  Nonlinear  Spatial  Filter  in  Two  Orthogonal  Directions 

=2x^  (m,  n)  -  x{m  - 1,  n)x(m  +  !,«)-  x(m,  n  -  \)x{m,  n  +  \)  (1 .34) 

e)  Nonlinear  Spatial  Filter  in  all  Four  Directions 

^  [x(m, «)]  =  4x^  {m,n)  —  x(m  —  1,  n)x{m  + 1,  n) 

-  x{m,  n  -  l)x(m,  n  +  \) 

-  x(m  -l,n  +  \)x{m  + 1, «  - 1) 

-  x{m-\,n-\)x{m  +  \,n  +  \)  (1.35) 

Figure  1.27  and  1.28  show  the  plots  of  the  raw  sEMG  signal  for  the  experiment  without  any  force  being 
applied. 
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Raw  sEMG  Data  for  Ring  Finger(at  MU)  Channel  1 


Raw  sEMG  Data  for  Ring  Finger  Channel  2 


Figure  1.27:  Raw  sEMG  Data  Plots  Channels  1  to  6 
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Figure  1.28:  Raw  sEMG  Data  Plots  Channels  7  to  9 


The  sEMG  data  was  then  filtered  using  four  (4)  HR  filters;  1)  Bessel  2)  Butterworth,  3)  Chebyshev 
Type  I  and  4)  Chebyshev  Type  II  with  a  pass-band  frequency  of  60-450  Hz.  The  force  data  was  also 
filtered  using  a  3rd  order  Low-pass  Butterworth  filter  with  cutoff  frequency  of  10  Hz.  The  same  filtering 
was  carried  out  for  all  the  experiments  conducted.  An  example  plot  of  the  filtered  force  and  sEMG  data  are 
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given  in  Figure  1.29.  Figure  1.29  shows  the  baseline  sEMG  and  force  levels  generated  by  the  subject  where 
no  contractions  were  performed. 


Filtered  Force  and  Filetred  sEMG  Data  Channel  1 


Figure  1.29:  Filtered  sEMG  and  Force  Data  -  No  Force  Generated 


Figure  1.30  and  1.31  plots  the  raw  sEMG  of  all  the  channels  (1-9)  for  another  experiment  where  the 
subject  was  performing  the  action  of  squeezing  the  force  ball  with  a  force  sensor  attached  to  the  ball. 


Figure  1.30:  Raw  sEMG  Data  Plots  Channels  1  to  6 
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Raw  sEMG  Data  for  Ring  Finger  Channei  7 
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Raw  sEMG  Data  for  Ring  Finger  Channei  8 


Raw  sEMG  Data  for  Ring  Finger  Channei  9 


Figure  1.31:  Raw  sEMG  Data  Plots  Channels  7  to  9 

Figure  1.32  shows  the  sEMG  and  the  force  signal  generated  by  the  subject  where  the  subject 
performed  random  variation  of  force  by  squeezing  the  stress  ball. 


Figure  1.32:  Filtered  sEMG  and  Force  Data  (Generated  Force  Fevel) 


Figure  1.33  a,  b,  c  and  d  show  the  results  of  the  Non-linear  Spatially  Filtered  sEMG  data  for  the  multi¬ 
sensor  array  setup  shown  in  Figure  1.23. 
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(a 


1  D  Spatial  Filter  TransNAerse  to  the  Muscle  Fiber  Direction 
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2  - 
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1D  Spatial  Filter  Longitudnal  to  the  Muscle  Fiber  Direction 


(c3 


g 


1D  Spatial  Filter  in  TWO  Orthogonal(TO)  Directions  to  the  Muscle  Fiber 


Samples 
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1D  Spatial  Filter  in  ALL  Four  Directions(AFD)  to  the  Muscle  Fiber 
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Figure  1.33:  Spatially  Filtered  sEMG  a)  1-D  Nonlinear  Transverse  Spatial  Filter,  b)  1-D  Nonlinear 
Longitudinal  Spatial  Filter,  c)  Nonlinear  Spatial  Filter  in  Two  Orthogonal  Directions,  d)  Nonlinear  Spatial 

Filter  in  All  Four  Directions 


Figure  1.34  shows  the  results  of  the  various  Linear  Spatially  Filtered  sEMG  data  for  the  multi-sensor 
array  setup  shown  in  Figure  1.23. 
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LongitudinsI  Single-DifferentisI  Filter  (LSD) 
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Figure  1.34:  Spatially  Filtered  sEMG  a)  Longitudinal  Single  Differential  (LSD),  b)  Longitudinal  Double 
Differential  (LDD),  c)  Normal  Double  Differential  (NDD),  d)  Inverse  Rectangular  (IR)  Filter,  e) 
Transverse  Single  Differential  (TSD),  f)  Transverse  Double  Differential  (TDD),  g)  Inverse  Binomial  (IB2) 


For  this  analysis  too,  the  time  windows  used  for  estimation  and  validation  of  the  models  were  'ze’  and 
‘zv '  respectively,  ‘ze '  contained  8000  sample  points  and  ‘zv '  contained  data  points  shifted  by  2000  sample 
points.  For  example,  if  ‘ze'  was  a  time  window  between  2-6  seconds  i.e.  samples  4000-12000,  then  ‘zv' 
was  between  3-7  seconds  i.e.  6000-14000  samples.  Thus  the  Hammerstein- Wiener  method  uses  ‘ze'  to 
estimate  the  model  structure  and  based  on  this  information  predicts  the  next  2000  sample  points.  The  data 
was  filtered  using  the  various  filters  mentioned  in  the  previous  sections.  Once  again  the  experiments  were 
performed  such  that  the  force  was  varied  randomly  and  the  subject  was  not  trying  to  achieve  maximum 
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voluntary  contractions  during  each  cycle.  A  cycle  is  defined  as  the  subject  starting  without  any  force  on  the 
stress  ball,  squeezing  it  (to  any  force  level)  and  then  going  back  to  no  force.  A  plot  of  the  variations  in  force 
achieved  for  6  different  experiments  is  shown  in  Figure  1.35. 


Raw  Force  Exp4 


time 

Raw  Force  Exp6 


Raw  Force  Exp8 


Raw  Force  Exp7 


Raw  Force  Exp9 


Figure  1.35:  Variations  in  Force  levels;  Experiment  3,  4,  6,  7,  8  &  9 


For  this  analysis  too,  42  models  with  variations  in  and  were  tested  while  the  value  of  rij^  was 

kept  as  1 .  The  total  number  of  models  estimated  were  1 5  (filter  types)  x  4  (time  windows)  x  42  models  per 
time  window  x  4  experiments  =  10,080  models.  As  an  example,  for  experiment  3,  for  time  window  of  2-7 
sec,  the  fit  values  obtained  by  varying  between  2-7  and  between  3-9,  are  shown  in  Figure  1.36. 


Figure  1.36  contains  a  lot  of  information  as  it  shows  49  models  fit  percentages  for  each  of  the  HR  and 
spatial  filter  types  tested.  The  large  variation  in  the  model  fit  values  can  be  attributed  to  the  fact  that  the  two 
data  sets  have  poor  correlation  between  one  another.  The  significant  result  for  this  time  duration  was  noted 
for  the  Bessel  and  NLTO  filters,  these  are  plotted  in  Figure  1.37.  The  predicted  model  output  plots  for  these 
values  are  shown  in  Figure  1.38 
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Figure  1.36:  Fit  %  for  Hammerstein- Wiener  Models  -  Various  HR  &  Spatial  Filters  (time  window  2-7  sec. 
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Figure  1.37:  Fit  %  for  Hammerstein- Wiener  Models  -  Bessel  &  NLTO  (time  window  2-7  sec,  Exp.  3) 

The  other  filters  used  also  predict  the  future  variations  in  force  but  the  fit  percentages  were  in  the  range 
of  30-48%.  A  key  objective  of  this  analysis  is  to  help  develop  a  control  regime,  which  in  not  based  on 
threshold  values  of  force  can  incorporate  the  dynamics  in  the  force.  This  would  help  to  control  the  response 
of  the  artificial  limb  to  be  closer  to  that  of  the  actual  hand.  Similarly  we  tested  various  models  for  the  other 
experiments  too.  Another  set  of  results  which  gave  very  high  values  of  fit  was  for  the  later  time  windows. 
This  case  was  especially  interesting  as  the  subject  had  fatigued  due  to  the  repetitive  experiments,  but  the 
Hammerstein- Wiener  models  did  successfully  capture  the  variations  in  the  sEMG  signal.  The 
Hammerstein- Wiener  models  performed  very  well  even  as  the  sEMG  signal  changed  and  we  obtained  fit 
values  in  the  high  sixties. 

y1.  (sim)  y1.(sim) 


Figure  1.38:  Measured  data  (black)  a)  Bessel  (blue)  56.36%  and  b)  NLTO  (red)  60.13%  for  Exp.  3  time 

window  2-7seconds 


Figure  1.39  shows  the  model  fit  values  obtained  for  these  later  data  windows.  As  can  be  seen  from  the 
plots,  contrary  to  our  expectations  the  Hammerstein- Wiener  Models  performed  very  well  and  produced 
very  good  fit  values. 

Figures  1.40,  1.41  and  1.42  show  the  model  output  plots  for  some  of  the  filters  mentioned  in  Figure 
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1.38.  The  only  HR  filter  whose  performance  matched,  and  in  a  few  cases  exceeded,  the  performance  of  the 
linear  and  the  non-linear  spatial  filters  was  the  Bessel  filter.  As  can  be  seen  from  Figure  1.38  the  Bessel 
filter  modeled  the  sEMG-force  relation  to  52.85  %  though  this  is  a  slightly  lower  value  than  the 
Butterworth  filter  mentioned,  the  spread  of  the  model  fit  values  was  more  consistent  in  the  range  of  45-50% 
as  compared  to  the  Butterworth  filter  which  had  a  far  more  spread  out  distribution. 
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Figure  1.39  Fit  Values  Obtained  for  Different  Hammerstein- Wiener  Models  -  Bessel,  NLTO  NET,  TDD, 
NDD,  NLAFD  Filters  (time  window  20-25  sec,  Exp.  5) 


Figure  1.40  Measured  Data  (Black)  &  Estimated  Data  (Blue) 


H^tiuinted 


Figure  1.41:  Measured  Data  (Black)  &  Estimated  Data  (Blue) 
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Eiitimated 


Figure  1.42:  Measured  Data  (Black)  &  Estimated  Data  (Blue) 

The  Hammerstein- Wiener  models  worked  very  well  in  capturing  the  dynamics  of  the  force  levels  for 
the  various  experiments  conducted.  This  method  of  modeling  could  help  in  improving  the  control  over  the 
motors  used  in  prosthetic  devices  to  mimic  the  actual  changes  force  levels  in  a  real  hand.  This  method  also 
performed  very  well  in  the  scenarios  where  the  subject  did  fatigue  but  the  affects  were  successfully 
modeled  by  the  Hammerstein-Wiener  models.  The  nonlinear  and  linear  spatial  filters  (TDD,  NDD  and 
NET,  NLTO  and  NLAFD)  did  outperform  the  other  filtering  methods  used  especially  for  the  later  time 
windows.  The  only  other  filter  which  had  a  comparable  performance  to  the  spatial  filters  was  the  Bessel 
filter.  Further  investigation  into  reducing  the  wide  range  of  the  fit  values  obtained  needs  to  be  performed. 
One  of  the  possible  methods  to  pursue  would  be  to  use  Genetic  Algorithm  to  optimize  the  model 
parameters  and  also  the  number  of  iterations  used  for  the  modeling  of  sEMG-force  levels.  One  of  the 
possible  reasons  for  poor  fit  values  could  also  be  attributed  to  the  model  trying  to  over-fit  the  data  sets. 


In  the  next  section  the  spatial  filter  masks  available  in  the  literature  were  compared  to  the  optimized 
masks  for  our  setup  and  experiments.  Figure  1.43  provides  an  overview  of  the  entire  procedure  followed 
for  this  analysis.  Analysis  of  the  kurtosis  improvement  of  these  filters  before  optimization  was  also 
performed. 


Random  Model 

Poor  Kurtosis 

Selection  of  Linear 

Improvements  for 

Spatial  Filter  Masks 

Linear  Spatial  Filters 

Genetic  Algorithm  Optimized  Filter  Mask  - 
Constrained  &  Unconstrained  Scenarios 


Filtering  Methods  -  HR 
Filters  &  Linear  and  Non¬ 
linear  Spatial  Filters 


Kurtosis  Comparison  of 
Spatial  Filters 


Figure  1.43:  Overview  of  the  methodology  used 

The  results  of  spatially  filtered  data  for  the  linear  and  the  nonlinear  spatial  filters  were  first  compared 
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based  on  the  '‘Kurtosis''  criteria,  [35  &  36].  ‘Kurtosis'  is  a  measure  of  whether  the  data  sets  are  peaked  or 
flat  relative  to  a  normal  distribution.  That  is,  data  sets  with  high  kurtosis  tend  to  have  a  distinct  peak  near 
the  mean,  decline  rather  rapidly,  and  have  heavy  tails.  Data  sets  with  low  kurtosis  tend  to  have  a  flat  top 
near  the  mean  rather  than  a  sharp  peak.  A  uniform  distribution  would  be  the  extreme  case.  The 
mathematical  expression  for  kurtosis  is  given  in  Equation  34. 

E[x]-3(E[/]y 
Kurt  =  - 

E[xy 

Figure  1.44  shows  the  plot  obtained  for  the  various  filters  based  on  the  kurtosis  measure.  The  y-axis  is 
the  kurtosis  improvements  which  is  the  ratio  of  the  output  to  the  input  kurtosis.  It  is  evident  from  the  plot 
that  the  NET,  NEE,  NLTO  and  the  NLAFD  spatial  filters  performed  very  well  as  compared  to  the  linear 
spatial  filters  under  investigation.  The  best  kurtosis  improvements  were  obtained  for  experiment  4  (approx.) 
~  44  for  the  nonlinear  spatial  filters.  The  x-axis  in  Figure  E42  shows  the  numbers  allotted  to  the  various 
spatial  filters  investigated. 

Based  on  these  results  we  focused  our  attention  to  the  linear  spatial  filter  masks  for  experiment  3, 
which  exhibits  poor  model  fit  percentages  and  also  low  kurtosis  values.  This  section  does  not  investigate 
the  reason  for  the  low  kurtosis  values  of  the  linear  spatial  filters  but  only  investigates  the  use  of  GA  to 
improve  the  low  model  fit  percentages  obtained  for  experiment  3.  The  filters  were  compared  based  on  the 
model  fit  values  obtained  from  various  Hammerstein- Wiener  models. 


(1.36) 


Comp  Alison  of  Spot!  a1  Filters 
Exp  1  to  9  -  With  Force  (Raw  Data) 


A  EXP3 
A  EXP4 
>|(  EXP5 
•  EXP6 
»  EXP7 
■  EXP  8 
— EXP9 


Figure  1.44:  Kurtosis  plots  of  various  filters  for  exp3  -  9;  y-axis  numbers  are  for  the  various  filters  tested 
1-NLT,  2-NLL,  3-NLTO,  4-NLAFD,  5-LSD,  6-TSD,  7-LDD,  8-TDD,  9-NDD,  10-IB2,  and  10-  IR 


Table  E9  shows  an  example  of  the  fits  that  were  obtained  on  varying  the  parameters  of  the 
Hammerstein- Wiener  model.  The  highlighted  models  (and  a  few  other  models)  were  selected  randomly  to 
be  optimized  using  Genetic  Algorithm  (GA).  We  had  two  scenarios  under  GA  -1)  GA  Constrained  and  2) 
GA  -  Unconstrained.  The  first  scenario  GA  constrained  optimized  only  the  mask  entry  a22  (location  of  the 
sEMG  sensor  on  the  motor  unit).  The  other  entries  of  the  filter  mask  were  then  computed  from  this 
optimized  value.  In  the  second  scenario,  GA  unconstrained  we  let  GA  optimize  all  the  entries  for  various 
masks.  The  GA  parameters  for  optimization  were  as  follows:  number  of  iterations:  50;  initial  population 
size  Generation  0:  96;  population  size  Generation  1:  48;  Number  of  Chromosomes  kept  for  mating:  24;  and 
mutation  rate  was  set  to  4%.  Figure  1.45  shows  the  difference  between  the  two  GA  scenarios. 

Table  1.9:  Example  of  System  Identification  Results  Using  Filter  Mask  from  Fiterature  -  Highlighted 

Models  Optimized  using  GA 


Model 

Number 

Ha 

Hb 

Hk 

LDD 

LSD 

TDD 

TSD 

ND 

D 

IB2 

IR 

ml 

2 

3 

1 

31.06 

41.39 

39.53 

-9.685 

45.5 

33.7 

35.38 
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5 

9 

m2 

2 

4 

1 

31.86 

17.4 

39.36 

43.19 

36.8 

4 

16.8 

8 

23.89 

m3 

2 

5 

1 

23.54 

35.94 

30.09 

2.247 

39.7 

8 

36.1 

7 

38.16 

m4 

2 

6 

1 

3.266 

41.99 

41.28 

43.46 

10.8 

3 

36.4 

1 

36.7 

m5 

2 

7 

1 

31.58 

40.55 

44.65 

31.28 

2.59 

3 

32.2 

6 

36.34 

m6 

2 

8 

1 

37.84 

4.259 

21.89 

20.08 

8.03 

6 

36.2 

2 

36.57 

ml 

2 

9 

1 

31.42 

-0.188 

35.78 

28.71 

38.1 

1 

35.5 

4 

35.82 

m8 

3 

3 

1 

36.59 

40.04 

36.17 

12.33 

4.47 

8 

41.0 

9 

35.81 

m9 

3 

4 

1 

20.74 

40.72 

31.53 

36.57 

29.7 

6 

37.4 

3 

38.76 

mlO 

3 

5 

1 

39.87 

11.53 

39.83 

30.24 

39.2 

5 

35.1 

5 

37.9 

• 

• 

• 

• 

• 

• 

• 

• 

• 

. 

• 

m40 

7 

7 

1 

34.91 

10.18 

40.79 

35.21 

35.2 

4 

33.4 

2 

37.92 

m41 

7 

8 

1 

0.112 

36.28 

39.68 

40.26 

20.2 

7 

35.8 

8 

24.32 

m42 

7 

9 

1 

36.55 

-0.412 

25.24 

31.31 

35.4 

34.2 

6 

39.82 

Genetic  Aljsoritliin 


Constiaineil  Fncoiistiamed 


-  optimized  Filter  Mask  Ejitry  sEMGI  only  -  All  the  non-zero  entries  were  optimized 

•  Other  non-zero  entries  computed  from  sEMGl 
value 


Figure  1.45:  Two  genetic  algorithm  scenarios  tested 
Table  1.10:  Results  of  constrained  and  unconstrained  GA  of  highlighted  models  from  Table  1.9 
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Longitudinal  Double  Differential  (LDD) 

Fit  % 

From 

Eiterature 

GA 

Constrained 

GA 

Uneonstrained 

ml 

31.06 

42.8291 

61.3475 

m6 

37.84 

53.3134 

63.7240 

ml2 

35.54 

44.2513 

51.7942 

m31 

39.44 

47.0034 

60.6489 

Longitudinal  Single  Differential  (LSD) 

Fit  % 

From 

Literature 

GA 

Constrainec 

GA 

Uneonstrainec 

ml 

41.39 

48.9135 

57.9136 

m4 

41.99 

41.5731 

60.2369 

m8 

40.04 

40.5924 

46.3310 

m9 

40.72 

45.2322 

45.4538 

Transverse  Double  Differential  (TDD) 

Fit  % 

From 

Literature 

GA 

Constrained 

GA 

Uneonstrained 

ml 

39.53 

41.5297 

59.8055 

m5 

44.65 

49.4667 

68.4191 

mlO 

39.83 

41.307 

63.8523 

ml5 

43.01 

43.3466 

56.5113 

Transverse  Single  Differential  (TSD) 

Fit  % 

From 

Literature 

GA 

Constrained 

GA 

Uneonstrained 

m2 

43.19 

44.0017 

65.9038 

m4 

43.46 

43.0529 

58.2755 

mil 

44.24 

39.7867 

44.8431 

m31 

29.1 

43.5787 

47.6688 

Inverse  Binomial  2  (IB2) 

Fit  % 

From 

Literature 

GA 

Constrained 

GA 

Uneonstrained 

ml 

33.79 

38.6076 

58.2365 

m3 

36.17 

38.9074 

58.1653 

m4 

36.41 

38.9957 

55.5179 

m8 

41.09 

47.2971 

55.0537 

Normal  Double  Differential  (NDD) 

Fit  % 

From 

Literature 

GA 

Constrained 

GA 

Uneonstrained 

ml 

45.55 

53.1512 

57.9496 

m3 

39.87 

47.1084 

60.7374 

m7 

38.11 

51.8065 

60.5535 

mil 

39.01 

46.881 

56.1193 

From  the  results  in  Table  1 .10  we  ean  see  that  the  optimization  of  the  filter  mask  using  GA  worked 
in  almost  all  the  eases  ehosen.  GA  without  eonstraints  performed  signifieantly  better,  in  most  eases, 
than  the  filter  masks  reported  in  literature  and  also  the  mask  whieh  we  eomputed  using  GA,  whieh  only 
optimized  the  entry  (a22)  i.e.  the  weight  assoeiated  with  the  sEMG  signal  at  the  motor  unit.  This 
restrietion  on  GA  would  leave  the  filter  mask  symmetrieal.  But  looking  at  the  results  of  the  GA,  we  ean 
eonelude  that  the  filter  mask  need  not  always  be  symmetrieal  for  analysis  of  sEMG,  espeeially  for  data 
reeorded  using  an  array.  All  the  filter  masks,  with  the  individual  entries  of  the  masks  that  were 
obtained  after  optimization  along  with  the  respeetive  fit  values  are  provided  in  Table  1.11. 

Table  1.11:  Optimized  filter  masks  for  eonstrained  and  uneonstrained  GA 


Linear 

Spatial 

Filter 

Type 

Mask  in 
Literature 

GA  Optimized  Spatial  Filter 
Mask  -  Constrained 

GA  Optimized  Spatial  Filter 
Mask  -  Unconstrained 

LDD 

ml 

I 

“0  0  o' 

-1  2  -1 

0  0  0 

nt  31.06"/ 

'  0  0  o' 

-6.5  13  -6.5 

0  0  0 

Fit  42.8912  % 

0  0  o' 

-64.2686  23.5033  -20.8633 

0  0  0 

Fit  61.3475  % 
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LSD 

m4 

I 

“0  0  0“ 

-1  1  0 

0  0  0 

nt  41.99 

0 

F 

“  0  0  0“ 

-2  2  0 

0  0  0 

it  41.573  E 

/o 

0  0  0 

-52.7866  54  0 

0  0  0 

Fit  60.2369% 

- 

TDD 

m5 

I 

“0  -1  0“ 

0  2  0 

0-10 

nt  44.65 

0 

Fi 

“0  -27  0“ 

0  54  0 

0  -27  0 

1 49.4667 

% 

“0  -41.5561  0“ 

0  54.7329  0 

0  -22  0 

Fit  68.4191  % 

TSD 

m2 

I 

“0  -1  0“ 

0  1  0 

0  0  0 

nt  43.19 "/ 

0 

F 

0  -28.5  0 

0  57  0 

0  0  0 

it  44.0017^ 

/o 

“0  -74  0“ 

0  89.6214  0 

0  0  0 

Fit  65.9038  % 

NDD 

m3 

I 

0  -1  0 

-1  4  -1 

0-10 

nt  39.87 "/ 

0 

0  -6.75  0 

-6.75  27  -6.75 

0  -6.75  0 

Fit  47.1084  % 

0  -11.5790  0 

-46.7773  36.9276  -11.8061 

0  -70.0491  0 

Fit  60.7374  % 

IB2 

ml 

I 

-1  -2  -1 

-2  12  -2 

-1  -2  -1 

nt  33.79 "/ 

0 

“-0.42  -0.83  -0.42“ 

-0.83  5  -0.83 

-0.42  -0.83  -0.42 

Fit  38.6076  % 

“  -9.3405  -85.0222  -53.7102“ 

-95.4633  42  -30.7811 

-28.6087  -8.2511  -10.0189 

Fit  58.2365  % 

The  linear  spatial  filter  masks  as  reported  in  the  literature  have  poor  model  fit  pereentages  and 
poor  kurtosis  improvements.  The  linear  spatial  filter  masks  were  optimized  using  GA  and  eompared 
them  based  on  the  model  fit  values  aehieved.  The  seleeted  model  strueture  for  eharaeterizing  the  sEMG 
and  finger  foree  data  is  a  Hammer  stein- Wiener  model.  The  fit  values  did  improve  signifieantly  in  the 
two  GA  seenarios  -  GA  with  and  without  eonstraints.  The  GA  without  eonstraints  performed  better 
than  the  GA  with  eonstrains,  whieh  brings  into  foeus  the  possibility  that  the  sEMG  signal  distribution 
over  the  entire  grid  eannot  be  assumed  to  be  symmetrieally  distributed  and  that  the  weights  assoeiated 
with  the  sEMG  signal  at  various  loeations  need  to  be  modified  depending  on  probably  the  subjeet  and 
also  based  on  the  experimental  design.  This  is  in  eontrast  to  the  reported  filter  mask  in  the  literature, 
whieh  are  all  symmetrie.  Almost  all  the  filter  masks  optimized  resulted  in  a  signifieant  improvement 
over  the  masks  reported  in  literature. 

1.10  Zone  Classification  of  Amputation  [421 

This  seetion  emphasizes  the  need  for  elassifieation  of  amputation.  The  smart  prosthetie  hand  being 
developed  would  use  the  sEMG  signals  as  a  eontrol  signal  to  eompute  the  neeessary  foree  and  joint 
angles.  In  order  to  extraet  suitable  sEMG  signals  for  the  eorresponding  finger  foree  and  joint  angles, 
we  initially  eondueted  experiments  in  whieh  external  stimulation  was  used  to  identify  motor  points. 
These  experiments  helped  us  understand,  with  a  fairly  high  degree  of  aeeuraey,  the  ideal  loeation  on 
the  hand  where  the  sEMG  sensors  eould  be  plaeed.  These  experiments  were  earried  out  on  individuals 
without  amputations.  But  with  individuals  with  amputations  we  would  need  an  alternate  method  to 
identify  the  useful  loeations,  depending  on  the  degree  of  amputation.  In  order  to  aseertain  the  ideal 
loeations  on  a  residual  limb  we  set  out  to  map  the  major  museles  in  both  the  flexor  and  extensor 
eompartments  of  the  forearm,  whieh  eontrol  the  hand  motion  and  eould  be  targeted  for  sEMG 
monitoring. 

Residual  limb  length  elassifieation  in  patients  with  upper  extremity  amputations  is  important  to 
identify  the  useful  part  of  the  remaining  skeletal  musele  groups  for  definitive  prosthetie  eontrol  in  both 
body  powered  and  myoeleetrie  prosthesis.  Approximately  30-50%  of  the  individuals  with  upper 
extremity  amputations  are  non-eompliant  in  the  use  of  their  prosthesis  seeondary  to  eontrol  issues.  The 
purpose  of  the  study  undertaken  was  to  determine  a  length  multiplier  that  ean  be  used  to  faeilitate 
deeision  making  about  what  type  of  myoeleetrie  prosthesis  to  preseribe  for  a  given  upper  extremity 
(trans-radial)  amputation  residuum  length. 

Three  female  and  five  male  eadaver  arms  (16  arms)  were  used  in  this  study.  The  mean  height  of 
the  speeimens  was  171.175  em  (+9.114). 

Eight  eadavers  were  disseeted  to  expose  the  museles  of  both  upper  extremities  and  shoulder 
girdles.  Length  measurements  were  obtained  using  digital  Vernier®  ealipers  as  shown  in  Figure  1.46. 
Musele  belly  length  measurements  were  obtained  from  six  wrist  and  hand  flexor  museles,  ten  wrist  and 
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hand  extensor  museles  and  six  arm  museles.  Musele  belly  lengths  from  the  16  forearm  museles  were 
averaged  into  a  single  eombined  musele  belly  length  for  eaeh  subjeet,  whieh  was  then  divided  by  the 
subjeet’s  arm  length  to  yield  a  single  forearm  musele  belly :humerus  ratio  for  eaeh  subjeet.  A  seeond 
ratio  was  similarly  ealeulated  using  the  arm  musele  belly  length  and  the  arm  length.  Means  and 
standard  deviations  for  both  ratios  and  for  arm  length  and  musele  belly  length  for  all  speeimens  were 
determined.  A  eoeffieient  of  variation  was  ealeulated  to  assess  inter-subjeet  variability  for  the  ratios. 

The  ealeulated  mean  forearm  musele  belly:  humerus  ratio  was  .636  ±  .053,  while  the  arm  musele 
belly  ratio  was  .505  ±  .041.  Table  1.12  shows  results  of  measurements  from  AC  joint  to  humeral 
eondyles.  Table  1.13  shows  data  from  all  MTJ  measurements  of  forearm  museles.  Figure  1.47  indieates 
Zone  1  and  2  delineations. 

The  eoeffieients  of  variation  in  measurements  ranged  from  7.87  -  10.35%. 

Analysis  of  the  measurements  taken  by  the  three  researehers  produeed  a  Pearson  produet-moment 
inter- tester  eorrelation  of  r=.  866. 


Figure  1.46:  Example  of  measurement  taken  of  Extensor  earpi  ulnaris  in  the 
extensor  eompartment  of  the  forearm  [42] 
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Table  1.12:  Measurement  of  Aeromioelavieular  joint  to  medial  and  lateral  epieondyles  [42] 


Mean 

SD 

Medial  Condyle 

31.780  em 

2.1 18  em 

Lateral  Epicondyle 

32.638  em 

2.205  em 

Combined 

32.209  em 

2.165  em 

Table  1.13:  Musele  mean  measurements  of  Forearm  and  Upper  Arm  Museles  [42] 


Mean 

SD 

Extensor  Grouping 

Brachioradialis 

17.873 

3.221 

Extensor  earpi  radialis  longus 

18.477 

2.650 

Extensor  earpi  radialis  brevis 

15.683 

2.205 

Extensor  digitiorum 

18.306 

2.598 

Extensor  digitorum  minimi 

16.776 

2.705 

Extensor  earpi  ulnaris 

17.820 

2.854 

Anconeus 

6.960 

1.872 

Supinator 

6.856 

1.598 

Abduetor  polieis  longus 

15.545 

2.111 

Extensor  polieis  longus 

13.820 

1.896 

Extensor  polieis  brevis 

7.631 

1.601 

Flexor  Grouping 

Pronator  teres 

15.040 

1.705 

Flexor  earpi  radialis 

17.942 

3.050 

Flexor  earpi  ulnaris 

21.030 

3.339 

Flexor  digitorum  superfieials 

20.726 

3.201 

Flexor  digitorum  profundus 

18.308 

1.211 

Flexor  polieis  longus 

15.438 

2.063 

Upper  Arm 

Bleeps  braehii  long  head 

25.821 

2.603 

Bleeps  braehii  short  head 

23.832 

3.126 

Braehialis 

24.765 

2.652 

Deltoid 

16.272 

2.212 

Trieeps  long  head 

22.578 

3.226 

Trieeps  short  head 

16.671 

2.176 

Multiplying  the  forearm  musele  belly  length: humerus  length  ratio  by  the  patient’s  humerus  length 
after  a  forearm  amputation  will  yield  a  referenee  length  against  whieh  a  deeision  about  the  type  of 
myoeleetrie  prosthesis  ean  be  determined.  The  low  eoeffieient  of  variation  values  derived  in  this  study 
suggests  the  ratio  ean  be  safely  applied  in  elinieal  situations  as  a  eonvenient  multiplier  to  determine 
referenee  lengths  for  most  eases.  We  identified  two  length  ‘zones’  to  help  foeus  the  deeision.  Zone  1 
ineludes  any  residuum  length  that  is  longer  than  the  referenee  and  Zone  2  ineludes  any  length  shorter 
than  the  referenee  length.  If  an  amputation  results  in  a  residuum  in  Zone  1 ,  forearm  musele  bellies  have 
been  spared  and  a  prosthesis  that  employs  sEMG  signals  from  forearm  museulature  to  operate  the 
prosthesis  ean  be  preseribed. 
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This  study  was  used  as  the  basis  for  analysis  of  the  sEMG  signal  obtained  from  the  two  zones  that 
were  identified.  Fifteen  healthy  subjeets:  14  male  and  1  female  were  tested  for  sEMG  obtained  for 
various  motions  and  foree  levels  from  the  two  zones.  Figure  1.48  shows  the  experimental  setup  for  the 
experiments  eondueted.  The  experiments  were  earried  out  on  the  Noraxon  Myosystem.  As  shown  in 
Figure  1.48  we  have  3  pairs  of  sensors  in  eaeh  zone.  For  this  analysis,  we  did  not  perform  any 
identifieation  of  the  ideal  motor  point  by  using  the  external  stimulator,  but  referring  to  published 
anatomieal  drawings  of  known  sEMG  sites  [43],  we  arbitrarily  plaeed  the  sEMG  sensors  on  the  most 
favorable  loeation  on  the  subjeets’  hand.  The  plaeement  of  the  sensors  also  ineorporates  the  findings 
from  the  zone  elassifieation  study  presented  earlier  in  this  seetion.  A  series  of  experiments  were 
eondueted  and  model  fit  values  were  estimated  to  eompare  the  sEMG  signals  from  the  two  zones. 


Figure  1.48:  Experimental  Setup  for  Zone  Classifieation 

Table  1.14  (a)  &  (b)  provide  a  list  of  experiments  that  were  eondueted  on  15  subjeets,  14  male  and 

1  female 


Motion 

Devices  for  Angle 
Measurement 

Data  Glove  (DG) 

Finger  Device  (FD) 

Experiments  to  be  performed  with  Stress  Balls  -  two  types  of 

Balls/FSR's 

Planned  Experiments 

Description 

Duration 

Zone  1 

Exp.  1 

Random  motion  with  DG  w/stress  ball  1 
(fast) 

30-45  sec 

Exp.  2 

Random  motion  with  FD  w/stress  ball  1 

30-45  sec 

Exp.  3 

Cyclic  motion  with  FD  w/stress  ball  1 

30-45  sec 

Exp.  4 

Cyclic  Motion  with  DG  only  w/stress  ball 

1  (slow) 

30-45  sec 

Exp.  5 

Constant  Force  Level  with  DG  w/stress 

balll 

>30  sec 

Exp.  6 

Random  motion  with  DG  w/stress  ball  2 

30-45  sec 
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(fast) 

Exp.  7 

Random  motion  with  FD  w/stress  ball  2 

30-45  sec 

Exp.  8 

Cyclic  motion  with  FD  w/stress  ball  2 

30-45  sec 

Exp.  9 

Cyclic  Motion  with  DG  only  w/stress  ball 

2  (slow) 

30-45  sec 

Exp.  10 

Constant  Force  Level  with  DG  w/stress 

ball  2 

>30  sec 

Description 

Duration 

Exp.  1 

Random  motion  with  DG  w/stress  ball 
l(fast) 

30-45  sec 

Exp.  2 

Random  motion  with  FD  w/stress  ball  1 

30-45  sec 

Exp.  3 

Cyclic  motion  with  FD  w/stress  ball  1 

30-45  sec 

Exp.  4 

Cyclic  Motion  with  DG  only  w/stress  ball 

1  (slow) 

30-45  sec 

Exp.  5 

Constant  Force  Level  with  DG  w/stress 

>30  sec 

Zone  2 

balll 

Exp.  6 

Random  motion  with  DG  w/stress  ball 

2  (fast) 

30-45  sec 

Exp.  7 

Random  motion  with  FD  w/stress  ball  2 

30-45  sec 

Exp.  8 

Cyclic  motion  with  FD  w/stress  ball  2 

30-45  sec 

Exp.  9 

Cyclic  Motion  with  DG  only  w/stress  ball 

2  (slow) 

30-45  sec 

Exp.  10 

Constant  Force  Level  with  DG  w/stress 

ball  2 

>30  sec 

(b) 


Zone  1 


Devices  for  Angle 
Measurement 

Data  Glove  (DG) 

Finger  Device  (FD) 

Experiments  to  be  performed  with  Stress  Balls  -  two  types  of 

FSR's 

Planned  Experiments 

Description 


Duration 
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Exp.  1 

Random  motion  with  DG  w/stress  ball  1 
(fast) 

30-45  sec 

Exp.  2 

Random  motion  with  FD  w/stress  ball  1 

30-45  sec 

Exp.  3 

Cyclic  motion  with  FD  w/stress  ball  1 

30-45  sec 

Exp.  4 

Cyclic  Motion  with  DG  only  w/stress  ball 

1  (slow) 

30-45  sec 

Exp.  5 

Constant  Force  Level  with  DG  w/stress 

balll 

>30  sec 

Exp.  6 

Random  motion  with  DG  w/stress  ball  2 
(fast) 

30-45  sec 

Exp.  7 

Random  motion  with  FD  w/stress  ball  2 

30-45  sec 

Exp.  8 

Cyclic  motion  with  FD  w/stress  ball  2 

30-45  sec 

Exp.  9 

Cyclic  Motion  with  DG  only  w/stress  ball 

2  (slow) 

30-45  sec 

Exp.  10 

Constant  Force  Level  with  DG  w/stress 

ball  2 

>30  sec 

Exp.  1 

Random  motion  with  DG  w/stress  ball 
l(fast) 

30-45  sec 

Exp.  2 

Random  motion  with  FD  w/stress  ball  1 

30-45  sec 

Exp.  3 

Cyclic  motion  with  FD  w/stress  ball  1 

30-45  sec 

Exp.  4 

Cyclic  Motion  with  DG  only  w/stress  ball 

1  (slow) 

30-45  sec 

Zone  2 

Exp.  5 

Constant  Force  Level  with  DG  w/stress 

balll 

>30  sec 

Exp.  6 

Random  motion  with  DG  w/stress  ball  2 
(fast) 

30-45  sec 

Exp.  7 

Random  motion  with  FD  w/stress  ball  2 

30-45  sec 

Exp.  8 

Cyclic  motion  with  FD  w/stress  ball  2 

30-45  sec 

Exp.  9 

Cyclic  Motion  with  DG  only  w/stress  ball 

2  (slow) 

30-45  sec 

Exp.  10 

Constant  Force  Level  with  DG  w/stress 

ball  2 

>30  sec 
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The  results  presented  here  inelude  data  analysis  of  4  subjeets  was  performed,  for  the  two  zones  and 
4  different  filter  types  were  used.  The  data  analysis  also  ineluded  modeling  for  statie  foree 
measurements  and  eomparison  of  the  two  zones.  An  exeerpt  of  the  results  obtained  is  presented  in  the 
following  seetion. 


Actual  Force  Estimated  Force 

Subject  1,  Zone  1,  Bessel  Filter  Subject  1,  Zone  2,  Bessel  Filter 


Figure  1.49:  Zone  Classifieation  Results  -  Subjeet  1,  Bessel,  Band-Pass  filter  60-450Hz,  Zone  1  &  2 
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Tactual  Force 


■fetimated  Force 


Subject  1,  Zone  1,  Butterworth  Filter  Subject  1,  Zone  2,  Butterworth  Filter 


Figure  1.50:  Zone  Classification  Results  -  Subject  1,  Butterworth,  Band-Pass  filter  60-450Hz,  Zone  1 

&2 
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Tactual  Force 


■fetimated  Force 


Subject  1,  Zone  1,  Chebyshev  I  Filter  Subject  1,  Zone  2,  Chebyshev  I  Filter 


Figure  1.51:  Zone  Classification  Results  -  Subject  1,  Chebyshev  Type  I,  Band-Pass  filter  60-450Hz, 

Zone  1  &  2 
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Tactual  Force 


■fetimated  Force 


Subject  1,  Zone  1,  Chebyshev  II  Filter  Subject  I,  Zone  2,  Chebyshev  II  Filter 


Figure  1.52:  Zone  Classification  Results  -  Subject  1,  Chebyshev  Type  II,  Band-Pass  filter  60-450Hz, 

Zone  1  &  2 
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Tactual  Force 


Estimated  Force 
Subject  2,  Zone  2,  Bessel  Filter 


Subject  2,  Zone  1,  Bessel  Filter 


Figure  1.53:  Zone  Classification  Results  -  Subject  2,  Bessel,  Band-Pass  filter  60-450Hz,  Zone  1  &  2 

From  the  figures  1.49  to  1.53,  for  4  types  of  filters  and  2  subjects,  we  see  that  the  sEMG-force 
relation  modeled  by  the  nonlinear  Hammer  stein- Wiener  models,  using  the  Adaptive  Gauss-Newton 
algorithm,  results  in  the  best  fit  values  for  data  (sEMG)  collected  in  zone  2.  This  outcome  is  in  good 
agreement  with  the  ideal  locations  to  measure  the  sEMG  signals  indicated  in  the  published  anatomical 
drawings  of  known  sEMG  sites  [43].  Also,  zone  2  contains  the  majority  of  the  muscles  which  are 
responsible  for  the  generation  of  force  and  finger  motion. 
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CHAPTER  TWO 


EMG-hand  motion  model  integration  and  optimization  for  degree  of  amputation  using  sensor 

fusion  strategies 

This  chapter  describes  force  modeling,  force  fatigue  modeling,  system  identification,  data  fusion 
algorithms,  and  finger  motion  modeling. 

2.1  Introduction 

This  section  reviews  techniques  of  EMG  signal  analysis,  sEMG-skeletal  muscle  force 
relationships,  sEMG- skeletal-muscle  fatigue  and  introduces  the  System  Identification  approach  to 
dynamic  modeling. 

2.1.1  Techniques  of  EMG  Signal  Analysis 

Literature  shows  that  there  are  numerous  mathematical  and  Artificial  Intelligent  (AI) 
techniques  available  for  the  EMG  signal  detection  and  analysis  [6].  In  the  category  of  mathematical 
models,  there  are  Fourier  transform,  statistical  measures,  time-frequency  approaches,  wavelet 
transform,  Wigner-Ville  Distribution  (WVD),  and  higher-order  statistics.  However,  on  the  other  hand 
in  AI  approaches,  there  are  Artificial  Neural  Networks  (ANN),  dynamic  recurrent  neural  networks 
(DRNN),  fuzzy  logic  (FL)  systems,  and  Genetic  Algorithm  (GA). 


Figure  2.1.  Detection  and  decomposition  of  intramuscular  EMG  signal.  Adapted  from  [48]. 

The  motor  unit  action  potential  (MUAP)  is  the  combination  of  the  muscle  fiber  action 
potentials  from  all  the  muscle  fibers  of  a  single  motor  unit  [47].  The  two  detection  methods  of  MUAP 
are  a  skin  surface  electrode  (non-invasive)  located  near  this  field,  and  a  needle  electrode  (invasive) 
inserted  in  the  muscle.  In  general  the  EMG  signal  can  be  modeled  as  given  in  Equation  (1),  [6]. 
x(n)  =  -r)  +  w(n)].  (1) 

In  Equation  (1),  x(n)  is  the  modeled  EMG  signal,  e(n)  is  the  point  processed,  representing  the  firing 
impulse,  h(r)  is  the  MUAP,  w(n)  is  the  zero  mean  additive  white  Gaussian  noise,  and  N  is  the  number 
of  motor  units  firing  [6].  Figure  2.1  illustrates  the  detection  and  decomposition  of  intramuscular  EMG 
Signal  [48]. 

Following  are  the  various  signal  processing  methods  that  have  been  studied  and  applied  to  raw 
EMG  for  its  better  and  precise  interpretation  [6]. 

Wavelet  Analysis 

A  very  appropriate  method  for  the  classification  of  the  EMG  signal  is  the  wavelet  transform 
(WT),  which  can  be  implemented  by  means  of  a  discrete  time  filter  bank  [6]. 

•  Wavelet  analysis  is  one  of  the  best  techniques  to  match  the  shape  of  the  MUAP,  which  results  in 
the  best  possible  energy  localization  in  the  time-scale  plane  [49]. 

•  Work  of  [49]  was  followed  further  and  wavelet  analysis  was  used  to  match  the  shape  of  the  MUAP 
[50].  Wavelet  analysis  is  linear,  gives  a  multi-resolution  representation  and  does  not  get  altered  by 
cross-terms,  for  instance,  in  the  instance  of  multicomponent-signal  analysis,  which  makes  the  WT 
an  alternative  to  other  time- frequency  representations  [50]. 

•  Mexican  hat  wavelet  is  a  second-order  derivative  of  a  Gaussian  distribution,  which  is  an 
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appropriate  option  to  estimate  the  shape  of  MUAP  for  a  unipolar  reeorded  signal  with 
underpinning  assumptions  [51]. 

•  In  eontrast  to  the  non- stationary  nature  of  the  EMG  signal,  with  the  assumption  that  the  EMG 
signal  is  stationary,  the  fast-  and  short-term  Fourier  transforms  (EFT  and  SET)  are  eommonly  used 
to  eompute  the  frequeney  speetrum  of  the  EMG  signal  [52]. 

•  WT  is  also  an  appropriate  method  for  multi-resolution  analysis,  whieh  is  basieally  analyzing  the 
signals  at  different  resolution  levels  [53]. 

•  ‘Wavelet  funetion’  (WF)  is  a  basis  funetion  used  in  the  WT  to  deeompose  the  signal  into  several 
multi-resolution  eomponents  [54].  In  one  side,  the  Short  Fourier  Transform  (SFT)  with  relatively 
short-time  windows  traek  the  speetral  variations  with  time;  however,  this  method  does  not  work 
well  for  the  non- stationary  signal  [54]. 

Time-Frequency  Approach 

Some  of  the  time-frequeney  methods  for  EMG  signal  proeessing  are  Cohen-elass 
transformation,  Wigner-Ville  distribution  (WVD),  and  Choi-Williams  distribution  [6].  EMG  signals  for 
dynamie  eontraetions  represent  non- stationary  stoehastie  proeesses  and  ean  be  modeled  with  the 
Cohen-elass  transformation,  whieh  is  a  elass  time-frequeney  representation  [55].  The  mathematieal 
representation  of  the  Cohen-elass  time-frequeney  speetrum  is  given  by  Martin  and  Flandrin  [56],  Amin 
[57]  and  Syeed  and  Jones  [58]. 

Autoregressive  Model 

EMG  signals  have  been  modeled  with  the  autoregressive  (AR)  time-series  models  where 
EMG  signals  are  assumed  with  the  delayed  intramuseular  input  [6].  EMG  signals  were  modeled  by 
Graupe  and  Cline  in  1975  with  the  autoregressive  moving-average  (ARM A)  model  [59],  where  they 
eonsidered  the  EMG  signal  as  stationary  over  suffieient  short  time  intervals.  In  [60],  Sherif  stated  that 
the  eleetrieal  behavior  of  the  medieal  deltoid  is  non- stationary  and  proposed  a  replaeement  with  AR, 
integrated  moving-average  (ARIMA)  representation  where  the  non- stationary  nature  of  the  EMG 
during  different  phase  of  musele  aetivity  was  eharaeterized.  The  surfaee  EMG  signal  with  delayed 
intramuseular  EMG  signal  as  the  input  was  modeled  with  AR  model  by  Zhou  et  al.  [61].  Hefftner  et  al. 
suggested  that  the  AR  model  was  a  good  ehoiee  with  better  eomputational  speed  [62].  A  statie 
nonlinear  element  with  time-varying  ARMA  model  and  a  non- stationary  identifier  of  time-varying  AR 
parameters  were  proposed  by  Bernatos  et  al.  [63],  and  Moser  and  Graupe  [64].  Researeh  work  by 
Tohru  suggested  that  the  AR  model  whieh  eomputationally  eeonomieal  was  better  than  the  more 
preeise  ARMA  or  ARIMA  models  for  dynamie  musele  movements  [65]. 

Artificial  Intelligence 

The  EMG  signal  reeording  and  analysis  is  a  real-time  applieation  and  Artifieial  Intelligenee 
teehniques  mainly  based  on  Neural  Networks  (NN)  have  been  proposed  for  this  applieation  [6].  Del 
and  Park  proposed  a  real-time  applieation  of  artifieial  neural  network  whieh  ean  solve  problems  with 
aeeeptable  eost  and  performanee  eriteria  that  eonventional  statistieal  methods  eannot  [66].  Neural- 
network  arehiteetures  are  a  fast  way  of  system  eustomization  to  the  patient,  but  also  provide  better 
patient  adoption  to  the  system  [6]. 

In  addition,  artifieial  dynamie  reeurrent  neural  networks  (DRNN)  were  used  to  model  the 
musele  EMG  aetivity  and  the  arm  kinematies,  where  the  simulated  movements  were  the  result  of  the 
interaetion  between  raw  EMG  signals,  without  invoking  any  theoretieal  assumptions  for  the  eontrol 
strategy  [67]. 

Fuzzy-logie  systems  have  a  reasoning  style  similar  to  humans  and  emulate  human  deeision- 
making  more  elosely  than  the  artifieial  neural  network  (ANN);  one  of  the  properties  of  the  Fuzzy  logie 
(FL)  systems  is  that,  FE  deals  with  eontradietions  nieely,  whieh  makes  FE  a  good  ehoiee  for  EMG 
signal  proeessing  and  elassifieation  [68]. 

Another  NN  based  method  is  the  blind  souree  separation  (BSS)  method  proposed  in  2001  by 
Belouehrani  et  al.  [69].  EMG  signals  generated  by  different  museles  may  overlap  in  the  time  and 
frequeney  domain;  therefore,  spatial  time-frequeney  distributions  based  approaeh  was  a  solution  for 
souree  separation  rather  than  the  elassieal  linear  filtering  [70]. 

Higher-Order  Statistics 

Higher-order  statisties  (HOS)  is  a  teehnique  based  on  probability  theory,  whieh  ean  be  used  to 
study  the  eharaeteristies  and  nature  of  a  random  proeess.  In  1974,  Kanosue  et  al.  [71]  proposed  a 
statistieal  method  to  estimate  the  amplitude  and  the  number  of  newly  MUAPs,  after  this  there  are  some 
more  methods  proposed  by  some  other  researehers. 

Other  Methods 

Some  of  the  other  models  proposed  by  researehers  for  the  EMG  signal  proeessing  are  briefly 
diseussed  in  this  seetion. 
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•  The  experimental  works  of  Ludin  [72]  on  the  intereostal  museles  was  the  bases  of  Rosenfalek’s 

mathematieal  model  in  1969.  The  model  is  given  below  in  Equation  (2). 

g(z)  =  96z^e~^  -  90,  (2) 

where  g(z)  is  intraeellular  aetion  potential  in  mV,  andz  is  nerve  or  musele  measurements  in  mm.  To 
mateh  with  better  experimental  data,  Nandedkar  and  Stalberg  [73]  suggested  a  modified  expression  as 
e(z)  =  g(2z),  whieh  is  intraeellular  formulation  for  the  single  fiber  aetion  potential  modeling  and 
given  by  Equation  (3). 

e(z)  =  768  *  z^  *  —  90.  (3) 


•  Previous  studies  in  1990  by  Slawnyeh,  Laszlo,  and  Hershler  [74]  suggested  that  the  MUAP 
amplitude  adds  algebraieally  to  results  into  the  eompound  musele  aetion  potential  (CMAP),  whieh  is 
not  valid  beeause  the  oeeurrenee  of  MUAP  waveforms  is  not  synehronous.  In  1992,  Nandedkar  and 
Barkhaus  proposed  a  model,  whieh  gives  the  phenomena  of  phase  eaneellation,  where  the  MUAP 
eontributes  less  than  its  amplitude  to  CMAP  amplitude  [74],  Equation  (4). 

^12  =  +  A2  —  2  *  *  A2  *  cc.  (4) 


Here,  A^  and  A2  are  the  two  MUAPs  with  phase  angle  a,  and  A^2  is  the  CMAP. 

•  Englehart  and  Parker  eonsidered  two  interpulse  interval  (IPI)  probability  density  funetion  (pdf) 
models,  the  Gaussian  density  funetion  model  (Equation  (5))  and  the  Gamma  density  funetion  model 
(Equation  (6))  [75]. 

1  _ 


V  2al  )' 


Here,  is  the  mean  and  is  the  varianee. 


(5) 


(6) 


Here,  a  is  the  loeation  parameter,  /S  is  the  seale  parameter,  p  is  the  shape  parameter,  and  r()  is  the 
gamma  funetion. 


•  In  1995,  Zhang  et  al.  [76]  derived  a  model  for  the  myoeleetrie  signal  with  the  integral  pulse 
frequeney  and  amplitude  modulation  (IPFAM).  The  three  main  eomponents  of  the  pulse  amplitude 
modulation  (PAM),  the  pulse  frequeney  modulation  (PFM)  and  the  linear  system  explains  the 
eharaeteristies  of  the  EMG  signals  with  ehange  in  museular  foree,  rates  of  nerve  firing,  and  the 
eompound  motor  unit  aetion  potential  ineluding  effeets  of  propagation  dispersion  and  tissue  filtering. 
The  IPFAM  model  ineludes  the  key  aspeets  for  the  EMG  signal  generation,  where  the  potential 
inereases  up  to  a  threshold  resulting  in  an  event  [76]. 

•  In  1995,  Karlsson  and  Nystrom  developed  a  real-time  system  for  the  EMG  signal  analysis  for 
elinieal  applieations,  where  a  signal  is  represented  in  time- frequeney  domain  with  the  short-time 
Fourier  transform  [77].  The  limitation  of  this  system  is  that  in  eontrast  to  the  inherent  eharaeteristie  of 
the  EMG  signal,  this  method  assumes  the  signal  to  be  stationary. 

•  In  2000,  Duehene  and  Hogrel  produeed  an  effieient  surfaee  EMG  simulation  model,  whieh  was 
useful  for  assessing  algorithms  related  to  surfaee  EMG  features  deseription  [78].  The  model  allowed 
the  surfaee  EMG  simulation  in  both  voluntary  and  elieited  eontraetions;  eonsidered  all  transformations 
from  intraeellular  potential  to  surfaee  reeordings,  and  exhibited  a  fast  implementation  of  the 
extraeellular  potential  eomputation. 

•  In  2005,  Hamilton  and  Stashuk  proposed  an  EMG  signal  model,  whieh  was  designed  to  resemble 
the  physiology  and  morphology  of  skeletal-musele  elosely,  ineorporated  the  line  souree  models  of 
eommonly  used  needle  eleetrodes  positioned  in  alignment  with  the  elinieal  studies  [79]. 


2.1.2  sEMG  -  Skeletal-Muscle  Force  Relationship 

Bouisset  surveyed  the  relationship  between  the  EMG  signal  and  musele-foree  relationship  in 
normal  motor  aetivities  [80].  The  EMG  is  a  measure  of  the  level  of  nervous  exeitation,  and  the  skeletal- 
musele  foree  during  the  eontraetion  depends  on  the  nervous  exeitation,  therefore,  the  EMG  ean  be  used 
to  measure  the  skeletal-musele  foree  [81].  There  is  a  neeessity  to  develop  a  good  means  of 
quantifieation  of  skeletal-musele  foree  using  the  EMG  signal,  and  there  have  been  numerous  researeh 
efforts  in  this  direetion.  Perry  and  Bekey  in  [81]  present  a  review  on  the  mathematieal  models  for  the 
EMG  signal  and  musele-foree  relationship.  Those  authors  eoneluded  that  some  of  the  results  are 
experimental  in  nature,  no  detailed  mathematieal  models  with  the  physiologieal  properties  and 
parameters  exist,  the  model  provides  only  a  steady-state  relationship,  and  the  model  is  only  algebraie  in 
nature  with  no  information  about  the  transient  behavior.  The  EMG  signal  proeessing  is  a  viable  option 
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to  study  the  “active  state,”  which  depends  on  the  internal  change  of  the  muscle.  Numerous  dynamic 
linear  and  nonlinear  modeling  approaches  were  proposed  with  integrated  EMG  signal  to  study  the 
“active  state”  of  the  muscle.  These  mathematical  models  do  not  have  any  parameter  for  physiological 
properties  and  hence  are  of  very  limited  use.  The  conclusion  of  the  study  in  [81]  include: 

a)  At  the  middle  of  the  operating  force  range  and  for  some  electrode  configurations  during  the 
isometric  contractions,  the  EMG  signal  and  muscle-force  has  linear  relationship. 

b)  For  the  EMG  signal  and  force  relationship,  the  joint  position  affects  the  constant  of 
proportionality. 

c)  The  EMG  signal  and  muscle-force  relationship  is  not  linear  in  the  presence  of  joint  movements. 

d)  The  EMG  signal  and  muscle-force  relationship  estimate  highly  depends  on  the  type  of  electrode, 
location  of  electrode  placement,  and  the  signal  processing  method. 

e)  There  is  no  good,  verified  and  validated  mathematical  model  for  the  EMG  and  muscle-force 
relationship  in  the  presence  of  joint  movements. 

In  1993,  research  by  Fuglevand  A.  J.  et  al.  [82]  presented  a  muscle-force  model  for  a  pool  of 
120  motor  units,  which  gave  an  exponential  function  for  the  distribution  of  twitch  forces  for  the  motor 
units.  Equation  (7)  gives  the  model  of  twitch  force  in  terms  of  the  impulse  response  of  a  critically 
damped,  second  order  system. 


fit) 


(7) 


Here,  T  is  contraction  time  to  peak  force  of  the  twitch  and  P  is  its  peak  amplitude.  Twitch  contraction 
times  are  inversely  proportional  to  twitch  amplitudes,  which  were  determined  by  the  rank  in  the 
recruitment  order.  The  total  force  of  the  muscle  was  determined  as  a  linear  summation  of  all  the 
individual  MU  forces,  where  MUs  followed  the  sigmoidal  relationship  of  MU  force  and  firing  rate 
[82]. 

A  study  in  2007  develops  a  neuromusculo skeletal  tracking  (NMT)  method,  which  estimates 
muscle-forces  from  observed  motion  data  [83].  Skeletal  motion  tracking  calculates  the  joint  torques 
needed  to  actuate  a  skeletal  model  and  track  observed  segment  angles  and  ground  forces  in  a  forward 
simulation  of  the  motor  task;  optimal  neuromuscular  tracking  resolves  the  muscle  redundancy  problem 
dynamically  and  finds  the  muscle  excitations  (and  muscle-forces)  needed  to  produce  the  joint  torques 
calculated  by  the  skeletal  motion  tracker.  NMT  method  can  estimate  muscle-forces  using 
experimentally  obtained  kinematics  and  ground  force  data  in  a  fast  and  accurate  way  [83]. 

The  relationship  between  the  EMG  signal  and  the  force  produced  by  a  muscle  and  the 
complicated  and  associated  factors  influencing  this  relationship  are  discussed  in  [46].  For  proper  use, 
the  understanding  the  EMG  signal  is  important,  conversely  it  is  complicated  because  of  the  difficulties 
in  quantifying  factors  and  processes  that  affect  the  EMG  signal.  The  anisotropy  and  non-homogeneity 
of  the  tissues  between  the  muscle  membranes  and  the  detection  electrode,  and  the  uniqueness  of  the 
microanatomical  structures  of  each  detection  location  further  complicates  this  issue.  Carlo  J.  De.  Euca 
in  [46]  states  that,  “It  is  conceivable  that  in  the  future,  elegant  and  complex  models  will  be  used  in 
conjunction  with  means  for  describing  the  anatomy,  physiology,  and  electrical  field  properties  to  allow 
a  direct  consideration  of  this  problem.”  The  factors  that  influence  the  EMG  signal  can  be  causative, 
intermediate,  and  deterministic.  The  causative  factors  can  be  extrinsic,  those  associated  with  the 
electrode  structure  and  its  placement  on  the  surface  of  the  skin  above  the  muscle,  and  intrinsic,  the 
physiological,  anatomical,  and  biochemical  characteristics  of  the  muscle.  The  extrinsic  causative 
factors  as  listed  in  [46]  are: 

a)  Electrode  configuration  —  the  shape  and  the  surface  area  of  the  electrode  and  the  inter  electrode 
surface  distance. 

b)  The  relative  position  of  the  electrode  and  the  motor  points  in  the  muscle. 

c)  Crosstalk  detected  by  the  electrode:  Surface  location  of  the  electrode  on  the  muscle. 

d)  The  electrode  detection  surface  orientation  with  respect  to  the  muscle  fibers. 

The  intrinsic  factors  as  listed  in  [46]  are  given  as: 

a)  The  amplitude  of  the  detected  signal  depends  on  the  number  of  active  motor  units  at  any  instance 
of  the  contraction. 

b)  Fiber  type  composition  of  the  muscle;  fiber  diameter;  Depth  and  location  of  the  active  fibers 
within  the  muscle  with  respect  to  the  electrode  detection  surfaces. 

c)  Blood  flow  in  the  muscle. 

d)  “The  amount  of  tissue  between  the  surface  of  the  muscle  and  the  electrode,  which  affects  the 
spatial  filtering  of  the  signal.” 

e)  Some  other  un-identified  factors:  the  length  of  the  depolarization  zone  and  ionic  fluxes  across  the 
membrane. 
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Figure  2.2  shows  the  influenee  of  the  loeation  of  the  eleetrode  on  the  amplitude  and  frequeney 
speetrum  of  the  EMG  signal  (top  eleetrode),  the  myotendonous  junetion  (bottom  eleetrode)  and  the 
lateral  edge  of  the  musele  (middle  right  eleetrode).  The  EMG  signal  has  maximum  amplitude  at  the 
midline  of  the  belly  of  the  musele  between  the  nearest  innervation  zone  and  the  myotendonous  junetion 
[46]. 
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Figure  2.2:  The  influenee  of  the  eleetrode  loeation  on  signal  amplitude.  Adapted  from  [46]. 


The  intermediate  faetors  are:  The  implieit  eharaeteristies  of  a  differential  eleetrode 
eonfiguration  sueh  as  band-pass  filtering  aspeets  of  the  eleetrode;  deteetion  volume  of  the  eleetrode; 
superposition  of  aetion  potentials  in  the  deteeted  EMG  signal;  erosstalk  from  nearby  museles; 
eonduetion  veloeity  of  the  aetion  potentials  that  propagate  along  the  musele  fiber  membrane;  and  the 
relative  position  of  the  eleetrode  and  the  aetive  musele  fibers  affeets  the  spatial  filtering  [46]. 

The  deterministie  faetors  for  the  relationship  of  the  EMG  and  the  musele-foree  are:  the 
number  of  aetive  motor  units;  motor  unit  foree-twiteh;  meehanieal  interaetion  between  musele  fibers; 
motor  unit  firing  rate;  the  number  of  deteeted  motor  units;  amplitude,  duration,  and  shape  of  the 
MUAPs;  and  reeruitment  stability  of  motor  units  [46]. 

At  present,  we  do  not  have  an  equation  that  ean  represent  the  relationship  between  the  surfaee 
EMG  signal  and  the  musele-foree  during  musele  eontraetion.  The  inerease  in  the  musele-foree 
generally  results  in  the  inerease  of  the  amplitude  of  the  EMG  signal.  This  knowledge  gives  us  only  the 
qualitative  information  and  laeks  in  the  quantitative  part  in  it  [46]. 

As  diseussed  previously,  there  are  many  eausative,  intermediate,  and  deterministie  faetors, 
whieh  make  this  relationship  to  be  non-rigid.  If  the  eleetrode  is  plaeed  firmly,  and  there  is  no  relative 
distanee  between  the  eleetrode  and  the  aetive  musele  fibers,  normalization  of  the  amplitudes  of  the 
EMG  signal  and  the  foree  among  eontraetions  will  neutralize  the  effeet  of  all  these  faetors  [46]. 

The  surfaee  EMG  signals  are  affeeted  by  the  issue  of  erosstalk  and  stationarity  [46],  [84].  The 
stability  of  the  eleetrode  position  with  respeet  to  the  aetive  musele  fibers  and  the  stability  of  the  motor 
unit  aetivation  pattern  have  the  greatest  effeet  on  signal  stationarity  [46],  [84].  For  natural  movements 
and  to  interaet  with  our  environment,  we  need  eoneentrie  (CC:  shortening  of  musele)  or  eeeentrie  (EC: 
lengthening  of  musele)  eontraetions,  whereas  isometrie  eontraetion  is  the  most  studied  eontraetion  even 
though  it  is  less  physiologieally  interesting  [46]. 

The  EMG  signal  and  musele-foree  relationship  primarily  depends  on  a  CC/EC  eontraetion, 
whieh  entails  various  meehanieal,  physiologieal,  anatomieal  and  eleetrieal  modifieations  during  the 
eontraetion.  To  obtain  a  quantitative  relationship  between  the  EMG  signal  and  musele-foree,  the 
signals  must  be  aequired  during  an  isometrie  eontraetion.  Considering  the  absenee  of  the  teehnieal 
faetors  and  erosstalk,  the  EMG  and  musele-foree  relationship  is  not  always  linear,  whieh  ehange  as  the 
type  of  musele  ehange.  Figure  2.3  shows  the  relationship  between  the  normalized  EMG  and  joint  Foree 
signals  for  three  types  of  museles,  where  the  smoothed  data  window  is  of  2  seeonds  duration  [46]. 
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Figure  2.3:  Normalized  EMG  signal  vs.  joint  force.  Adapted  from  [46]. 

The  random  nature  of  the  surface  EMG  signal,  intrinsic  anatomical  and  physiological  factors 
results  in  the  nonlinear  relationship  between  the  EMG  and  the  muscle-force  signal  [46].  Other  reasons 
for  the  nonlinear  relationship  are: 

1)  For  most  of  the  available  electrode  types,  the  detection  volume  of  the  electrode  is  less  than  the 
muscle  volume,  which  implies  that  the  number  of  MUAPs  detected  by  the  electrode  is  less  than  the 
active  MUAPs  in  the  corresponding  muscle. 

2)  The  firing  rate  of  the  recruited  motor  units  will  increase  with  the  increase  in  the  muscle-force. 
Each  MUAP,  however,  will  continue  to  provide  energy  to  the  EMG  signal,  while  the  force  contribution 
saturates.  This  results  in  the  nonlinear  relationship  between  the  EMG  signal  and  the  muscle-force 
signal.  The  central  nervous  system  (CNS)  also  affects  the  EMG-force  relationship  by  controlling  the 
motor  units  firing  rate  dynamics,  and  motor  unit  recruitment  range  [46]. 

2.1.3  sEMG  -  Skeletal-Muscle  Fatigue 

The  energy  consumption  of  skeletal-muscle  cells  may  increase  to  100-fold  when  going  from 
rest  to  high-intensity  exercise.  The  aerobic  capacity  of  the  muscle  cells  falls  short  with  the  energy 
demand  during  high- intensity  exercise,  and  anaerobic  metabolism  supplies  a  major  portion  of  the 
required  adenosine  triphosphate  (ATP).  Skeletal-muscle  fatigue  (i.e.  a  decline  in  contractile  function  is 
also  an  outcome  of  high-intensity  exercise).  Muscle- fatigue  and  anaerobic  metabolism  likely  are 
correlated,  and  the  decrease  in  contractile  function  results  as  a  consequence  of  anaerobic  metabolism 
[85].  Tactic  acid  is  the  main  part  of  inorganic  acids,  and  intracellular  accumulation  of  inorganic  acids 
results  from  anaerobic  breakdown  of  glycogen  [85],  [86].  Lactate  and  are  the  products  of  the 
dissociation  of  the  lactic  acid,  which  is  a  strong  acid.  Muscle  contraction  is  not  affected  greatly  by 
lactate  ions  [86];  but,  the  buildup  of  or  moderation  of  pH  is  the  typical  reason  of  the  skeletal- 
muscle  fatigue.  Several  recent  studies  illustrate  that  the  decreased  pH  may  have  small  effect  on  the 
contraction  in  mammalian  muscle  [85],  [87],  [88],  [89],  [90].  In  addition  to  acidosis,  anaerobic 
metabolism  in  skeletal-muscle  also  entails  hydrolysis  of  creatine  phosphate  (CrP)  to  creatine  and 
inorganic  phosphate  (Pj).  Several  mechanisms  may  justify  the  decrease  of  contractile  function  as  an 
outcome  of  increased  Pj,  but  creatine  has  small  effect  on  contractile  function.  So,  during  high-intensity 
exercise  the  buildup  of  Pj,  rather  than  acidosis  seems  to  be  the  chief  cause  of  muscle-fatigue  [90],  [91], 
[92],  [93],  [94],  [95].  Failure  of  action-potential  propagation  and  other  similar  elements  become  critical 
with  even  more  intense  activation  such  as  continuous  maximal  contraction  [85]. 

The  breakdown  of  CrP  is  the  main  reason  for  increase  of  the  Pj  concentration  during  intense 
skeletal-muscle  activity.  The  release  of  Pj  in  the  transition  from  low-force  (weakly  attached  states)  to 
high-force  (strongly  attached  state)  is  proposed  by  most  cross-bridge  action  models.  So,  the  transition 
to  high-force  states  is  constrained  by  Pi  buildup.  This  outcome  indicates  that  during  fatigue 
development  there  will  be  less  cross-bridges  in  high-force  states  and  increased  Pi  would  cause  decrease 
in  force  production  [85]. 
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Figure  2.4:  Various  mechanisms  of  Pf  effect  on  muscle  function  during  fatigue.  Adapted  from  [85]. 

Increased  Pi  also  affects  fatigue  development  by  acting  on  sarcoplasmic  reticulum  (SR) 
handling.  In  this  respect,  there  are  several  mechanisms  by  which  increased  Pj  may  exert  its  effect,  and 
the  result  may  be  both  increased  and  reduced  tetanic  Figure  2.4  illustrates  the  various 

mechanisms  by  which  Pj  may  affect  muscle  function  during  fatigue.  It  shows  that  increased  Pj  may 
depress  force  production  by  acting  directly  on  the  myofibrils  or  on  sites  in  the  excitation-contraction 
pathway  within  muscle  cells.  The  depressive  effect  of  increased  Pi  may,  like  the  effect  of  acidification 
described  above,  diminish  as  the  temperature  is  increased  to  that  prevailing  in  mammalian  muscles  in 
situ.  Increased  Pi  may  act  directly  on  the  myofibrils  and  decrease  cross-bridge  force  production  and 
myofibrillar  sensitivity  (A).  By  acting  on  SR  handling  (B),  increased  Pi  may  also  increase 
tetanic  [Ca^^]i  in  early  fatigue  by  stimulating  the  SR  release  channels  (1);  inhibit  the  ATP- 
driven  SR  up-take  (2);  and  reduce  tetanic  [Ca^^]i  in  late  fatigue  by  entering  the  SR, 

precipitating  with  Ca^^,  and  thereby  decreasing  the  available  for  release  (3),  [85]. 

Muscle-force  output  has  been  used  as  a  muscle  fatigue-index  in  the  study  of  human 
biomechanics  [46].  The  muscle  is  assumed  to  be  fatigued  at  the  failure  point,  which  is  the  point  at  the 
muscle  contraction,  can  no  longer  be  maintained.  Use  of  failure  point  as  an  indication  of  muscle- 
fatigue  has  some  practical  disadvantages,  where  fatigue  would  be  detected  only  after  it  had  occurred, 
which  is  not  desirable  for  clinical  and  ergonomics  applications.  Moreover,  there  are  three  other  critical 
factors: 

1)  The  measured  torque  may  not  truly  represent  the  force  of  the  muscle  of  interest,  because  for  a 
voluntary  contraction  the  force  of  an  individual  muscle  is  not  directly  accessible. 

2)  The  physiological  and  biochemical  processes  are  microscopic  in  nature,  and  change  the  means  for 
generating  force  during  a  sustained  submaximal  contraction  at  constant  torque. 

3)  Either  both  or  any  one  of  physiological  and  psychological  factors  can  be  the  reason  for  the  failure, 
which  is  almost  impossible  to  determine  accurately.  An  alternative  and  preferable  method  to  detect  the 
muscle- fatigue  is  the  spectral  analysis  of  the  EMG  signal  during  a  sustained  contraction.  The  fatigue- 
index  is  a  means  for  monitoring  and  quantifying  the  spectral  modification  during  sustained 
contractions,  which  results  in  the  fatigue-related  changes  in  the  physiological  and  biochemical 
processes. 

During  the  fatigue  progression,  both  the  EMG  spectral  modification  and  muscle-force 
changes;  this  result  indicates  that  there  is  a  relationship  between  the  two  variables.  Although  the  causal 
nature  of  this  relationship  has  yet  to  be  demonstrated,  the  spectral  fatigue-index  is  useful  to  study 
muscle- fatigue  [46].  Mean  or  mode  frequency,  and  median  of  the  spectrum  are  some  of  the 
characteristic  indicators  of  the  frequency  spectrum,  which  can  be  used  to  monitor  and  compute  the 
spectral  modification.  Median  frequency  is  the  best  choice  for  fatigue-index,  because  it  is  less  sensitive 
to  noise  and  signal  aliasing,  and  more  sensitive  to  the  biochemical  and  physiological  factors  within  the 
muscles  during  sustained  contractions  [46],  [96].  A  diagrammatic  representation  of  the  spectral 
modification  during  muscle-fatigue  is  shown  in  the  Figure  2.5. 
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Figure  2.5:  The  muscle  fatigue-index  is  represented  by  the  median  frequency  of  the  spectrum  of  the 
EMG  signal  during  sustained  contraction.  Adapted  from  [46]. 

2.1.4  System  Identification  (SI)  a  Dynamic  Modeling  Approach 

System  Identification  (SI)  is  the  interface  between  the  real  world  of  applications  and  the 
mathematical  world  of  control  theory  and  model  abstractions,  where  the  dynamic  mathematical  models 
of  natural  phenomena  are  designed  from  observed  input-output  data  [97].  System  identification  is  a 
very  large  topic  with  many  facets  and  there  are  many  approaches  and  methods  in  SI  [97]. 

Thermodynamics  and  electromagnetism  in  physics,  chemical  processes  and  adaptation  in 
biology,  control  systems  in  engineering,  and  decision  making  in  macro- economics,  finance,  and 
business  economics  are  some  of  the  phenomena  with  a  dynamical  evolution  over  time  [98].  These 
dynamic  processes  can  be  studied  with  mathematical  models;  we  require  stability,  uncertainty 
reduction,  and  optimal  decision  making  for  these  models.  These  models  need  to  have  model  parameters 
that  can  be  estimated  from  available  data.  In  the  process  of  SI  to  estimate  a  system,  we  need  an 
observed  data  set,  a  model  structure  with  specifications,  compute  the  unknown  model  parameters,  and 
finally  validation  of  the  obtained  model.  Modeling  of  dynamical  phenomena  from  observed  data  can  be 
used  for  numerous  fields  such  as  engineering,  astronomy,  microbiology,  psychology,  management,  and 
many  others.  SI  application  flow  chart  is  given  in  Figure  2.6. 


Figure  2.6:  Flow  chart:  System  Identification  application.  Adapted  from  [99]. 


70  of  329 


Figure  2.7:  Schematic  block  diagram  of  SI  components.  Adapted  from  [99]. 

In  a  real  world  environment  a  system  is  subjected  to  disturbances  and  noise  influences.  In 
parallel  to  the  regular  measured  input  the  disturbance  also  plays  a  role  in  the  excitation  of  the  system 
modes.  Noise  and  internal  dynamics  of  the  system  is  part  of  the  data  collected  with  input/output 
sensors  [99].  Figure  2.7  illustrates  the  typical  SI  components  in  order  to  extract  a  mathematical  model 
from  experimental  data. 

Non  Parametric  System  Identification  Techniques 

Non-Parametric  System  Identification  uses  the  direct  estimation  of  the  response  of  the  system 
and  does  not  require  system  parameters.  Table  2.1  shows  a  set  of  nonparametric  SI  methods  [99]. 


Table  2.1:  Non-Parametric  SI  Methods 


Method 

Domain 

Principle 

Characteristics 

Correlation 

Time 

Correlation  of 
output  with  input, 
and  solve  for  the 
impulse  response 

Approximation  of 
the  covariance 

matrix 

Frequency 

Response 

Frequency 

Apply  a  sine  wave, 
and  determine 
amplitude  and  phase 
graphically 

»Sinusoid  inputs 
only  »  Long 
experiment 
periods  necessary 

Frequency 

Response 

and 

correlation 

Frequency 

Apply  a  sine  wave, 
correlate  with  sine 

and  cosine  to 
suppress  noise 

»Sinusoid  inputs 
only  »  Long 
experiment 
periods  necessary 

Fourier 

Analysis 

Frequency 

The  empirical 
transfer  function 

estimate  =  DFT  of 
the  output  divided 
by  the  discrete 
Fourier  transform  of 
the  input 

»  Fast » 

Noise-sensitive 
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Parametric  System  Identification 

Parametric  System  Identification  methods  require  a  model  that  fits  the  given  system.  The 
models  of  this  method  are  in  parametric  form,  hence  the  name  of  this  SI  method.  Some  of  the 
parametric  model  structures  are  covered  in  the  following  section  [99]. 


General  -  Linear  Polynomial  Model 

A  general- linear  polynomial  model,  also  known  as  general- linear  model,  can  describe  many 
different  types  of  systems.  These  models  are  used  for  discrete  systems  only.  Equation  (8)  gives  a 
discrete  system  model,  which  is  known  as  the  general-linear  polynomial  model. 
y(/c)  =  z~^Giz~^,9)uik)  +  0)e(/c),  (8) 

where  u(k)  is  the  system  input,  y(/c)  is  the  system  output,  e(k)  is  a  zero-mean  white  noise  or  the 
disturbance  of  the  system,  G(z~^,  6)  is  the  transfer  function  of  the  deterministic  part  of  the  system,  and 
H(z~^,6)  is  the  transfer  function  of  the  stochastic  part  of  the  system.  The  deterministic  transfer 
function  describes  the  relation  between  the  output  and  the  input  signal.  Effects  of  random  disturbances 
on  the  output  signal  can  be  explained  by  the  stochastic  transfer  function.  System  dynamics  are 
associated  with  the  deterministic  and  stochastic  dynamics  with  stochastic  parts  of  a  system  [99].  The 
term  is  the  backward  shift  operator,  which  is  given  by  Equation  (9). 
z~^x{k)  =  x(k  —  1). 
z~'^x(k)  =  x(k  —  2). 


z~^x{k)  =  x(k  —  n).  (9) 

z“^  defines  the  number  of  delay  samples  between  the  input  and  the  output.  G{z~^,6)  and//(z“^,0) 

are  rational  polynomials  and  are  given  by  Equation  (10)  and  (11)  respectively: 


A(z,6)F(z,6y 

C{z,G) 


(10) 

(11) 


A{z,d)D{z,dy 

The  vector  6  is  the  set  of  model  parameters.  To  simplify  the  equations  6  is  not  used  in  the  following 
sections. 

Defining  A{z),B{z),C{z),D{z),  and  F(z)  as  follows: 

i4(z)  =  1  +  a^z~^  -h  a2Z~^  -\ - f  aj^^z~^^, 

B(z)  =  bo  +  biz-^  +  b2Z~^  +  ■■■  +  ^ 

C(z)  =  1  +  +  C2Z~^  +  •••  + 


D(z)  =  1  +  d^z  ^  +  d2Z  ^  +  — h 
F(z)  =  1  +  /iZ“^  +  /2Z“^  +  •••  +  /k^Z“V 
where  /c^,  /c^,  k^,  k^,  and  kf  are  the  model  orders. 

Equation  (17)  represents  the  general- linear  polynomial  model. 
A(z)y(k)  = 


yy  uQi)  +  ^^e(fc)  =  —  n)+  ^^e(fc). 

F(z)  ^  ^  D(z)  ^  ^  F(z)  ^  ^  D(z)  ^  ^ 


u(k) 


(13) 


(17) 


(12) 


(14) 

(15) 

(16) 


Figure  2.8:  Signal  flow  of  a  General-Linear  polynomial  model.  Adapted  from  [99]. 

Schematic  of  the  signal  flow  of  the  general-linear  polynomial  model  is  given  in  Figure  2.8. 
This  model  structure  is  good  for  both  system  and  stochastic  dynamics.  The  estimation  of  the  general- 
linear  model  is  done  using  a  nonlinear  optimization  method.  Nonlinear  optimization  methods  need 
intensive  computations,  and  they  do  not  guarantee  global  convergence  [99]. 

Assigning  one  or  more  of  i4(z),  C(z),  D(z),  andF(z)  equal  to  1  will  result  simpler  models 
such  as  Auto  Regressive  with  exogenous  terms  (ARX),  Auto  Regressive-Moving  Average  with 
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exogenous  terms  (ARMAX),  Output-Error  (OE),  and  Box-Jenkins  (BJ)  models,  whieh  are  suitable  for 
real-world  dynamie  modeling  problems  and  used  very  eommonly  [99]. 

Considering  Equation  (17)  and  setting  C(z),D(z),  and  F(z)  equal  to  1,  the  general-linear 
polynomial  model  gives  an  ARX  model.  Considering  D  (z)  and  F(z)  equal  to  1,  the  general- linear 
polynomial  model  reduees  to  the  ARMAX  model.  Considering  i4(z),  C(z),  and  D(z)  equal  1,  the 
general-linear  polynomial  model  gives  an  Output- Error  (OE)  model.  Considering  A(z)  equals  to  1,  the 
general-linear  polynomial  model  gives  a  Box-Jenkins  (BJ)  model.  Considering  C(z),  D(z),  and  F(z) 
equal  to  1  and  F(z)  equals  to  0,  the  general-linear  polynomial  model  gives  an  Auto  Regressive  (AR) 
model  [99].  In  linear  models,  AR,  ARX,  ARMAX,  OE,  BJ,  and  State-Spaee  models;  in  nonlinear 
models,  nonlinear  ARX  and  nonlinear  Hammer  stein- Wiener  models;  Adaptive  Neuro  Fuzzy  Inferenee 
System  (ANFIS);  Curve  fitting  are  diseussed  in  details  as  used  in  the  later  part  of  this  seetion. 

Prediction  Error  Method  Parameters  Determination 

The  predietion  error  method  is  used  as  an  identifieation  method  for  the  work  done  in  this 
seetion.  Use  of  a  trial-and-error  proeess  is  neeessary  to  determining  the  delay  and  model  order  for  the 
predietion-error  method.  Following  steps  ean  be  used  to  find  a  suitable  model  [99]. 

I.  Observe  the  number  of  resonanee  peaks  in  the  nonparametrie  frequeney  response  funetion  and  find 
some  insight  about  the  model  order.  (The  number  of  peaks  in  the  magnitude  response  equals  half 
the  order  of  i4(z)F(z).) 

II.  Observe  the  impulse  response  or  test  reasonable  values  in  a  medium  sized  ARX  model  and  find 
the  delay  that  provides  the  best  model  fit  based  on  predietion  errors  or  another  eriterion. 

III.  Choose  the  model  order  eorresponding  to  the  best  fit  of  the  various  ARX  models  with  this  delay. 

IV.  “Reduee  the  model  order  by  plotting  the  poles  and  zeros  with  eonfidenee  intervals  and  examining 
potential  eaneellations  of  pole-zero  pairs.  The  resulting  model  might  be  unneeessarily  high  in 
order  beeause  the  ARX  model  deseribes  both  the  system  dynamies  and  noise  properties  with  the 
same  set  of  poles.  The  ARMAX,  Output-Error,  and  Box-Jenkins  models  use  the  resulting  orders  of 
the  poles  and  zeros  as  the  B  and  F  model  parameters  and  the  first-  or  seeond-order  models  for  the 
noise  eharaeteristies  [99].” 

V.  If  a  suitable  model  is  not  seleeted  at  this  stage  then  examine  whether  additional  signals  influenee 
the  output,  whieh  ean  be  ineorporated  as  extra  input  signals. 

If  after  following  previous  steps,  if  a  suitable  model  eannot  be  obtained,  additional  physieal  insight  into 
the  problem  might  be  neeessary.  From  the  predietion  error  standpoint,  the  higher  the  order  of  the 
model,  the  better  the  model  fits  data  beeause  of  the  large  degree  of  freedom.  It  is  wise  to  piek  a  model 
with  smallest  degree  of  freedom  or  number  of  parameters.  Therefore,  the  model-order  assessment 
eriteria  must  rely  on  the  predietion  error  and  at  the  same  time  targets  low  model  order.  There  are  three 
standard  eriteria  for  model-order  estimation  that  is  Akaike's  Information  Criterion  (AIC),  Akaike's 
Final  Predietion  Error  Criterion  (FPE),  and  the  Minimum  Deseription  Eength  Criterion  (MDE). 
Akaike’s  Information  Criterion 

Akaike's  Information  Criterion  (AIC)  is  a  subjeetive  estimation  error.  Equation  (18)  is 
minimized  by  an  optimal  model  order. 

AIC  =  Vr,{l  +  f),  (18) 

where  the  number  of  data  points  are  given  by  A,  an  index  related  to  the  predietion  error  by  l^,  and  the 
number  of  parameters  in  the  model  by  p  [99]. 

Final  Prediction  Error  Criterion 

As  the  name  suggests  Final  Predietion  Error  (FPE)  Criterion  estimates  the  model-fitting  error. 
It  is  used  mainly  during  new  output  predietion  with  the  model  order  [99].  Equation  (19)  is  minimized 
by  an  optimal  model  order. 

Minimum  Description  Length  Criterion 

For  the  Minimum  Deseription  Eength  (MDE)  Criterion,  Equation  (20)  is  minimized  by  an 
optimal  model  order  [99].  Equation  (20)  is  given  below. 

MDL  =  Vn{l+^).  (20) 

The  basis  for  the  MDE  depends  on  and  the  number  of  terms  used. 

Analyzing,  Validating,  and  Converting  Models 

Onee  the  plant  model  is  estimated,  we  ean  analyze  and  observe  its  eharaeteristies.  To  verify 
that  the  model  replieates  the  true  plant  dynamies,  we  need  to  run  validation  tests.  A  linear  system  ean 
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be  expressed  by  different  models,  but  none  of  these  will  yield  a  fit  with  the  dynamies  of  the  real 
system.  “Certain  model  representations  are  more  suitable  for  eertain  analysis  teehniques  [99].” 

2.2  Skeletal-Muscle  Force 


2.2.1  Adaptive  Multi  Sensor  Based  Nonlinear  Identification  of  Skeletal-Muscle  Force 

Skeletal-musele  foree  and  surface  eleetromyographie  (sEMG)  signals  are  elosely  related. 
Henee,  the  later  ean  be  used  for  the  foree  estimation.  Usually,  the  location  for  the  sEMG  sensors  is  near 
the  respective  muscle  motor  unit  points.  EMG  signals  generated  by  skeletal-muscles  are  temporal  and 
spatially  distributed  which  results  in  cross  talk  that  is  recorded  by  different  sEMG  sensors.  This 
research  focuses  on  modeling  muscle  dynamics  in  terms  of  sEMG  signals  and  the  generated  muscle- 
force.  Here,  an  array  of  three  sEMG  sensors  is  used  to  capture  the  information  of  the  muscle  dynamics 
in  terms  of  sEMG  signals  and  generated  muscle-force.  Optimized  nonlinear  Half-Gaussian  Bayesian 
filters  and  a  Chebyshev  Type-II  filter  are  used  for  the  filtration  of  the  sEMG  signals  and  the  muscle- 
force  signal,  respectively.  Genetic  Algorithm  is  used  for  the  optimization  of  the  filter  parameters.  The 
sEMG  and  skeletal-muscle  force  is  modeled  using  multi  nonlinear  Auto  Regressive  exogenous  (ARX) 
and  Hammerstein- Wiener  models  with  different  nonlinearity  estimators/classes  using  System 
Identification  (SI)  for  three  sets  of  sensor  data.  An  adaptive  probabilistic  Kullback  Information 
Criterion  (KIC)  for  model  selection  is  applied  to  obtain  the  fusion  based  skeletal-muscle  force  for  each 
sensor  first  and  then  for  the  final  outputs  from  each  sensor.  The  approach  yields  good  skeletal-muscle 
force  estimates. 

An  EMG  signal  recorded  on  the  surface  of  the  limb  is  expressed  as  an  electric  voltage  ranging 
between  -5  and  +5  mV.  This  method  is  known  as  surface  electromyography  (sEMG).  The  sEMG  is 
utilized  as  an  input  to  the  controller  to  realize  the  movements  of  the  prosthesis  and  force  control  [44], 
[45].  Past  research  results  show  that  EMG  signal  amplitude  generally  increases  with  skeletal-muscle 
force.  However,  this  relationship  is  not  always  rigid;  various  factors  affect  this  relationship.  EMG 
signals  are  a  result  of  the  varying  motor  unit  recruitments,  crosstalk,  and  biochemical  interaction  within 
the  muscular  fibres.  This  makes  EMG  signals  random,  complex  and  dynamic  in  nature  and  the  control 
of  the  prosthesis  difficult.  Moreover,  it  changes  continuously  due  to  the  onset  and  progression  of 
muscle-fatigue  which  results  because  of  continuous  high  frequency  stimulation  or  because  of  titanic 
stimulation  [96].  Synchronization  of  active  motor  units  along  the  muscle  fibres,  and  a  decrease  in 
conduction  velocity  are  reflected  in  the  EMG  signal  as  an  increase  of  amplitude  in  time  domain  and  a 
decrease  of  medium  frequency  in  frequency  domain  [96].  All  these  factors  make  the  relationship 
between  the  EMG  and  force  nonlinear.  Correct  interpretation  of  EMG  signal  is  vital  to  achieve  precise 
motion  and  force  control  of  prosthesis. 

The  present  work  presents  a  novel  approach  to  estimate  skeletal-muscle  force  using  an 
adaptive  multi-sensor  data  fusion  algorithm  with  hybrid  nonlinear  ARX  and  Hammerstein- Wiener 
models  as  summarized  in  Figure  2.9.  Here,  an  array  of  three  sEMG  sensors  is  used  to  capture  the 
information  of  muscle  dynamics  in  terms  of  sEMG  signals.  The  recorded  sEMG  signals  are  filtered 
utilizing  optimized  nonlinear  Half-Gaussian  Bayesian  filter  parameters,  and  the  skeletal-muscle  force 
signal  is  filtered  by  using  a  Chebyshev  Type-II  filter.  A  simple  Genetic  Algorithm  code  is  used  to 
optimize  the  Bayesian  filter  parameters.  Using  an  input/output  approach,  the  EMG  signal  measured  at 
the  skin  surface  is  considered  as  input  to  the  skeletal-muscle,  whereas  the  resulting  hand/finger  force 
constitutes  the  output.  Multi  nonlinear  ARX  and  Hammerstein- Wiener  models  with  different 
nonlinearity  estimators/classes  are  obtained  using  SI  for  three  sets  of  sensor  data  obtained  from  the 
vicinity  of  a  single  motor  unit.  Different  nonlinearity  estimators/classes  are  used  for  nonlinear 
modeling  as  they  capture  the  dynamics  of  the  system  differently.  The  outputs  of  estimated  nonlinear 
models  are  fused  with  a  probabilistic  Kullback  Information  Criterion  (KIC)  for  model  selection  and  an 
adaptive  probability  of  KIC.  First,  the  outputs  are  fused  for  the  same  sensor  and  for  different  models 
and  then  the  final  outputs  from  each  sensor.  The  final  fused  output  of  three  sensors  provides  good 
skeletal-muscle  force  estimates. 
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Figure  2.9:  The  flow  chart  for  skeletal-muscle  force  estimation. 

Figure  2.9  shows  the  flow  chart  for  skeletal-muscle  force  estimation.  This  section  is  structured 
as  follows.  First,  the  experiment  design,  pre-processing  and  filter  parameter  optimization  for  sEMG 
signals  are  discussed.  Second,  nonlinear  ARX  and  Hammer  stein- Wiener  modeling  are  covered.  Third, 
the  fusion  of  various  nonlinear  model  outputs  using  KIC  and  adaptive  probability  of  KIC  is  covered. 
Finally,  the  results,  discussion  and  future  work  are  provided  followed  by  a  conclusion  to  summarize  the 
importance  of  this  work. 

Experiment  Design  and  Pre-Processing 

The  experiment  design  is  shown  in  Figure  2.10.  Both  sEMG  and  muscle-force  signals  are 
acquired  simultaneously  using  EabVIEW™  at  a  sampling  rate  of  2000  Hz.  The  sEMG  data  capturing 
was  aided  by  a  DEESYS®  Bagnoli-16  EMG  system  with  DE-2.1  differential  EMG  sensors.  The 
corresponding  force  data  was  captured  using  Interlink  Electronics  Force  Sensing  Resistor  (FSR)  0.5” 
circular  force  sensor.  One  sEMG  sensor  is  placed  on  the  motor  point  of  the  ring  finger  and  two 
adjacent  to  the  motor  point  of  a  healthy  subject.  Prior  to  placing  the  sEMG  sensors,  the  skin  surface  of 
the  subject  was  prepared  according  to  International  Society  of  Electrophysiology  and  Kinesiology 
(ISEK)  protocols. 
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Figure  2.10:  Experiment  design. 

Aeeording  to  previous  researeh,  the  Bayesian  based  filtering  method  yields  the  most  suitable 
sEMG  signals  [100].  The  nonlinear  filter  signifieantly  reduees  noise  and  extraets  a  signal  that  best 
deseribes  EMG  signals  and  may  permit  effeetive  use  in  prosthetie  eontrol.  An  instantaneous 
eonditional  probability  density  P  (EMG  |x)  provides  the  resulting  EMG  for  the  latent  driving  signal  x 
[100].  The  model  for  the  eonditional  probability  of  the  reetified  EMG  signal  emg  =  |EMG|  is  used  in 
this  eurrent  estimation  algorithm.  EMG  signals  are  usually  deseribed  as  amplitude-modulated  zero 
mean  Gaussian  noise  sequenee  [6].  For  the  reetified  EMG  signal,  the  “Half-Gaussian  measurement 
model”  in  [100]  is  given  by  Equation  21. 

P(emg\x)  =  2  *  exp(— ^^)/(2  *  tt  *  x^)^/^.  (21) 

The  EMG  signal  is  modeled  for  the  eonditional  probability  of  the  reetified  EMG  signal  as  a  filtered 
random  proeess  with  random  rate.  The  likelihood  funetion  for  the  rate  evolves  in  time  aeeording  to  a 
Fokker-Planek  partial  differential  equation  [100].  The  diserete  time  Fokker-Planek  equation  is  given 
by  Equation  22. 

p(x,  t  ^  a  *  p(x  -  t  -  1)  -f  (1  -  2  *  a)  *  p(x,  t  -  1)  +  a  *  p(x  +  a,  t  -  1)  +  ^  +  (1  -  * 

p(x,t-l).  (22) 

Here,  a  and  p  are  two  free  parameters,  a  is  the  expeeted  rate  of  gradual  drift  in  the  signal,  and  p  is  the 
expeeted  rate  of  sudden  shifts  in  the  signal.  The  unknown  driving  signal  x  is  diseretized  into  bins  of 
width  8.  These  two  free  parameters  of  the  non-linear  Half-Gaussian  filter  model  are  optimized  for  the 
aequired  EMG  data  using  elitism  based  GA.  GA  belongs  to  a  elass  of  optimization  algorithms  that  are 
based  on  observing  nature  and  its  eorresponding  proeesses  to  imitate  solving  eomplex  problems,  most 
often  optimization  or  estimation  problems  [101],  [102],  [103].  A  Chebyshev  Type  II  low  pass  filter 
with  a  550  Hz  pass  frequeney  is  used  to  filter  the  foree  signal.  Figs.  2.1 1  (a),  and  (b)  depiet  the  raw  and 
Chebyshev  Type-II  low  pass  filtered  foree  signals.  Figs.  2.12,  2.13  and  2.14  show  the  reetified  EMG 
and  Half-Gaussian  Filtered  EMG  signal  for  three  sensors. 
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(a)  Raw  Skeletal  Muscle  Force  Signal 


Time  (60.35  secs)  xio' 

(b)  Chebyshev  Type  -  n  Filtered  Force  Signal 


Time  (60.35  secs)  xio' 


Figure  2.11:  (a)  Raw  and  (b)  Chebyshev  Type-II  filtered  skeletal-musele  foree  signals. 


Rectified  EMG  for  Motor  Point  Sensor 


Figure  2.12:  Reetified  EMG  and  Half-Gaussian  filtered  EMG  signal  for  motor  point  sensor. 


Figure  2.13:  Reetified  EMG  and  Half-Gaussian  filtered  EMG  signal  for  ringl  sensor. 
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Figure  2.14:  Rectified  EMG  and  Half-Gaussian  filtered  EMG  signal  for  ring2  sensor. 

Nonlinear  ARX  and  Hammerstein-Wiener  Modeling 

In  this  section,  we  are  using  nonlinear  ARX  and  Hammerstein-Wiener  models  with  different 
nonlinearity  estimators/classes  to  model  three  sEMG  sensors  data  as  input  and  skeletal-muscle  force 
data  as  output.  The  nonlinear  ARX  model  uses  a  parallel  combination  of  nonlinear  and  linear  blocks 
[104]. 

Figure  2.15  shows  the  nonlinear  ARX  model  structure.  The  nonlinear  ARX  model  uses 
regressors  as  variables  for  nonlinear  and  linear  functions.  Regressors  are  functions  of  measured  input- 
output  data  [104].  The  predicted  output  y(t)  of  a  nonlinear  model  at  time  t  is  given  by  the  general 
Equation  23 : 

m  =  (23) 

where  x(t)  represents  the  regressors,  F  is  a  nonlinear  regressor  command,  which  is  estimated  by 
nonlinearity  estimators/classes  [104]. 


Figure  2.15:  Structure:  nonlinear  ARX  model. 

As  shown  in  Figure  2.15,  the  command  F  can  include  both  linear  and  nonlinear  functions  ofx(t). 
Equation  24  gives  the  description  of  F. 

F(x)  =  ttfc  K{Pk{x  -  Yk))  (24) 

where  k  is  the  unit  nonlinear  command,  d  is  the  number  of  nonlinearity  units,  and  aj^,  and  are 
the  parameters  of  the  nonlinearity  estimators/classes  [104]. 

The  Hammerstein-Wiener  model  uses  one  or  two  static  nonlinear  blocks  in  series  with  a  linear 
block.  Structural  representation  of  a  nonlinear  Hammerstein-Wiener  is  shown  in  Figure  2.16  [104]. 
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The  general  Equations  (25),  (26),  and  (27)  ean  deseribe  the  Hammerstein- Wiener  strueture 


[104]. 


w(t)  = 

(25) 

(26) 

y(t)  =  h(x(t)). 

(27) 

Here,  u(t)  and  y(t)  are  input  and  output  of  the  system,  respeetively.  /  and  h  are  nonlinear  funetions, 
whieh  eorresponds  to  input  and  output  nonlinearity,  respeetively.  w(t)  and  x(t)  are  internal  variables, 
where  w(t)  has  the  same  dimensions  as  u(t)  and  x(t)  has  the  same  dimensions  as  y(t),  and  5(q)  and 
F(q)  eorresponds  to  the  linear  dynamie  bloek,  as  polynomials  in  the  baekward  shift  operator. 


Input  it(t) 


Output  y(t) 


Figure  2.16:  Strueture:  nonlinear  Hammerstein- Wiener  model. 

The  nonlinearity  elasses  used  in  this  work  are  Wavenet,  Treepartition,  Sigmoidnet,  Pwlinear, 
Saturation,  and  Deadzone.  For  motor  point  and  ringl  sensors,  three  nonlinear  ARX  and  four  nonlinear 
Hammer  stein- Wiener  models  with  different  nonlinearity  estimators/elasses  are  obtained.  For  ring2 
sensor,  three  nonlinear  ARX  and  five  nonlinear  Hammerstein- Wiener  models  with  different 
nonlinearity  estimators/elasses  are  obtained.  Tables  2.2,  2.3  and  2.4  give  the  nonlinearity 
estimators/elasses  for  different  sensors  and  their  eorresponding  model  fit  values. 

Table  2.2:  Different  Nonlinearity  Estimators  and  Model  Fit  Values  for  Motor  Point  Sensor  (WSEAS 

2010) 


S.  No. 

Model 

Nonlinearity  Class 

Model  Fit 

1. 

nlarxl 

Wavenet 

24.78  % 

2. 

nlarx2 

Treepartiton 

40.46  % 

3. 

nlarxS 

Sigmoidnet 

48.75  % 

4. 

nlhw2 

Wavenet 

32.38  % 

5. 

nlhwS 

Pwlinear 

26.27% 

6. 

nlhw4 

Saturation 

55.16% 

7. 

nlhwS 

Deadzone 

42.45  % 

Table  2.3:  Different  Nonlinearity  Estimators  and  Model  Fit  Values  for  Ringl  Sensor  (WSEAS  2010) 


S.No. 

Model 

Nonlinearity  Class 

Model  Fit 

1. 

nlarxS 1 

Wavenet 

-60.76  % 

2. 

nlar x32 

Treepartiton 

-52.64  % 

3. 

nlarxSS 

Sigmoidnet 

-39.36  % 

4. 

nlhwSl 

Pwlinear 

31.06% 

5. 

nlhw32 

Sigmoidnet 

10.05  % 

6. 

nlhwSS 

Saturation 

31.57% 

7. 

nlhwSS 

Wavenet 

32.36% 
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Table  2.4:  Different  Nonlinearity  Estimators  and  Model  Fit  Values  for  Ring2  Sensor  (WSEAS  2010) 


S.No. 

Model 

Nonlinearity  Class 

Model  Fit 

1. 

nlarx2 1 

Wavenet 

-25.12  % 

2. 

nlarx22 

Treepartiton 

-22.31  % 

3. 

nlar x23 

Sigmoidnet 

-33.65  % 

4. 

nlhw21 

Pwlinear 

34.69  % 

5. 

nlhw22 

Sigmoidnet 

34.76  % 

6. 

nlhw23 

Saturation 

33.3  % 

7. 

nlhw24 

Deadzone 

34.94  % 

8. 

nlhw2S 

Wavenet 

34.89  % 

Data  Fusion  and  Adaptive  KIC  Probability 

Data  fusion  of  multiple  outputs  of  nonlinear  ARX  and  Hammer  stein- Wiener  models  is  done 
by  assigning  a  partieular  probability  to  eaeh  individual  model  [105].  First,  the  adaptive  fusion 
algorithm  is  applied  to  the  outputs  of  different  nonlinear  ARX  and  Hammer  stein- Wiener  models  for 
eaeh  sensor  obtained  using  different  nonlinearity  estimators.  Seeond,  the  adaptive  fusion  algorithm  is 
again  applied  to  the  final  fusion  based  outputs  of  eaeh  sensor;  this  gives  good  foree  estimate.  SI  model 

[IF— r|l 

1  —  *  100.  The  model  seleetion 

eriterion  used  is  KIC.  The  sum  of  two  direeted  divergenees,  whieh  is  the  measure  of  the  models 
dissimilarity,  is  known  as  Kullbaek’s  symmetrie  or  J-divergenee  [106],  as  given  by  Equation  28. 

KIC(pt)  =  ^\ogRi  +  -  nip  +  gin).  (28) 

where g(ji)  =  n*  log(n/2). 

The  following  adaptive  fusion  algorithm  given  by  [105]  is  applied  for  data  fusion  of  the 
outputs  of  different  nonlinear  ARX  and  Hammer  stein- Wiener  models: 


1) 


2) 


Identify  models  M^,  M2,  using  sEMG  data  (u)  as  input  and  foree  data  (T)  as  output,  for  k 

number  of  sensors  eolleeting  data  simultaneously. 

Compute  the  residual  square  norm  =  \\Y  —  Oj0j||  =  ||T  —  f  ||, 


where  Qi  =  J  and  O 
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3) 

4) 


Caleulate  the  model  eriteria  eoeffieient  using  Equation  28. 


ul 


77^ 

^n—p-i 


Compute  the  model  probability  p(Mi\Z)  = 


where  I  is  model  seleetion  eriterion,  i.e. 


KlCipt). 

5)  Compute  the  data  fusion  based  model  output  Yf  =  Xf=i  p(Mj |Z)?j. 

Here  all  the  eomputation  from  step  2)  to  5)  is  adaptive  i.e.  the  residual  square  norm,  KIC(pi),  model 
probability p(Mj I Z),  and  fused  model  output!^  are  being  updated  with  time  or  for  eaeh  data  point. 
Figure  2.17  shows  the  flow  ehart  for  fusion  of  outputs  and  adaptive  probability  of  KIC. 
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Figure  2.17:  Data  fusion  and  adaptive  KIC  probability. 

Results,  Discussion,  and  Future  Work 

This  section  deals  with  the  results,  discussion  and  future  work.  The  following  plots  show  the 
nonlinear  (ARX  and  Hammerstein- Wiener)  model  and  adaptive  fusion  algorithm  based  estimated  force 
output  for  each  sensor  first  and  then  finally  combined  adaptive  fusion  based  output  for  all  three 
sensors.  Figure  2.18  shows  the  overlapping  plot  of  the  original  and  adaptive  fusion  based  force  output 
for  the  motor  point  sensor.  The  output  is  the  result  of  the  adaptive  fusion  algorithm  on  three  nonlinear 
ARX  and  four  nonlinear  Hammer  stein- Wiener  models  for  the  motor  point  sensor  signal. 


Original  Force  and  NL-ARX  -  NL-HW-2-3-4-5  Models  Fused  Output  -  Sensor  Motor  Point 


Figure  2.18:  Measured  vs.  adaptive  data  fusion  based  output  for  motor  point  sensor. 

Figure  2.19  shows  the  overlapping  plot  of  the  original  and  adaptive  fusion  based  force  output 
for  ringl  sensor.  This  output  is  the  result  of  adaptive  fusion  algorithm  of  three  nonlinear  ARX  and  four 
nonlinear  Hammerstein- Wiener  models  for  ringl  sensor  signal. 
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Original  Force  and  NL-ARX  -  NL-HW  -  Models  Fused  Foree  Output  -  Ringl  Sensor 


Figure  2.19:  Measured  vs.  adaptive  data  fusion  based  output  for  ringl  sensor. 


Original  Foree  and  NL-ARX  -  NI^HW  Models  Fused  Output  -  Ring2  Sensor 


Figure  2.20:  Measured  vs.  adaptive  data  fusion  based  output  for  ring2  sensor. 

Figure  2.20  shows  the  overlapping  plot  of  the  original  and  adaptive  fusion  based  foree  output 
for  ring2  sensor.  This  output  is  the  result  of  adaptive  fusion  algorithm  on  three  nonlinear  ARX  and  five 
nonlinear  Hammerstein- Wiener  models  for  ring2  sensor  signal. 


Original  Force  and  NI^ARX  -  NL-HW  Models  Output  -  MotorPoint  -  Ringl  -  Ring2  Sensors 


Figure  2.21:  Final  plot  -  measured  vs.  adaptive  data  fusion  based  output  for  all  three  sensors. 

Figure  2.21  shows  the  overlapping  plot  of  the  original  and  final  eombined  adaptive  fusion 
based  foree  output  for  motor  point,  ringl  and  ring2  sensors.  The  output  is  the  result  of  adaptive  fusion 
algorithm  on  the  final  outputs  of  three  sensors  i.e.  motor  point,  ringl  and  ring2  as  shown  in  Figs.  24  to 
26.  Also,  Figure  2.21  shows  the  best  skeletal-musele  foree  estimate,  whieh  is  the  result  of  the  multi 
nonlinear  ARX  and  Hammerstein- Wiener  models  and  an  adaptive  hybrid  data  fusion  on  these 
nonlinear  models.  Figure  2.22  shows  the  error  plot  of  the  original  and  best-estimated  model  output  for 
the  motor  point  sensor.  Figure  2.23  shows  the  error  plot  of  original  and  final  multi  nonlinear  modeled 
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and  adaptive  hybrid  data  fusion  based  foree  estimate  (results  from  three  sensors,  nonlinear  modeling 
and  adaptive  data  fusion  algorithm).  If  we  eompare  Figs.  28  and  29,  it  is  very  elear  and  eonspieuous 
that  the  error  has  deereased  remarkably  and  is  very  elose  to  zero. 

Error  Plot  -  Original  and  Best  Model  Simulated  Output  for  Motor  Point  Sensor 


Figure  2.22:  Error  plot  -  measured  vs.  best-estimated  model  output  for  motor  point  sensor. 


Final  Error  Plot  -  Original  and  Fused  Output  -  MotorPoint.  Ringl  andRing2  Sensors 


Figure  2.23:  Final  error  plot  -  measured  vs.  adaptive  data  fusion  based  output  for  motor  point,  ringl 

and  ring2  sensors. 

Future  work  will  foeus  on  the  improvement  of  the  data  eolleetion  teehniques  and  experiment 
design.  By  using  the  eombination  of  linear  and  nonlinear  modeling,  and  adaptive  hybrid  data  fusion, 
the  skeletal-musele  foree  estimate  ean  be  improved  further.  Furthermore,  the  authors  believe  that  by 
using  different  model  seleetion  eriteria  sueh  as  Akaike  Information  Criterion  (AIC),  Kullbaek 
Information  Criterion  (KIC)  and  the  Bayesian  Information  Criterion  (BIC)  together  to  obtain  final 
skeletal-musele  foree  estimate  will  give  improved  results. 

sEMG  and  foree  data  aequired  using  three  EMG  and  one  eommon  FSR  foree  sensor  is 
modeled  using  nonlinear  SI.  Using  different  nonlinearity  estimators/elasses,  multi  nonlinear  ARX  and 
Hammerstein- Wiener  models  are  obtained  for  eaeh  sensor.  First,  the  outputs  of  different  models  for 
eaeh  sensor  are  fused  with  a  data  fusion  algorithm  and  an  adaptive  KIC  probability.  Finally,  the  fused 
outputs  from  eaeh  sensor  are  again  fused  with  same  algorithm  and  adaptive  KIC  probability.  The  final 
estimated  foree  using  this  teehnique  gives  the  best  estimate.  The  presented  approaeh  ean  be  utilized  for 
eontrolling  prosthetie  hands  [107]. 


2.2.2  A  Hybrid  Adaptive  Data  Fusion  with  Linear  and  Nonlinear  Models  for  Skeletal-Muscle 

Force  Estimation 


Position  and  foree  eontrol  are  two  eritieal  aspeets  of  prosthetie  eontrol.  Surfaee 
eleetromyographie  (sEMG)  signals  ean  be  used  for  skeletal-musele  foree  estimation.  In  this  seetion, 
skeletal-musele  is  eonsidered  as  a  system  and  System  Identifieation  (SI)  is  used  to  model  sEMG  and 
skeletal-musele  foree.  The  reeorded  sEMG  signal  is  filtered  utilizing  optimized  nonlinear  Half- 
Gaussian  Bayesian  filter,  and  a  Chebyshev  Type-II  filter  prepares  the  musele-foree  signal.  The  filter 
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optimization  is  accomplished  using  Genetic  Algorithm  (GA).  Multi-  linear  and  nonlinear  models  are 
obtained  with  sEMG  as  input  and  skeletal-musele  foree  of  a  human  hand  as  an  output.  The  outputs  of 
these  models  are  fused  with  a  probabilistie  Kuhbaek  Information  Criterion  (KIC)  for  model  seleetion 
and  an  adaptive  probability  of  KIC.  This  approaeh  gives  good  estimate  of  the  skeletal-musele  foree. 

The  present  work  presents  a  novel  approaeh  to  estimate  skeletal-musele  foree  using  an 
adaptive  data  fusion  algorithm  with  hybrid  multi  linear  and  nonlinear  models  as  shown  in  Figure  2.24. 
The  reeorded  sEMG  signals  are  filtered  utilizing  Genetie  Algorithm  (GA)  based  optimized  nonlinear 
Half-Gaussian  Bayesian  filter  parameters,  and  the  skeletal-musele  foree  signal  is  filtered  by  using  a 
Chebyshev  Type-II  filter.  Using  an  input/output  approaeh,  the  EMG  signal  measured  at  the  skin  surfaee 
is  eonsidered  as  input  to  the  skeletal-musele,  whereas  the  resulting  hand/finger  foree  eonstitutes  the 
output. 


Figure  2.24:  Flow  ehart  for  estimation  of  skeletal-musele  foree  using  an  adaptive  data  fusion 

algorithm. 

Multi  linear  and  nonlinear  models  are  obtained  using  System  Identifieation  (SI)  for  the  motor 
point  signals  as  they  eapture  the  dynamies  of  the  system  differently.  The  outputs  of  estimated  linear 
and  nonlinear  models  are  fused  with  a  probabilistie  Kuhbaek  Information  Criterion  (KIC)  for  model 
seleetion  and  an  adaptive  probability  of  KIC.  First,  the  outputs  are  fused  for  the  linear  models  and  then 
for  nonlinear  models  and  finally  the  resultant  outputs  of  linear  and  nonlinear  models  are  fused  together. 
The  final  fused  output  of  different  linear  and  nonlinear  models  results  in  good  skeletal-musele  foree 
estimates. 

Experiment  Design  and  Pre-Processing 

Experiment  design  and  signal  preproeessing  is  diseussed  in  the  ‘Experiment  Design  and  Pre- 
Proeessing’  seetion  of  ‘Adaptive  Multi  Sensor  Based  Nonlinear  Identifieation  of  Skeletal-musele 
Foree’  in  ‘Chapter  2:  Skeletal-musele  Foree.’  Please  refer  to  Figure  2.10  in  this  seetion. 

System  Identitication  -  Linear  and  Non-Linear  Modeling 

System  Identifieation  (SI)  is  based  on  the  aequired  experimental  data  and  is  an  alternative  to 
physieahy  based  mathematieal  modeling  [110].  A  dynamieal  model  sueh  as  the  Auto  Regressive  with 
exogenous  input  (ARX)  or  Output  Error  (OE)  gives  the  system  in  mathematieal  form  whieh  is  the 
outeome  of  parametrie  SI  proeess.  In  this  work,  the  SI  approaeh  is  used  with  the  myoleleetrie  signal  as 
the  input  to  the  system  and  as  the  output  is  the  intended  finger/hand  foree.  In  this  work,  mutli-  linear 
and  nonlinear  y(t)u(t  —  nk)e(t)  models  are  obtained  for  modeling  of  EMG  and  hand/finger  foree 
signals.  Six  linear  and  three  nonlinear  models  are  obtained  for  the  motor  point  sEMG  signal. 

For  the  linear  models  Output  Error  model  of  order  6,  ARX  model  of  order  6,  ARM  AX  model 
of  model  order  5,  Box- Jenkins  model  of  order  18,  State-Spaee  model  with  subspaee  method  of  order  12 
and  a  State-Spaee  model  with  predietion  error/maximum  likelihood  method  of  order  12  are  obtained 
using  SI  as  given  in  Table  2.5.  In  Table  2.5  y  is  output,  t  is  time,  B(q),  F(q),  A(q),  C(q),  D(q),  are 
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polynomials,  g  is  a  backward  shift  operator,  u  is  input,  is  delay  and  e  is  error  [104].  For  State-Spaee 
models:-  x  is  state,  t  is  time,  75  is  sampling  time,  u  is  input,  e  is  error,  A,B,K,  C,  and  D  are  system 
matriees,  and  y  is  output  [104]. 

In  eontrary  to  six  linear  models  as  given  in  Table  2.5,  nonlinear  ARX  with  nonlinearity 
estimator  as  ‘sigmoidnet’  and  nonlinear  Hammer  stein- Wiener  models  with  nonlinearity  estimators  as 
‘pieeewise  linear  -  pwlinear’  and  ‘saturation’  are  obtained,  as  given  in  Table  2.6. 


Table  2.5:  Linear  Models  and  Their  Struetures  (CIBEC  2010) 


Linear  Model  Name 

Linear  Model  Strueture 

Output  Error 

y(0  =  u(t  nfc)  +  e(t) 

ARX 

^(q)y(t)  =  B{q)u{t  -  rifc)  +  e(t) 

ARM  AX 

A(q)y(t)  =  B{q)u(t  -  n^)  +  C(q)e(t) 

Box- Jenkins 

State-Spaee  - 
subspaee  method 

x(t  +  Ts)  =  Ax(t)  +  Bu(t)  +  Ke(t) 
y(t)  =  Cx(t)  +  Du(t)  +  e(t) 

State-Spaee  - 
predietion 
error/ maximum 
likelihood  method 

x(t  +  Ts)  =  Ax(t)  +  Bu(t)  +  Ke(t) 
y(t)  =  Cx(t)  +  Du(t)  +  e(t) 

Table  2.6:  Nonlinear  Models  and  Their  Struetures  (CIBEC  2010) 

Nonlinear  Model  Name 

Nonlinear  Model  Strueture 

Nonlinear  ARX  -  Sigmoidnet 

yp(0  =  /(y(t  - 1).  y(t  -  2),  y(t  -  3), ... ,  u(t  - 

l),u(t  —  2), ... );  /(z)  =  is  sigmoid  funetion. 

Nonlinear  HW  -  Pieeewise  Einear  - 
pwlinear 

w(t)  =  /(w(t)),  x(t)  =  wit),  y{t)  = 

Nonlinear  HW  -  Saturation 

wit)  =  f(u(t)),  x(t)  =  w(t),  y(t)  =  h(x(t)); 

In  Table  2.6  /  is  a  nonlinear  funetion  for  the  nonlinear  ARX  model.  Inputs  to  /  are  model 
regressors.  yp(t)  is  the  predieted  output  as  a  weighted  sum  of  past  output  values  and  eurrent  and  past 
input  values.  For  the  nonlinear  Hammer  stein- Wiener  model  u(t)  and  y(t)  are  the  inputs  and  outputs 
for  the  system,  respeetively.  /  and  h  are  nonlinear  funetions  that  eorresponds  to  the  input  and  output 
nonlinearity,  respeetively.  w(t)  andx(t)  are  internal  variables.  w(t)  has  the  same  dimension  as  u(t). 
x(t)  has  the  same  dimension  as  y(t).  B(q)  and  F(q)  in  the  linear  dynamie  bloek  are  polynomials  in 
the  baekward  shift  operator.  If  only  the  input  nonlinearity  is  present,  the  model  is  ealled  the 
Hammerstein  model.  If  only  the  output  nonlinearity  is  present,  the  model  is  ealled  the  Wiener  model 
[104]. 
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Fusion  of  Outputs  and  Adaptive  Probability  of  KIC 

Fusion  of  outputs  is  achieved  with  an  adaptive  probability  of  KIC,  as  given  in  the  subseetion 
‘DATA  FUSION  AND  ADAPTIVE  KIC  PROBABILITY,’  of  the  previous  seetion  ‘ADAPTIVE 
MULTI  SENSOR  BASED  NONLINEAR  IDENTIFICATION  OF  SKELETAL-MUSCLE  FORCE’  of 
this  ehapter. 

Results,  Conclusion,  and  Future  Work 

Adaptive  KIC  probability  based  data  fusion  algorithm  is  applied  to  linear  and  nonlinear 
models  separately  and  then  eombined.  Figs.  2.25  and  2.26  show  the  results  for  the  linear  and  nonlinear 
models  respeetively.  Finally,  both  linear  and  nonlinear  models  are  eombined  and  adaptive  KIC 
probability  based  data  fusion  algorithm  is  applied  to  obtain  the  final  output  that  is  given  by  Figure  2.27. 
Validation  of  this  teehnique  is  eonfirmed  with  a  separate  data  set.  Figure  2.28  depiets  the  validation  of 
the  proposed  teehnique.  Future  work  will  foeus  on  the  improved  data  eolleetion  teehniques,  use  of 
spatial  filters  for  sEMG  signals  filtration,  and  use  of  multi  sensor  data  with  this  teehnique. 


KIC  Adaptive  Probability -Data  Fusion  Based  Force -Linear  Models  and  Chebyshev  Filtered  Force  Signal 


2  4  6  8  10  12 


Time  (60  Seconds  Data)  xio^ 

Figure  2.25:  For  linear  models:  KIC  adaptive  probability  data  fusion  based  foree  vs.  Chebyshev  Type 

II  filtered  foree. 

KIC  Adaptive  Probability -Data  Fusion  Based  Force -NL  Models  and  Chebyshev  Filtered  Force  Signal 


2  4  6  8  10  12 


Time  (60  Seconds  Data)  x 

Figure  2.26:  For  nonlinear  models:  KIC  adaptive  probability  data  fusion  based  foree  vs.  Chebyshev 

Type  II  filtered  foree. 
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KIC  Adaptive  Probability  and  Linear  -  Nonlinear  Data  Fusion  Based  Foree  Vs.  Chebyshev  Filtered  Foree  Signal 


Time  (60.32  Seconds  Data)  x  io^ 


Figure  2.27:  For  linear  and  nonlinear  models  eombined:  KIC  adaptive  probability  data  fusion  based 

foree  vs.  Chebyshev  Type  II  filtered  foree. 


Validation  Plot  -  Measured  Output  Vs.  Estimated  Fused  Output  With  Adaptive  Probability 


Figure  2.28:  Validation  plot  -  for  linear  and  nonlinear  models  eombined:  KIC  adaptive  probability  data 
fusion  based  foree  vs.  Chebyshev  Type  II  filtered  foree. 


2.2.3  A  Hybrid  Adaptive  Multi  Sensor  Data  Fusion  for  Estimation  of  Skeletal-Muscle  Force  for 

Prosthetic  Hand  Control 


Effective  use  of  upper-extremity  prostheses  depends  on  the  two  eritieal  aspects  of  precise 
position  and  force  control.  Surface  electromyographic  (sEMG)  signals  can  be  used  as  a  control  input 
for  the  position  and  force  actions  related  to  the  prosthesis.  In  this  section,  we  use  the  measured  sEMG 
signals  to  estimate  skeletal-muscle  force.  Further,  we  consider  skeletal-muscle  as  a  system  and  System 
Identification  (SI)  is  used  to  model  multi-sensor  sEMG  and  skeletal-muscle  force.  The  sEMG  signals 
are  filtered  utilizing  optimized  nonlinear  Half-Gaussian  Bayesian  filter,  and  a  Chebyshev  Type-II  filter 
provides  the  muscle-force  signal.  The  filter  optimization  is  accomplished  using  a  Genetic  Algorithm 
(GA).  Multi-  linear  and  nonlinear  models  are  obtained  with  sEMG  data  as  input  and  skeletal-muscle 
force  of  a  healthy  human  hand  as  an  output  for  three  sensors.  The  outputs  of  these  models  for  three 
sensors  are  fused  with  a  probabilistic  Kullback  Information  Criterion  (KIC)  for  model  selection  and  an 
adaptive  probability  of  KIC.  The  final  fusion  based  force  for  multi-sensor  sEMG  gives  improved 
estimate  of  the  skeletal-muscle  force. 

The  present  work  is  an  extension  of  our  previous  work  [111]  where  we  proposed  estimation  of 
the  skeletal-muscle  force  using  an  adaptive  data  fusion  algorithm  with  hybrid  multi  linear  and 
nonlinear  models.  In  [111]  the  sEMG  data  was  based  only  from  measuring  the  motor  point  sEMG 
signal,  whereas  in  the  present  work  we  extend  this  to  three  sensors  for  the  ring  finger  of  the  dominant 
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hand  of  a  healthy  male  subjeet.  Figure  2.29  presents  the  flow  ehart  of  the  work  done  in  this  seetion. 
The  sEMG  signals  are  aequired  from  the  forearm  of  a  healthy  subjeet  and  filtered  utilizing  Genetie 
Algorithm  (GA)  based  optimized  nonlinear  Half-Gaussian  Bayesian  filter.  On  the  other  hand,  the 
skeletal-musele  foree  signal  is  filtered  using  a  Chebyshev  Type-II  filter.  The  sEMG  is  eonsidered  as 
input  whereas  foree  signal  is  eonsidered  as  an  output.  Sinee  eaeh  model  eaptures  the  dynamies 
differently,  we  obtained  multiple  linear  and  nonlinear  models  using  System  Identifieation  (SI)  for  the 
sEMG  data  eorresponding  to  the  three  sensors.  First,  the  outputs  of  all  the  linear  and  nonlinear  models 
from  the  three  sensors  are  fused  separately  and  then  the  resultant  three  outputs  are  fused  with  a 
probabilistie  Kullbaek  Information  Criterion  (KIC)  for  model  seleetion  and  an  adaptive  probability  of 
KIC.  The  final  fused  output  using  this  approaeh  gives  improved  skeletal-musele  foree  estimates. 


Figure  2.29:  Flow  ehart  for  estimation  of  skeletal-musele  foree  using  an  adaptive  data  fusion 

algorithm. 


Experiment  Design  and  Pre-Processing 

Experiment  design  and  signal  preproeessing  is  diseussed  in  the  ‘Experiment  Design  and  Pre- 
Proeessing’  seetion  of  ‘Adaptive  Multi  Sensor  Based  Nonlinear  Identifieation  of  Skeletal-Musele 
Foree’  in  ‘Chapter  2:  Skeletal-Musele  Foree.’  Please  refer  to  Figure  2.10  in  this  seetion. 

System  Identification  -  Linear  and  Nonlinear  Modeling 

A  system  ean  be  modeled  either  by  using  physies  based  mathematieal  models  or  by  System 
Identifieation  (SI)  [110].  Parametrie  SI  gives  a  dynamie  model  sueh  as  the  Auto  Regressive  with 
exogenous  input  (ARX)  or  Output  Error  (OE)  of  the  system  in  mathematieal  form.  In  this  researeh,  we 
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use  the  SI  approaeh  to  model  the  two  signals.  The  sEMG  is  the  input  to  the  system  and  the  intended 
finger/hand  foree  is  output.  In  this  work,  mutli-  linear  and  nonlinear  y(t)u(t  —  nk)e(t)  models  are 
obtained  for  modeling  of  sEMG  and  hand/finger  foree  signals  for  three  sensors  for  the  ring  finger  of 
the  dominant  hand  of  a  healthy  subjeet.  Six  linear  and  three  nonlinear  models  are  obtained  for  the 
motor  point  sEMG  signal,  three  linear  and  five  nonlinear  models  are  obtained  for  the  ringl  sensor,  and 
six  linear  and  five  nonlinear  models  are  obtained  for  ring2  sensor  data.  Table  2.7  and  VIII  give  the 
struetures  of  linear  and  nonlinear  models  respeetively. 

The  model  order  of  the  various  models  used  in  this  work  are  as  follows:  linear  models  for  the 
motor  point  data,  OE  model  of  order  6,  ARX  model  of  order  6,  ARMAX  model  of  model  order  5,  Box- 
Jenkins  (BJ)  model  of  order  18,  State-Spaee  model  with  subspaee  method  (N4SID)  of  order  12  and  a 
State-Spaee  model  with  predietion  error/maximum  likelihood  method  (PEM)  of  order  12  are  obtained 
using  SI.  For  ringl  sensor  (sensor  adjaeent  to  the  motor  point  sensor)  data  OE  model  of  order  17, 
ARMAX  model  of  order  35  and  BJ  model  of  order  11  are  obtained.  For  ring2  sensor  (sensor  on 
opposite  side  of  ringl  sensor)  data  OE  model  of  order  45,  ARX  model  of  order  12,  ARMAX  model  of 
order  17,  BJ  model  of  order  14,  N4SID  model  of  order  13  and  PEM  model  of  order  22  are  obtained. 
Table  2.7  gives  the  strueture  of  all  the  linear  models.  In  Table  2.7  y  is  output,  t  is  time,  B(q),  F(q), 
A(q),  C(q),  D(q),  are  polynomials,  g  is  a  baekward  shift  operator,  u  is  input,  is  delay  and  e  is 
error  [104].  For  State-Spaee  models:-  x  is  state,  t  is  time,  Ts  is  sampling  time,  u  is  input,  e  is  error, 
A,  B,  K,  C,  and  D  are  system  matriees,  and  y  is  output  [104]. 

Table  2.8  gives  the  struetures  of  nonlinear  models.  The  nonlinear  models  for  the  motor  point 
data  are  obtained  as,  the  nonlinear  ARX  with  a  sigmoidnet  nonlinearity  estimator,  nonlinear 
Hammer  stein- Wiener  models  with  a  pieeewise  linear  nonlinearity  estimator,  and  a  saturation  based 
estimator.  For  eaeh  ringl  and  ring2  signal  data  sets,  five  nonlinear  Hammer  stein- Wiener  models  with 
nonlinearity  estimators  as  ‘pieeewise  linear  -  pwlinear,’  ‘sigmoidnet,’  ‘saturation,’  ‘deadzone,’  and 
wavelet  network’  are  obtained. 

In  Table  2.8  /  is  a  nonlinear  funetion  for  the  nonlinear  ARX  model.  Inputs  to  /  are  model 
regressors.  yp(t)  is  the  predieted  output  as  a  weighted  sum  of  past  output  values  and  eurrent  and  past 
input  values.  For  the  nonlinear  Hammer  stein- Wiener  model  u(t)  and  y(t)  are  the  inputs  and  outputs 
for  the  system,  respeetively.  /  and  h  are  nonlinear  funetions  that  eorresponds  to  the  input  and  output 
nonlinearity,  respeetively.  w(t)  andx(t)  are  internal  variables.  w(t)  has  the  same  dimension  as  u(t). 
x(t)  has  the  same  dimension  as  y(t).  B(q)  and  F(q)  in  the  linear  dynamie  bloek  are  polynomials  in 
the  baekward  shift  operator. 

For  nonlinear  Hammerstein- Weiner  model  with  deadzone  nonlinearity  estimator,  F  is  a 
nonlinear  funetion  of  x  with  the  properties  given  in  the  Table  2.8.  For  nonlinear  Hammerstein- Weiner 
model  with  wavelet  network  as  nonlinearity  estimator,  k(s)  as  a  wavelet  funetion,  and  is  a  row 
veetor  sueh  that  //c(x  —  y/^)  is  a  sealar.  If  only  the  input  nonlinearity  is  present,  the  model  is  ealled  the 
Hammerstein  model.  If  only  the  output  nonlinearity  is  present,  the  model  is  ealled  the  Wiener  model 
[104]. 


_ Table  2.7:  Einear  Models  and  Their  Struetures  (ICAI  2011) _ 

Einear  Model  Name  Einear  Model  Strueture 


Output  Error 

y(0  =  u(t  Uk)  +  e{t) 

ARX 

A(q)y(t)  =  B(q)u(t  -  Uk)  +  e(t) 

ARMAX 

A(.q)y(t)  =  B{q)u{t-nk) 

+  Ciq)e(t) 

Box- Jenkins 
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State- space  -  subspace  method 


x(t  +  Ts)  =  Ax(t)  +  Bu(t) 

Ke(t^ 

y(t)  =  Cx(t)  +  Du(t)  +  e(t) 


State-Space  -  prediction  error/maximum  likelihood  x(t  +  Ts)  =  Ax(t)  +  Bu(t) 

method  +  Ke(t) 

y(t)  =  Cx(t)  +  Du(t)  +  e(t) 


Table  2.8:  Nonlinear  Models  and  Their  Structures  [ICAl  2011) 


Nonlinear  Model  Name 

Nonlinear  ARX  -  Sigmoidnet 

Nonlinear  HW  -  Piecewise  Linear  - 
pwlinear 

Nonlinear  HW  -  Sigmoidnet 

Nonlinear  HW  -  Saturation 

Nonlinear  HW  -  Deadzone 

Nonlinear  HW  -  Wavelet  Network 


Nonlinear  Model  Structure 


yp(t)  =  f(y(t  -  i),y(t  -  2),y(t  - 
3), ... ,  u{t  —  1),  u(t  —  2), ... ); 

/(z)  =  is  sigmoid  function. 

w(t)  =  f{u(t)),  x{t)  = 
y(t)  =  /i(x(t)); 

yp(t)  =  /(y(t  -  i).y(t  -  2),y(t  - 
3), ... ,  u{t  —  1),  u(t  —  2), ... ); 
f{z)  =  is  sigmoid  function. 

IVCO  =  /(u(t)),  x(t}  = 

y(t)  =  h(xm 

y  =  F(x);  a  <  X  <  b,  F(x)  =  0 
X  <  a,  F(x)  =  X  —  a 
X  >  b,  F(x)  =  X  —  b 
gix)  =  Y.k=i  a-kKiPkix  -  yfc)) 


Adaptive  Data  Fusion  Algorithm 

Fusion  of  outputs  for  different  linear  and  nonlinear  models  is  achieved  with  an  adaptive 
probability  of  KIC,  as  given  in  the  subsection  ‘DATA  FUSION  AND  ADAPTIVE  KIC 
PROBABILITY,’  of  the  previous  section  ‘ADAPTIVE  MUETI  SENSOR  BASED  NONEINEAR 
IDENTIFICATION  OF  SKEEETAE-MUSCEE  FORCE’  of  this  chapter. 
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Figure  2.30:  Adaptive  KIC  probability  based  data  fusion. 


In  this  researeh  work,  we  are  obtaining  multi-  linear  and  nonlinear  models  using  SI  for  the 
sEMG  sensor  for  the  ring  finger  motor  unit,  and  two  adjaeently  plaeed  sensors,  ringl  and  ring2.  The 
fusion  of  outputs  and  adaptive  KIC  probability  is  shown  in  Figure  2.30,  whieh  is  followed  by  the 
adaptive  data  fusion  algorithm. 

Results  and  Discussion 

An  adaptive  KIC  probability  based  data  fusion  algorithm  is  applied  to  linear  and  nonlinear 
models  separately  for  the  models  obtained  using  three  sets  of  input  and  output  data  for  three  sEMG 
sensors.  First  the  fusion  based  output  for  eaeh  sensor  is  obtained  and  then  the  three  fusion  based 
outputs  from  three  sEMG  sensors  are  fused  to  get  the  improved  estimates  of  the  skeletal-musele  foree. 
The  following  plots  show  the  improvement  in  the  foree  estimates  in  sueeession  with  different  sensors 
separately  and  then  eombined.  All  the  plots  have  the  measured  skeletal-musele  foree  signal  in  green 
and  the  estimated  foree  signal  in  red  eolor. 


Chebyshev  Type  II  Filtered  Vs.  Linear-NL  Models  -  Adaptive  KIC  Probability  -  Ringl 


2  4  6  8  10  12 

Time  (60  Seeonds)  xio^ 


Figure  2.31:  Chebyshev  Type  II  vs.  adaptive  KIC  probability  based  foree  from  linear  and  nonlinear 

models  for  ringl  sensor. 
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Figure  2.31  is  a  plot  of  measured  and  Chebyshev  Type  II  filtered  finger  foree  data  with  the 
adaptive  KIC  probability  fusion  based  foree  for  the  first  sensor  named  as  ringl.  The  two  signals  are 
very  elear  and  the  estimated  signal  shows  good  follow  up  of  the  measured  signal.  Figure  2.32  and  2.33 
show  the  measured  and  Chebyshev  Type  II  filtered  skeletal-musele  foree  with  the  adaptive  KIC 
probability  fusion  based  foree  signals  for  the  seeond  sensor  named  as  ring2,  and  motor  point  sensor.  It 
is  evident  to  us  that  the  measured  signal  has  a  very  elose  follow  up  by  the  estimated  signal. 


Chebyshev  Type  II  Filtered  Vs.  Linear-NL  Models  -  Adaptive  KIC  Probability  -  Ring2 


Time  (60  Seeonds)  x  10^ 

Figure  2.32:  Chebyshev  Type  II  vs.  adaptive  KIC  probability  based  foree  from  linear  and  nonlinear 

models  for  ring2  sensor. 


Chebyshev  Type  II  Filtered  Vs.  Motor  Point  -  Linear-NL  Models  -  Adaptive  KIC  Probability 


Figure  2.33:  Chebyshev  Type  II  vs.  adaptive  KIC  probability  based  foree  from  linear  and  nonlinear 

models  for  motor  point  sensor. 
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Chebyshev  Type  II  Filtered  Vs.  Ringl-Ring2-MotorPoint  -  Linear-NL  Models  -  Adaptive  KIC  Probability 


Time  ( 60  Seeonds)  x  io^ 

Figure  2.34:  Chebyshev  Type  II  vs.  adaptive  KIC  probability  based  foree  from  linear  and  nonlinear 
models  for  ringl,  ring2  and  motor  point  sensor  eombined. 

Finally  the  estimated  skeletal-musele  foree  from  three  sEMG  sensors  is  further  fused  with 
adaptive  KIC  probability  based  data  fusion  algorithm.  Figure  2.34  shows  the  eomparison  of  the 
measured  and  Chebyshev  Type  II  filter  with  the  final  adaptive  KIC  probability  based  fusion  skeletal- 
musele  foree  estimate  using  three  sEMG  sensors.  The  final  result  for  three  sensors  is  the  best  estimate 
of  skeletal-musele  foree  and  it  is  evident  to  us  that  the  measured  signal  has  a  very  elose  follow  up  by 
the  estimated  signal. 

The  results  show  that  there  is  a  deerease  in  the  pereentage  error  from  the  linear  and  nonlinear 
models  adaptive  fusion  based  separate  outputs  to  the  adaptive  fusion  based  eombined  output  of  linear 
and  nonlinear  models  eombined  for  all  three  sensors.  However,  these  results  show  that  there  is  a  16% 
improvement  in  the  mean  fit  value  of  the  motor  point  signal  models  with  the  adaptive  KIC  probability 
based  data  fusion  algorithm  for  multi-sensors  (three  in  this  ease).  Figure  2.35  and  2.36  show  the 
validation  plots  of  this  approaeh  for  two  separate  sets  of  sEMG  and  skeletal-musele  foree  data,  where 
green  signal  is  the  Chebyshev  Type  II  filtered  measured  foree  signal  and  the  blue  signal  is  estimated 
using  this  approaeh. 


Validation  Plot  -  Separate  Experiment  Data  1 


Figure  2.35:  Validation  plot  1  -  Chebyshev  Type  II  vs.  estimated  foree  signal  using  adaptive  KIC 

probability. 
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Validation  Plot  -  Separate  Experiment  Data  2 


Time  (60  Seeonds)  x  10'' 

Figure  2.36:  Validation  plot  2  -  Chebyshev  Type  II  vs.  estimated  foree  signal  using  adaptive  KIC 

probability. 

Different  linear  and  nonlinear  models  are  obtained  using  system  identifieation  (SI)  for  three 
sets  of  data.  Linear  and  nonlinear  models’  outputs  are  fused  separately  for  eaeh  sensor  and  then  fused 
together  to  get  the  final  foree  estimate  for  eaeh  sensor.  The  net  foree  estimates  for  eaeh  sensor  is  then 
applied  with  adaptive  KIC  probability  based  data  fusion  algorithm.  The  final  estimates  of  the  skeletal- 
musele  foree  gives  improved  results.  Future  work  will  foeus  on  the  improved  data  eolleetion 
teehniques  and  eapturing  data  at  higher  sampling  rate  (6000  samples  per  seeond).  Also,  we  would 
design  new  model  seleetion  eriteria  using  different  model  seleetion  eriteria  sueh  as  Akaike  Information 
Criterion  (AIC),  Kullbaek  Information  Criterion  (KIC)  and  the  Bayesian  Information  Criterion  (BIC). 

2.2.4  An  Adaptive  Hybrid  Data  Fusion  Based  Identification  of  Skeletal-Muscle  Force  with  ANFIS 

and  Smoothing  Spline  Curve  Fitting 

Preeise  and  effeetive  prosthetie  eontrol  is  important  for  its  applieability.  Two  desired 
objeetives  of  the  prosthetie  eontrol  are  finger  position  and  foree  eontrol.  Variation  in  skeletal-musele 
foree  results  in  eorresponding  ehange  of  surfaee  eleetromyographie  (sEMG)  signals.  sEMG  signals 
generated  by  skeletal-museles  are  temporal  and  spatially  distributed  that  result  in  eross  talk  between 
adjaeent  sEMG  signal  sensors.  To  address  this  issue,  an  array  of  nine  sEMG  sensors  is  used  with  a 
foree  sensing  resistor  to  eapture  musele  dynamies  in  terms  of  sEMG  and  skeletal-musele  foree.  The 
sEMG  and  skeletal-musele  foree  are  filtered  with  a  nonlinear  Teager-Kaiser  Energy  (TKE)  operator 
based  nonlinear  spatial  filter  and  Chebyshev  Type-II  filter  respeetively.  Multiple  Takagi-Sugeno-Kang 
Adaptive  Neuro  Fuzzy  Inferenee  Systems  (ANFIS)  are  obtained  using  sEMG  as  input  and  skeletal- 
musele  foree  as  output.  Outputs  of  these  ANFIS  systems  are  fitted  with  smoothing  spline  eurve  fitting. 
To  aehieve  better  estimate  of  the  skeletal-musele  foree,  an  adaptive  probabilistie  Kullbaek  Information 
Criterion  (KIC)  for  model  seleetion  based  data  fusion  algorithm  is  applied  to  the  smoothing  spline 
eurve  fitting  outputs.  Final  adaptive  fusion  based  output  of  this  approaeh  results  in  improved  skeletal- 
musele  foree  estimates. 


94  of  329 


Figure  2.37:  Flow  chart  of  the  approach  used  in  this  research  work. 

Experiment  Design 

Based  on  the  arrangement  of  the  sEMG  sensor  array  in  [113],  an  experiment  design  was 
developed  using  DELSYS®  Bagnoli-16  EMG  system  with  nine  DE-3.1  sEMG  sensors  to  eapture 
sEMG  signals  from  skeletal-museles.  Here,  the  array  involves  nine  sensors  eovering  four  direetional 
spatial  distributions  of  the  sEMG  signal.  The  middle  three  sEMG  sensors  were  attaehed  direetly  on  the 
skin  surfaee  above  the  motor  point  of  the  flexor  digitorum  superfieialis  (EDS)  musele  whieh  eontrols 
the  flexion  of  the  ring  finger.  Appropriate  sEMG  eleetrode  attaehment  point  for  the  flexion  of  the  ring 
finger  was  identified  using  a  wet  probe  musele  stimulator  at  the  EDS  (RICH-MAR,  HV  1000). 


Figure  2.38:  Experiment  design:  9  sEMG  sensors. 


Prior  to  plaeing  the  sEMG  sensors,  the  skin  surfaee  of  the  subjeet  was  prepared  aeeording  to 
International  Soeiety  of  Eleetrophysiology  and  Kinesiology  (ISEK)  protoeols.  The  thumb  movement 
was  restrieted  in  this  experiment  using  a  thumb  splint.  However,  the  eorresponding  foree  data  was 
eaptured  using  NI  EE  VIS™  with  Interlink™  Eleetronies  FSR  0.5”  eireular  foree  sensor.  Experiment 
design  is  shown  in  Figure  2.38,  where  9  sensors  are  shown  on  a  healthy  subjeet  forearm,  holding  a 
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stress  ball  for  force  measurements.  The  sEMG  and  finger  force  data  was  collected  at  a  sampling  rate  of 
2000  Hz  using  Lab  VIEW™  in  conjunction  with  DELSYS®  Bagnoli-16  EMG  and  NI  ELVIS™.  With 
this  experiment  design  we  conducted  several  experiments  of  30  seconds,  45  seconds  and  60  seconds 
durations. 

Signal  Processing 

The  recorded  sEMG  signal  is  filtered  using  nonlinear  spatial  filtering  for  multichannel  surface 
EMG.  As  given  in  [113],  this  nonlinear  spatial  filter  is  derived  from  “Nonlinear  Teager-Kaiser  Energy 
(TKE)  Operator.”  As  given  in  [113],  the  TKE  operator  in  the  time  domain  on  sEMG  signal  is  defined 
by  Equation  29. 

T^[x(n)]  =  x^(n)  -  x(n  +  1)  *  x(n  -  1).  (29) 

Here,  is  the  TKE  operator  andx(n)  is  the  time  domain  sEMG  signal.  Based  on  the  TKE  operator, 
the  four-dimensional  nonlinear  spatial  filter  is  given  by  Equation  30. 

=  4  *  x^(m,n)  —  x{m  -  l,n)  *  x{m  +  l,n)  -  x{m,n  -  1)  *  x{m,n  +  1)  - 
x{m  -  1,  n  +  1)  *  x(m  +  1,  n  -  1)  -  x(m  -  1,  n  -  1)  *  x{m  +  1,  n  +  1).  (30) 

Figure  2.39  shows  a  comparison  between  the  measured  and  nonlinear  spatial  filtered  sEMG 
signals.  A  Chebyshev  Type  II  infinite  impulse  response  (HR)  low  pass  filter  with  a  550  Hz  pass  band 
frequency  is  used  to  filter  the  skeletal-muscle  force  signal.  Figure  2.40  shows  the  comparison  between 
the  measured  and  Chebyshev  Type  II  filtered  skeletal-muscle  force  signal. 


sEMG  Signal  at  Ring  Finger  Motor  Point  -  Without  Filteration 


Time  xio' 

Figure  2.39:  sEMG:  ring  finger  motor  point  signal  vs.  filtered  9  sensor  array  signal. 

Measured  Skeletal  Musele  Foree  Signal  -  Without  Filteration 


Time  xio' 

Figure  2.40:  Skeletal-muscle  force  signal  from  ring  finger. 
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ANFIS  Modeling 

In  1965  professor  Lofti  A.  Zadeh  introduced  the  concept  oi ‘'Fuzzy  Sets'\  which  are  sets  with 
imprecise  amplitudes  [114].  Dr.  Zadeh  stated  that  the  “membership''  in  a  fuzzy  set  is  a  matter  of  degree 
and  not  a  matter  of  affirmation  or  denial.  For  last  four  decades,  this  proposal  has  gained  recognition  as 
an  important  point  in  the  evolution  of  modern  concept  of  imprecision  and  uncertainty  [114].  This 
innovation  represents  a  paradigm  shift  from  the  classical  sets  or  the  crisp  sets  to  “Fuzzy  Sets"  [114]. 

Fuzzy  set  and  fuzzy  logic  theory  can  be  used  to  capture  the  natural  phenomenon  of  the 
imprecision  and  uncertainty  [114].  The  membership  function  is  the  characteristic  of  fuzzy  set,  which  is 
a  function  whose  range  is  an  ordered  membership  set  within  the  closed  unit  interval  [114]. 

A  crisp  set  which  is  a  collection  of  distinct  objects  is  defined  in  a  way  to  partition  objects  in  a 
given  domain  of  discourse  into  two  groups:  members  and  non-members  [114].  On  the  other  hand,  a 
fuzzy  set  can  be  formed  by  assigning  a  membership  value  (which  represents  the  degree  to  which  an 
object  belongs  to  a  fuzzy  set)  to  each  object  in  the  interval  of  0  to  1  [114].  Fuzzy  membership  functions 
can  be  of  different  forms  such  as  triangular,  trapezoidal,  pi,  bell  and  Gaussian  form. 

Fuzzy  Inference  System  (FIS)  in  fuzzy  logic  can  be  used  to  model  a  system  which  is  an 
inference  system  based  on  empirical  knowledge  based  linguistic  rules  [115].  The  fuzzy  inference 
system  is  composed  of  five  steps:  fuzzification  of  the  input  variables,  application  of  the  fuzzy  operator 
(AND  or  OR)  in  the  precedent,  implication  from  the  precedent  to  the  subsequent,  aggregation  of  the 
subsequents  across  the  rules,  and  defuzzification.  In  the  fuzzification  process,  the  membership  values 
coming  from  quantitative  measurements  are  converted  to  linguistic  values  based  on  the  membership 
functions  [115]. 


0  1  2  3  4  S 


input  variable  "inputl" 

Figure  2.41:  Gaussian  membership  functions  for  the  sEMG. 

Figure  2.41  shows  the  plot  of  Gaussian  membership  functions  for  fuzzification  of  the  sEMG. 
The  process  of  fuzzification  followed  by  IF  ..  AND..  THEN  ..OR  EESE  type  control  or 
relation/estimation  rules  [115].  The  output  of  the  rules  is  computed  as  a  max-min  composition  [1 15].  In 
the  defuzzification  process,  the  output  of  the  rules  has  to  be  converted  to  a  crisp  value  [115]. 

Using  eight  different  membership  functions  types  we  designed  eight  single-output  Sugeno- 
type  adaptive  neuro-fuzzy  inference  systems  (ANFIS)  using  a  grid  partition  on  the  data.  The  output 
membership  function  in  each  of  these  is  linear.  Each  ANFIS  has  ten  rules  and  connection  type  is  ‘And’ 
with  a  weight  of  1.  For  the  ‘And’  method  ‘product’  and  for  ‘Or’  method  ‘probabilistic’  types  are  used 
for  each  ANFIS.  Deffuzification  is  achieved  using  weighted  average  (wtaver)  from  each  rule.  Figure 
2.42  shows  the  rules  for  ANFIS  with  Gaussian  membership  functions  and  illustrate  the  ANFIS 
inference  mechanism.  The  membership  functions  used  are  tabulated  in  Table  2.9. 
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Figure  2.42:  Illustration  of  ANFIS  inference  mechanism. 
Table  2.9:  Membership  Functions  [FUZZ-IEEE  2011) 


S.No. 

Membership  Function 

1. 

Gaussian  (GAUSSMF) 

2. 

Gaussian  combination  (GAUSS2MF) 

3. 

Difference  between  two  sigmoidal  membership 
functions  (DSIMF) 

4. 

Generalized  bell-shaped  (GBELLMF) 

5. 

n-shaped  (PIMF) 

6. 

Product  of  two  sigmoidally  shaped  membership 
functions  (PSIMF) 

7. 

Trapezoidal- shaped  (TRAPMF) 

8. 

Triangular-shaped  (TRIMF) 

A  Gaussian  function  is  given  by /(x;  (7,c)  =  e  2^2  for  some  real  constants  c  and  a  >  0, 
and  e  =  2.718.  Gaussian  combination  membership  function  (GAUSS2MF)  depends  on  the  c  and  a 
parameters  [116].  The  sigmoidal  membership  function  is  given  as  /(x;  a,  c)  =  depends 


on  the  two  parameters  a  and  c.  The  difference  between  two  sigmoidal  membership  function  (DSIMF) 
which  is  the  difference  between  two  sigmoidal  functions  depends  on  the  four  parameters  a^,  c^,  a2,  and 
C2  [116].  Generalized  bell-shaped  membership  function  (GBELLMF)  is  given  as /(x;  a,  h,  c)  = 
— and  depends  on  three  parameters  a,  b,  and  c  where  parameter  a  and  b  decide  the  width  of  the 


curve  and  parameter  c  locates  the  center,  usually  b  >  0  [116].  Pi-shaped  membership  function  (PIMF) 
is  given  by 


/(x;  a,  b,  c,  d) 


0, 

X  <  a 

a+b 

a  <  X  <  — 
2 

a+b  .  .  j 

2 

b  <  X  <  c 

c+d 

C  <  X  <  — 
2 

2  , 

—  <  X  <  d 
2 

\d-cJ 

0, 

x>  d 

and  evaluated  at  the  points  given  by  vector  x. 


The  “feet”  of  the  curve  is  determined  by  parameters  a  and  d  whereas  parameters  b  and  c  decides  its 
“shoulders”  [116].  The  Product  of  two  sigmoidally  shaped  membership  functions  (PSIMF)  is  simply 
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the  products  of  two  sigmoidal  functions  as  given  before.  The  trapezoidal  shaped  membership  function 
(TRAPMF)  is  given  by 


/(x;  a,  b,  c,d) 


/ 

x-a 
b-a  * 
1, 
d-x 
d-c 
\  0, 


a  <  X  <  b 


\ 


b  <  X  <  c 
c  <  X  <  d 
d  <  X  / 


which  depends  on  four  scalar  parameters  a,  b,  c,  and  d.  The 


triangular  shaped  membership  function  (TRIMF)  is  given  by 


/(x;  a,  b,  c) 


X  <  a  \ 
a  <  X  <  b 

b  <  X  <  c 
c  <x  j 


which  depends  on  the  scalar  parameters  a,  b  and  c  [116]. 


Smoothing  Spline  Curve  Fitting 

MATLAB®  Curve  Fitting  Toolbox™  is  a  useful  tool  for  fitting  curves  and  surfaces  to 
acquired  data  [117].  It  can  be  used  to  do  exploratory  data  analysis,  preprocessing  and  post-processing 
of  the  data,  comparing  candidate  models,  and  for  removing  outliers  [117].  Weights  for  each  smoothing 
spline  curve  fit  are  calculated  by  subtracting  the  ANFIS  output  from  the  measured  skeletal-muscle 
force  output.  A  graphical  user  interface  is  used  to  fit  the  smoothing  spline  curve  to  each  output  from 
eight  ANFIS  with  respective  weights.  Smoothing  spline  which  is  a  piecewise  polynomial  computed 
from  a  smoothing  parameter  (p)  of  0.92  is  fitted  to  each  of  eight  outputs  of  ANFIS.  Smoothing 
parameter  (p)  is  a  number  between  0  and  1 .  Change  in  the  value  of  p  from  0  to  1  results  in  the  change 
in  smoothing  spline.  For  p  =  0  the  smoothing  spline  is  a  least- square  straight-line  approximation  to  the 
data  whereas  for  p  =  1  it  gives  the  "natural"  cubic  spline  interpolant  to  the  data  [117]. 


Analysis  of  fit  "fit  1 "  for  dataset  "a_e_40GAUSS2MF  with  wtl_2GA40" 


4 

x10 


Figure  2.43:  Analysis  results  for  smoothing  spline  curve  fitting  to  the  output  of  ANFIS  with  Gaussian 

membership  function. 

For  the  specified  weight  (Wj)  and  smoothing  parameter  (p)  a  smoothing  spline  s  is  formed 
which  minimizes  the  parameter  J  given  by  Equation  (31). 

J  =  +  (1  (31) 

where  Xj  and  yi  are  predictor  and  response  data  respectively.  The  smoothing  parameter  p  should  be 

d^  s 

chosen  to  make  the  error  F (5)  =  ~  roughness  J(— )^dx  small.  In  this  work  the 

smoothing  parameter  p  is  chosen  as  0.92  [117].  Figure  2.43  shows  the  analysis  results  for  smoothing 
spline  curve  fitting  to  the  output  of  ANFIS  with  Gaussian  membership  function. 
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Adaptive  Data  Fusion 

Fusion  of  outputs  for  different  linear  and  nonlinear  models  is  aehieved  with  an  adaptive 
probability  of  KIC,  as  given  in  the  subseetion  ‘DATA  FUSION  AND  ADAPTIVE  KIC 
PROBABILITY,’  of  the  previous  seetion  ‘ADAPTIVE  MULTI  SENSOR  BASED  NONLINEAR 
IDENTIFICATION  OF  SKELETAL-MUSCLE  FORCE’  of  this  ehapter.  Figure  2.44  shows  the  flow 
ehart  for  fusion  of  outputs  and  adaptive  probability  of  KIC. 

Results  and  Discussion 

The  proposed  method  gives  good  estimation  of  the  skeletal-musele  foree.  A  data  set  of  45 
seeonds  is  used  to  estimate  the  output.  Figure  2.45  shows  the  measured  and  estimated  skeletal-musele 
foree  using  this  method. 


Figure  2.44:  Flow  ehart  for  fusion  of  outputs  and  adaptive  probability. 


ANFIS  -  CURVE  FITTING  -  DATA  FUSION  OUTPUT 


10  20  30  40  50  60  70  80  90 


Time 


Figure  2.45:  Plot  of  measured  and  proposed  method  estimated  skeletal-musele  foree. 
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Validation  Plot  1  -  ANFIS  -  CURVE  FITTING -DATA  FUSION 


Figure  2.46:  Validation  plot  1  using  different  data  set. 

Figs.  2.46  and  2.47  are  the  validation  plots  for  45  seeonds  and  60  seeonds  of  data  sets 
respeetively.  All  of  these  three  plots  show  a  very  elose  follow  up  of  the  measured  signal  by  the 
estimated  signal  using  this  approaeh. 

Validation  Plot  2  -  ANFIS -CURVE  FITTING -DATA  FUSION 


Figure  2.47:  Validation  plot  2  using  different  data  set. 


Percentage  Error 
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Figure  2.48  shows  the  pereentage  error  between  the  measured  foree  signal  and  estimated 
finger  foree  signal  for  45  seeonds  of  data  set.  The  pereentage  error  redueed  to  the  lower  values  and  the 
maximum  pereentage  error  value  is  1.7  pereent.  The  mean  fit  value  between  the  measured  and 
estimated  output  is  91.3  pereent. 

Percentage  Error  -  Validation  2  Data 


Figure  2.49:  Pereentage  error  plot  for  60  seeonds  data  set. 

Figure  2.49  shows  the  pereentage  error  plot  for  different  data  set  of  60  seeonds  duration. 
Pereentage  error  redueed  to  lower  values  and  the  maximum  pereentage  error  value  is  3.7  pereent.  The 
mean  fit  value  between  the  measured  and  estimated  output  is  40  pereent.  The  mean  fit  value  for  another 
45  seeonds  of  data  set  is  73  pereent. 

Using  the  sEMG  and  skeletal-musele  foree  as  input  and  output  data,  eight  ANFIS  were 
designed  and  tested.  Outputs  of  these  ANFIS  were  fitted  with  smoothing  spline  eurve  fit  and  resultant 
outputs  were  fused  using  a  KIC  based  adaptive  data  fusion  algorithm.  This  approaeh  has  been  validated 
using  two  separate  data  sets.  Results  are  promising  and  show  good  estimation  of  skeletal-musele  foree 
whieh  ean  be  applied  to  design,  applieation  and  improvement  of  prosthetie  hands  for  amputees. 

Future  work  will  address  the  improvement  of  data  eolleetion  teehniques,  the  sEMG  sensor 
design,  use  of  this  approaeh  for  finger  angles  and  stiffness  estimation  from  sEMG  signals.  Different 
modeling  teehniques  with  this  approaeh  and  eombined  probability  of  different  model  seleetion  eriteria 
sueh  as  Akaike  Information  Criterion  (AIC),  Kullbaek  Information  Criterion  (KIC)  and  the  Bayesian 
Information  Criterion  (BIC)  together  will  give  improved  results. 

2.3  Skeletal-Muscle  Fatigue 

2.3.1  Towards  Smart  Prosthetic  Hand:  Adaptive  Probability  Based  Skeletal-Muscle  Fatigue 

Model 


Skeletal-musele  foree  ean  be  estimated  using  surfaee  eleetromyographie  (sEMG)  signals. 
Usually,  the  surfaee  loeation  for  the  sensors  is  near  the  respeetive  musele  motor  unit  points.  Skeletal- 
museles  generate  a  spatial  EMG  signal,  whieh  eauses  eross  talk  between  different  sEMG  signal 
sensors.  In  this  study,  an  array  of  three  sEMG  sensors  is  used  to  eapture  the  information  of  musele 
dynamies  in  terms  of  sEMG  signals.  The  reeorded  sEMG  signals  are  filtered  utilizing  optimized 
nonlinear  Half-Gaussian  Bayesian  filters  parameters,  and  the  musele-foree  signal  using  a  Chebyshev 
Type-II  filter.  The  filter  optimization  is  aeeomplished  using  Genetie  Algorithms.  Three  diserete  time 
state-spaee  musele-fatigue  models  are  obtained  using  system  identifieation  (SI)  and  modal 
transformation  for  three  sets  of  sensors  for  single  motor  unit.  The  outputs  of  these  three  musele-fatigue 
models  are  fused  with  a  probabilistie  Kullbaek  Information  Criterion  (KIC)  for  model  seleetion.  The 
final  fused  output  is  estimated  with  an  adaptive  probability  of  KIC,  whieh  provides  improved  foree 
estimates. 

This  seetion  addresses  the  issue  of  skeletal-musele  fatigue  that  is  a  dynamie  phenomenon.  The 
Flow  Chart  of  the  work  in  this  seetion  is  shown  in  Figure  2.50.  The  modeling  is  based  on  system 
identifieation,  where  mathematieal  relations  are  inferred  from  experimental  data.  The  data  eonsists  of 
sEMG  signals  and  hand/finger  foree  generated  by  healthy  subjeets.  The  reeorded  three-sEMG  signals 
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are  filtered  using  nonlinear  Half-Gaussian  Bayesian  filters  with  optimized  filter  parameters,  whereas 
the  skeletal-musele  foree  signal  is  pre-proeessed  using  a  Chebyshev  Type-II  filter  [118],  [100]. 

A  simple  Genetie  Algorithm  eode  is  used  to  optimize  the  Bayesian  filter  parameters.  Using  an 
input/output  approaeh,  the  EMG  signal  is  the  input  to  the  skeletal-musele,  and  the  produeed 
hand/finger  foree  eonstitutes  the  output.  Three  diserete  time  state-spaee  models  are  obtained  using 
system  identifieation  and  modal  transformation  for  three  sets  of  sensors.  One  sensor  is  plaeed  at  the 
motor  unit  of  the  ring  finger  of  the  dominant  hand  and  two  sensors  are  loeated  in  its  vieinity  as  shown 
in  Figure  2.51.  The  extraeted  models  from  the  data  sets  are  fused  with  a  probabilistie  Kullbaek 
Information  Criterion  (KIC)  for  model  seleetion.  The  final  fused  output  is  estimated  with  an  adaptive 
probability  of  KIC  that  gives  improved  skeletal-musele  foree  estimates. 


Figure  2.50:  The  flow  ehart  of  the  work  in  this  seetion. 

Experiment  Design  and  Pre-Processing 

Both  sEMG  and  musele- foree  signals  were  aequired  simultaneously  using  EabVIEW™  8.2  at 
a  sampling  rate  of  2000  Hz.  The  sEMG  data  eapturing  was  aided  by  a  DEESYS®  Bagnoli-16  EMG 
system  with  DE-2.1  differential  EMG  sensors.  The  eorresponding  foree  data  was  eaptured  using  NI 
EE  VIS  with  Interlink  Eleetronies  FSR  0.5”  eireular  foree  sensor.  The  experiment  design  is  shown  in 
Figure  2.51.  One  sEMG  sensor  was  plaeed  on  the  motor  point  of  ring  finger  and  two  adjaeent  to  the 
motor  point  of  a  healthy  subjeet.  Prior  to  plaeing  the  sEMG  sensors,  the  skin  surfaee  of  the  subjeet  was 
prepared  aeeording  to  International  Soeiety  of  Eleetrophysiology  and  Kinesiology  (ISEK)  protoeols 
[1]. 
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Figure  2.51:  Experiment  set-up. 


The  EMG  signal  is  modeled  for  the  eonditional  probability  of  the  reetified  EMG  signal  as  a 
filtered  random  proeess  with  random  rate.  The  likelihood  funetion  for  the  rate  evolves  in  time 
aeeording  to  a  Fokker-Planek  partial  differential  Equation  [100].  Here,  a  and  fS  are  two  free 
parameters,  a  is  the  expeeted  rate  of  gradual  drift  in  the  signal,  and  fS  is  the  expeeted  rate  of  sudden 
shifts  in  the  signal.  These  two  free  parameters  of  the  non-linear  “Half-Gaussian  filter  model”  are 
optimized  for  the  aequired  EMG  data  using  elitism  based  Genetie  Algorithm.  A  Chebyshev  Type  II 
low  pass  filter  with  a  550  Hz  pass  frequeney  is  used  to  filter  the  foree  signal. 

System  Identification  and  Modal  Transformation 

An  alternative  to  physieally  based  mathematieal  modeling  is  data  based  -‘system 
identifieation  (SI)’-  that  ean  be  applied  to  different  systems  where  it  needs  suffieient  experimental  data 
[110].  The  parametrie  system  identifieation  proeess  yields  a  dynamieal  model  sueh  as  the  Auto 
Regressive  with  exogenous  input  (ARX)  or  Output  Error  (OE)  model,  this  model  gives  us  the  system 
in  mathematieal  form.  In  this  work,  the  SI  approaeh  is  used  with  the  myoeleetrie  signal  as  the  input  to 
the  system  and  as  the  output  is  the  intended  finger/hand  foree.  In  this  work,  we  are  using  an  output 
error  (OE)  model  strueture  for  the  modeling  of  EMG  and  hand/finger  foree  signals,  whieh  has  been 
doeumented  in  the  literature  to  perform  well  for  EMG  signals  among  linear  parametrie  models  [118]. 
Eaeh  OE  model  takes  the  form  of  Equation  (32), 

y(t)  =  ^u(t  -  Uk)  +  e(t),  (32) 

where  t  is  time  index,  y(t)  is  output,  u(t  —  n^)  is  input,  is  the  delay,  e{t)  is  the  error,  and  B{q) 
and  F{q)  are  polynomials. 

A  eommon  OE  model  is  obtained  for  eaeh  sensor  data  set  using  one  set  of  model  parameters 
(polynomial  order).  The  OE  models  then  are  eonverted  into  a  state-spaee  formulation.  By  doing  this, 
the  identifieation  properties  of  the  OE  model  formulation  are  preserved  and  represented  in  the  state- 
spaee  form.  A  modal  form  is  eomputed  by  using  state-spaee  matriees  and  following  transformation: 

A  =  T“UT,  n  =  T“^B,  r  =  Cl,  (33) 

where  T  is  the  matrix  eomposed  of  the  eigenveetors  of  A,  A,  Q  and  F  are  eorresponding  transformations 
for  matrix  A,  B,  and  C .  Matrix  D  eame  out  to  be  a  zero  matrix  for  the  eases  treated  in  this  work. 
Equation  33  refers  to  the  eontinuous  representation  of  the  identified  models.  Using  the  modal  form 
representation  for  eaeh  eorresponding  data  set,  the  influenee  of  fatigue  ean  be  observed  by  eharting  the 
modal  eoeffieients  in  time  for  eaeh  matrix.  For  example,  the  eoeffieients  eontained  in  the  transformed 
matrix  A  ean  be  plotted  in  the  eomplex  ^-plane.  This  traeking  ean  then  be  used  as  the  basis  for 
eonstrueting  polynomials  that  eonneet  eaeh  element  of  eaeh  matrix  in  time  with  the  eorresponding  time 
stamp.  Henee,  a  fatigue  model  in  state-spaee  deseription  is  eonstrueted,  where  the  input  is  the  reeorded 
EMG  signal  and  the  output  the  expeeted  foree  generated  by  the  hand  motion  all  as  a  funetion  of  time. 

Fusion  of  Outputs  and  Adaptive  Probability  of  KIC 

Multiple  model  fusion  is  done  by  assigning  a  partieular  probability  to  eaeh  individual  model 
[105].  These  models  are  obtained  using  SI  for  three  sEMG  sensors  for  single  motor  unit.  SI  model  fit 

r  |r-f|l 

value  is  used  to  eompute  the  probability  for  eaeh  model.  The  fit  value  is  given  by  1  —  -r^A  *  100. 
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The  model  seleetion  eriterion  used  in  this  seetion  is  Kullbaek  information  eriterion  (KIC),  whieh  is  an 
asymmetrie  measure.  The  sum  of  two  direeted  divergenees,  whieh  is  the  measure  of  the  models 
dissimilarity,  is  known  as  Kullbaek’ s  symmetrie  or  J-divergenee  [106],  as  given  by  Equation  34. 

KICipi)  =  ^\ogRt+  -  nxp  +  g (n),  (34) 

where  g(n)  =  n  *  log  (n/2). 

Following  fusion  teehnique  is  applied  for  sEMG  -  foree  identifieation  models,  whieh  is  based  on  [105]. 


1)  Identify  OE  models  M^,  M2,  using  sEMG  data  (u)  as  input  and  foree  data  (T)  as 

output,  for  kl  number  of  sensors  eolleeting  data  simultaneously. 

2)  Compute  the  residual  square  norm  Ri  =  \\Y  —  =  ||T  —  f  ||  , 


r 

ul 

h-i 

...  ul 

where  Qi  =  J  and  O  = 

^p+i 

Up+i 

Y^ 

Ip 

.  ul 

L^n-l 

K-1 

^n-2  ■■ 

.  ul_p 

3)  Caleulate  the  model  eriteria  eoeffieient  using  Equation  34. 

e-h 

4)  Compute  the  model  probability  p(Mi\Z)  =  — — where  I  is  model  seleetion  eriterion,  i.e. 


KlCipt). 

5)  Compute  the  data  fusion  based  model  output  Yf  =  Xfii  p(Mj |Z)?j. 

Here  all  the  eomputation  from  step  2)  to  step  5)  is  adaptive  i.e.  the  residual  square  norm, 
KIC(pi),  model  probability  p(Mj|Z),  and  fused  model  output!^  are  being  updated  with  time  or  for 
eaeh  data  point. 


Results  and  Discussion 

Based  on  previous  researeh  results  and  after  trying  different  model  orders  for  sEMG/Foree 
data,  an  optimal  model  order  of  =  2,nf  =  2,n^  =  1  is  used  in  this  work.  Equation  35,  36,  and  37 
give  three  resulting  diserete  time  state-spaee  sEMG-Foree-Fatigue  models  for  motor  point  sensor, 
sensor- 1  and  sensor-2  respeetively. 

Xm(h  +  1)  =  A^x^(h)  +  B^EMG^Qi)-, 

Y^(h)  =  +  D^EMG^ih).  (35) 

x^(h  +  1)  =  i4iXi(/i)  +  BiEMGiih)-, 

fi(/i)  =  CiXi(/i)  +  D^EMG^ih).  (36) 


X2{h  +  1)  =  ^2^2  W  +  B2EMG2ihy. 

72  (/i)  =  C2X2ih)  +  D2EMG2(K).  (37) 

In  these  ease  matriees  D^,  and  D2  are  zero  matriees,  whereas 


Am,  Bm,  Cm,  A^,  C^,  A2,  B2,  and  C2  are  given  as: 


Arr,  = 


^ml  (^) 
0 


0 

^m2 


;  Bm  = 


^ml  (^) 
^m2  (^) 


:  Cm  =  [Cmlit)  C^2(0]:  ^1  = 


0 

%2 


matriees 


B,  = 


Cl  —  [cii  C12];  A2  — 


and  6*2  =  [c2i(t)  C22(t)];  where 


'CL2l(t)  0].  5  ^  p2i(0 

0  ^22-  ^  -^22(0 

the  elements  of  matriees  Am,Bm,  Cm,A2,B2,  and  C2  are  funetion  of  time  and  the  elements  of  matriees 
A^,B^  and  Q  are  eonstants  for  this  partieular  data  set.  The  time  variables 
CLml  it).  ^m2  it),  ^ml  it).  ^m2  it).  ^ml  it).  ^rn2  it). 

021(0,022(0.^21(0.^22(0.^21(0.  and  022(0  are  given  by  quadratic  polynomials  obtained  by  curve 
fitting  the  tracked  modal  transformed  coefficients.  These  time  variables  are  given  as; 


ami(0  =  0.00026t2  -  0.033t  -  11;  0^2(0  =  -O.OOlSt^  +  0.24t  -  33; 
bmiit)  =  -O.OOIt^  +  0.33t  +  42;  hm2(0  =  -O.OOiyt^  +  0.33t  +  25; 

Cmi(0  =  (3.2  *  lO-Ot"  -  (4.2  *  10-Ot  +  0.71; 

Cm2(0  =  (4.6  *  10-®)t2  -  (5.8  *  10-Ot  -  0.71; 

a2i(t)  =  -(1.2  *  lO'Ot^  +  0.0013t  -  0.47;  022(0  =  O.OOlt^  -  0.037t  -  35; 
b^iit)  =  (6.4  *  lO-®)!^  -  O.OOlt  +  0.3;  1)22(0  =  0.00231^  -  0.12t  -  75; 
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C2i(t)  =  -(1.8  *  +  (6.4  *  10-^)t  +  0.71;  and  C22(t)  =  -(2.1  *  lO-^)!^  +  (2.4  *  IQ-^t  - 

0.71. 


Elements  of  matriees  A^,  B^,  and  are  eonstants  for  this  partieular  data  set,  they  are  given  as: 

=  -0.0159  ;  a^2  =  -43.1883  ;  =  0.0090  ;  b^2  =  -72.1875  ;  =  0.7147  ;  and  c^2  = 

-0.7071. 


The  diserete  models  have  a  sampling  time  ofdt  =  0.0005  seeonds.  The  duration  of  the  final  estimated 
and  fused  output  for  three  sensors  is  37.36  seeonds.  Figure  2.52  depiets  the  probability  and  10^^  degree 
eurve  fitting  for  motor  point,  ring2  and  ringl  sensor  signals. 

Figure  2.53  and  2.54  shows  the  measured  and  estimated  fused  output,  depending  on  the  error 
between  the  two  later  follows  the  measured  signal  very  elosely.  This  approaeh  identifies  a  fused  fatigue 
model  and  estimates  an  adaptive  probability  based  output  that  follows  the  measured  output  very 
elosely.  The  outeome  of  this  researeh  ean  be  used  to  estimate  the  skeletal-musele  foree  of  a  human 
hand  for  prosthetie  hand  design,  applieation  and  improvement. 

In  future  work  improvement  of  the  data  eolleetion  teehniques  and  sEMG  sensor  design,  may 
lead  to  improved  foree  estimation. 
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Figure  2.52:  10^^  degree  eurve  fitting  -  probability  motor,  ring2  and  ringl  sensor  signals. 


Measured  Output  Vs.  Estimated  Fused  Output  with  Adaptive  Probability 


Figure  2.53:  Measured  output  vs.  fusion  based  estimated  output  with  adaptive  probability. 
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Validation  Plot  -  Measured  Output  Vs.  Estimated  Fused  Output  With  Adaptive  Probability 


Figure  2.54:  Validation  plot  -  measured  vs.  fusion  based  estimated  output  with  adaptive  probability. 

2.3.2  Spectral  Analysis  of  sEMG  Signals  to  Investigate  Skeletal-Muscle  Fatigue 

Our  recent  investigations  are  focused  to  develop  dynamic  models  for  skeletal-muscle  force 
and  finger  angles  for  prosthetic  hand  control  using  surface  electromyographic  sEMG  as  input.  Since 
the  sEMG  is  temporal  and  spatially  distributed  and  is  influenced  by  various  factors,  muscle-fatigue  and 
its  related  sEMG  becomes  of  importance.  This  study  is  an  effort  to  spectrally  analyze  the  sEMG  signal 
during  progression  of  muscle-fatigue.  The  sEMG  is  captured  from  the  arms  of  healthy  subjects  during 
muscle  fatiguing  experiments  for  dynamic  and  static  force  levels.  Filtered  sEMG  signal  is  segmented  in 
five  parts  with  75%  overlap  between  adjacent  segments.  The  analysis  is  done  using  different  classical 
(fast  Fourier  transform,  Welch’s  averaged  modified  periodogram),  model-based  (Yule-Walker,  Burg, 
Covariance  and  Modified  Covariance  autoregressive  (AR)  method),  and  eigenvector  methods  (Multiple 
Signal  Classification  (MUSIC)  and  eigenvector  spectral  estimation  method)  in  frequency  domain. 
Results  show  that  the  classical  and  eigenvector  based  methods  are  more  sensitive  than  the  model-based 
methods  to  fatigue  related  changes  in  sEMG  signals. 

The  present  work  investigates  the  change  in  sEMG  in  frequency  domain  during  skeletal- 
muscle  fatigue.  sEMG  signals  are  acquired  for  multiple  subjects  for  dynamic  and  static  force 
experiments  to  induce  skeletal-muscle  fatigue.  sEMG  signals  are  filtered  with  a  nonlinear  Teager- 
Kaiser  Energy  (TKE)  operator-based  nonlinear  spatial  filter  [113].  Two  sets  of  dynamic  force  data  are 
segmented  into  three  and  five  parts  and  two  sets  of  static  force  data  are  segmented  into  five  parts  each. 
There  is  a  75%  overlap  between  the  two  adjacent  segments.  A  number  of  classical,  model-based  and 
eigenvector  based  spectral  estimation  techniques  are  used  to  study  the  change  in  sEMG  signals  as  a 
result  of  muscle-fatigue.  In  classical  methods  Fast  Fourier  transform  (EFT)  and  Welch’s  averaged 
modified  periodogram  methods  are  used.  In  case  of  model-based  methods,  Yule-Walker  (Y-W),  Burg, 
Covariance  (Cov.),  and  Modified  Covariance  (Mcov.)  Autoregressive  (AR)  methods  are  applied.  For 
eigenvector  methods  Multiple  Signal  Classification  (MUSIC)  and  Eigenvector  (EIG)  spectral 
estimation  methods  were  selected  for  processing  sEMG  signals.  Using  these  spectrum  analysis 
techniques.  Power  Spectral  Density  (PSD)  estimates  and  detailed  documentations  of  sEMG  signals 
were  obtained.  These  methods  were  compared  in  terms  of  their  frequency  resolution  and  the  effects  in 
determination  of  skeletal-muscle  fatigue. 

Experiment  Design  and  Pre-Processing 

An  experiment  design  was  developed  using  DEESYS®  Bagnoli-16  EMG  system  with  nine 
DE-3.1  sEMG  sensors  to  capture  sEMG  signals  from  skeletal-muscles  as  given  in  [113].  This 
arrangement  involves  nine  sensors  covering  four  directional  spatial  distributions  of  the  sEMG  signal. 
The  appropriate  motor  point  of  the  flexor  digitorum  superficialis  (EDS)  muscle,  which  controls  the 
flexion  of  the  ring  finger,  was  identified  using  a  wet  probe  muscle  stimulator  at  the  EDS  (RICH-MAR, 
HV  1000).  The  middle  three  sEMG  sensors  were  attached  directly  on  the  skin  surface  above  the  motor 
point  of  the  ring  finger.  Prior  to  placing  sEMG  sensors,  the  skin  surface  of  the  subject  was  prepared 
according  to  International  Society  of  Electrophysiology  and  Kinesiology  (ISEK)  protocols  [119].  Two 
different  sets  of  fatigue  inducing  experiments  were  conducted  using  this  experiment  design  of  sEMG 
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sensors,  one  experiment  by  varying  the  foree  dynamieally,  and  seeond  with  50  pounds  of  statie  foree. 
For  the  dynamie  foree  variation  we  used  an  Interlink™  Eleetronies  FSR  0.5”  eireular  foree  sensor  on  a 
stress  ball  and  for  the  statie  foree  experiment  we  used  a  eable  tensionmeter  (T5166)  by  Taeifie 
Seientifie  Company.’ 


Figure  2.55:  Experiment  design  for  dynamie  foree  levels. 

For  the  dynamie  foree  experiment  we  restrieted  the  thumb  movement  using  a  thumb  splint. 
For  the  statie  foree  experiment  we  held  the  foree  of  the  dynamometer  at  50  pounds  and  tried  to 
maintain  this  foree  level  to  induee  fatigue  in  skeletal-museles.  Foree  data  for  dynamie  foree 
experiments  was  eaptured  using  NI  EE  VIS™  with  Interlink™  Eleetronies  FSR  0.5”  eireular  foree 
sensor.  Experiment  design  is  shown  in  Figure  2.55  and  2.56,  where  9  sensors  are  shown  on  a  healthy 
subjeet  forearm,  holding  a  stress  ball  and  a  grip  tension  dynamometer,  respeetively.  sEMG  and  finger 
foree  data  were  eolleeted  at  a  sampling  rate  of  2000  Hz  using  Lab  VIEW™  in  eonjunetion  with 
DELSYS®  Bagnoli-16  EMG  and  NI  ELVIS™.  With  these  experiment  designs,  we  eondueted  several 
experiments  of  30  seeonds,  45  seeonds  and  60  seeonds  durations. 


Figure  2.56:  Experiment  design  for  50  pounds  statie  foree  levels. 

Spectral  Estimation  Methods 

Signals  ean  be  analyzed  in  the  time  and  frequeney  domains  and  in  some  instanees  the 
frequeney  eontent  of  the  signal  is  more  useful  than  the  time  domain  eharaeteristies  [120].  Various  bio 
signals  sueh  as  the  heart  rate,  EMG,  EEG,  ECG,  eye  movements,  and  other  motor  responses,  aeoustie 
heart  sounds,  and  stomaeh  and  intestinal  sounds,  show  mueh  rieher  information  in  the  frequeney 
domain  [120].  Speetral  analysis  is  a  mathematieal  prism  whieh  finds  the  frequeney  eontent  of  a 
waveform  by  deeomposing  the  signal  into  its  eonstituent  frequeneies  [120],  [121].  There  is  a  wide 
range  of  methods  for  speetral  analysis,  eaeh  having  its  own  benefits  and  drawbaeks.  In  this  researeh  we 
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are  using  classical  methods  based  on  the  Fourier  transform,  modem  methods  based  on  the  estimation  of 
model  parameters,  and  eigenvector  based  methods  [120]  in  order  to  characterize  the  muscle-fatigue 
occurring  in  skeletal  human  muscles,  in  particular  muscles  of  the  forearm.  To  use  the  spectral  analysis 
wisely,  we  need  to  have  an  understanding  of  the  spectral  features  of  interests  and  the  best  methods  to 
accurately  determine  those  features  [120]. 

A,  Discrete  Fourier  Transform  (DFT) 

DFT  which  is  the  computational  basis  of  the  spectral  analysis  transforms  the  time  or  space 
domain  data  into  frequency  domain  data  [122].  The  DFT  of  a  vector  x  of  length  N  is  given  by  Equation 
(38). 

xik)  =  (38) 

where  =  ^(-2ni)/N  unity  [122]. 

B,  Welch  ^s  averaged  modified periodogram  method 

As  the  name  suggests,  the  ‘Welch’s  averaged  modified  periodogram  method’  depends  on  the 
periodogram  of  the  signal  {x(n)^]  which  is  given  by  Equation  39,  [122]. 

Sperif)  =  ^  lln=i  x(n)exp  {-j2nfn)\^.  (39) 

In  Welch  method,  the  signal  is  segmented  into  eight  parts  of  equal  length  with  an  overlapping 
ratio  of  50%  and  each  part  is  segmented  using  a  Hamming  window  as  given  by  Equation  40,  [122]. 

w(n)  =  0.54  —  0.46 cos  (27r ,0  <n  <  N  .  (40) 

C  Yule-Walker  (Y-W)  autoregressive  (AR)  method 

The  Yule-Walker  autoregressive  method,  also  called  the  autocorrelation  method,  estimates  the 
power  spectral  density  (PSD)  of  the  input.  This  method  fits  an  autoregressive  (AR)  model  to  the 
windowed  input  data  by  minimizing  the  forward  prediction  error  in  the  least-squares  sense.  This 
formulation  leads  to  the  Yule-Walker  equations,  which  are  solved  by  Levinson-Durbin  recursion  [122]. 

D,  Burg  autoregressive  (AR)  method 

The  Burg  autoregressive  (AR)  method  is  a  parametric  spectral  estimation  method  of  the 
signal,  X.  The  power  spectral  density  is  calculated  in  units  of  power  per  radians  per  sample.  This 
method  is  based  on  the  minimization  of  the  forward  and  backward  prediction  error  and  on  estimation  of 
the  reflection  coefficients  [122]. 

E,  Covariance  (Cov,)  autoregressive  (AR)  method 

The  covariance  autoregressive  (AR)  method  uses  the  covariance  algorithm  to  estimate  the 
parametric  spectral  density  of  the  signal,  x.  Based  on  causal  observation  of  the  input  signal,  the 
covariance  method  minimizes  the  forward  prediction  error  and  fits  an  AR  linear  prediction  filter  model 
to  the  signal  [122]. 

F,  Modified  covariance  (Mcov,)  autoregressive  (AR)  method 

Modified  covariance  autoregressive  (AR)  method  estimates  the  PSD  of  the  signal  using  the 
modified  covariance  method.  Based  on  the  causal  information  of  the  input  signal,  the  modified 
covariance  method  fits  an  autoregressive  (AR)  linear  prediction  filter  model  to  the  signal  by 
simultaneously  minimizing  the  forward  and  backward  prediction  errors.  The  spectral  estimate  returned 
by  this  method  is  the  magnitude  squared  frequency  response  of  the  AR  model  [122]. 


G.  Multiple  Signal  Classification  (MUSIC)  spectral  estimation  method 

The  MUSIC  algorithm  estimates  the  pseudospectrum  (in  rad/sample)  at  the  corresponding 
vector  of  frequencies  for  the  input  signal  x  [122].  This  algorithm  uses  the  estimates  of  the  eigenvectors 
of  a  correlation  matrix  associated  with  the  input  signal  using  Schmidt's  eigenspace  analysis  method 
[123].  The  MUSIC  pseudospectrum  estimate  is  given  by  Equation  (41), 

where  N  is  the  dimension  of  the  eigenvectors  and  is  the  /c-th  eigenvector  of  the  correlation  matrix 
[122].  The  signal  subspace  has  a  dimension  p  and  the  eigenvectors  used  in  the  sum  corresponds  to 
the  smallest  eigenvalues  and  also  spans  the  noise  subspace  [122].  The  vector  e(/)  consists  of  the 
complex  exponentials,  so  the  inner  product  vj^e(f)  amounts  to  a  Fourier  transform.  To  estimates  the 
pseudospectrum,  the  squared  magnitudes  are  summed  for  FFT  computed  for  each  Vj^  [122]. 
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H,  Eigenvector  (EIG)  spectral  estimation  method 

The  eigenvector  spectral  estimation  method  estimates  the  pseudo  spectrum  (in  rad/sample)  at 
the  corresponding  vector  of  frequencies  using  estimates  of  the  eigenvectors  of  a  correlation  matrix 
associated  with  the  input  signal  x  [122].  This  method  estimates  the  pseudospectrum  from  a  signal  or  a 
correlation  matrix  using  a  weighted  version  of  the  MUSIC  algorithm  derived  from  Schmidt's 
eigenspace  analysis  method  [123],  [124].  To  find  the  frequency  content  of  the  signal  the  algorithm 
performs  eigenspace  analysis  of  the  signal's  correlation  matrix.  Singular  value  decomposition  is  used  to 
compute  the  eigenvalues  and  eigenvectors  of  the  signal's  correlation  matrix  [122].  This  method 
computes  the  pseudospectrum  estimate  as  given  by  Equation  (42). 


Pevif)  = 


(42) 


where  the  eigenvectors  have  a  dimension  of  N  and  is  the  /c-th  eigenvector  of  the  correlation  matrix 
[122].  The  signal  subspace  has  a  dimension  p  and  the  eigenvectors  Vj^  used  in  the  sum  corresponds  to 
the  smallest  eigenvalues  and  also  spans  the  noise  subspace  [122].  The  vector  e(/)  consists  of  the 
complex  exponentials,  so  the  inner  product  amounts  to  a  Fourier  transform  and  to  estimate  the 

pseudospectrum,  the  squared  magnitudes  are  summed  for  EFT  computed  for  each  Vj^  [122]. 


/.  Selection  of  Model  Orders  for  Model-Based  and  Eigenvector  Based  Methods 

Model-based  and  eigenvector-based  methods  need  to  have  a  specific  model  order  which  is  an 
important  aspect  of  the  use  in  these  methods.  Using  sEMG  and  force  data  as  input  and  outputs  for  three 
and  five  sets  of  the  segments  for  different  data  sets,  we  created  model  structure  matrices  using  ‘struc’ 
function  in  MATFAB®,  using  ‘arxstruc’  we  compared  a  model  order  of  1  to  50^^  with  varying  delay  of 
1  to  50  using  cross-validation  on  the  second  half  of  the  data  set.  With  this  approach,  it  was  possible  to 
select  the  order  that  gives  the  best  fit  for  the  validation  data  set. 


Results  and  Discussion 

sEMG  signal  changes  as  a  consequence  of  muscle-fatigue,  the  amplitude  of  the  PSD  of  the 
signal  increases  and  the  median  frequency  shifts  towards  the  lower  frequency  range.  In  this  study, 
PSDs  of  the  different  segments  of  each  sEMG  data  set  were  obtained  using  FFT,  Welch’s  averaged 
modified  periodogram,  Yule-Walker,  Burg,  Covariance,  Modified  Covariance  autoregressive  (AR), 
Multiple  Signal  Classification  (MUSIC),  and  Eigenvector  spectral  estimation  methods.  The  objective 
of  this  study  was  to  determine  preferred  methods  of  signal  processing  that  elevates  the  sensitivity  of 
muscle- fatigue  as  represented  in  the  PSD  of  the  sEMG  signal.  An  increased  sensitivity  allows  for  better 
modeling  of  the  fatigue  phenomena  and  hence  more  accurate  sEMG  models.  Ultimately  this  may  lead 
to  better  prosthetic  control. 

Data  of  two  experiments  for  dynamic  force  variations  was  segmented  in  three  and  five  parts 
respectively.  Each  segment  is  with  an  overlap  of  75%  with  its  adjacent  segment.  Using  different 
methods,  we  computed  the  PSDs  for  each  segment.  For  the  dynamic  force  experiments,  the  maximum 
value  of  PSDs  of  sEMG  signal  increases  with  muscle-fatigue  as  time  or  segment  number  is  increased. 
The  classical  methods  (FFT  and  Welch)  and  eigenvector  based  methods  (MUSIC  and  Eigenvector 
(EIG.))  are  representing  this  change  well  in  case  of  maximum  PSD  values  and  show  a  clear  difference. 

Table  2.10  lists  the  peak  values  of  the  PSDs  of  five  segments  using  classical  and  eigenvector 
based  methods  for  a  dynamically  varying  force  experiment.  Figure  2.57  shows  the  overlapping  plot  of 
PSDs  for  five  segments  using  the  MUSIC  algorithm  based  spectral  estimation  method.  The  increase  in 
the  maximum  PSD  value  is  evident  from  the  1  st  to  the  5th  segment  of  the  data. 


Table  2.10:  Maximum  Value  of  PSD  for  Classical  Methods  and  Eigenvector  Based  Methods  - 
Dynamic  Varying  Force  -  Experiment  2  (lEEE-CDC  2011) 


Segment  No. 

Classical-Methods 

Eigenvector-Methods 

FFT 

Welch 

MUSIC 

EIG 

1st 

4.1e+6 

0.0082 

371.59 

1.0819 

2nd 

5.09e+6 

0.0100 

424.43 

1.3892 

3rd 

5.74e+6 

0.0111 

480.71 

1.4132 

qth 

6.79e+6 

0.0133 

508.64 

1.4936 

5* 

2.13e+7 

0.0379 

695.08 

10.2118 
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MUSIC  -  Dynamic  Force  -  Experiment  2 
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Figure  2.57:  PSD  vs.  frequency  plot  for  MUSIC  algorithm  -  dynamic  force  experiment. 


Burg  -  Dynamic  Force  -  Exp88 


Figure  2.58:  PSD  vs.  frequency  plot  for  Burg  method  -  dynamic  force  experiment. 

Figure  2.58  shows  the  resulting  PSD  using  the  Burg  method.  Comparing  Figs.  63  and  64,  the 
progression  of  fatigue  influence  shift  in  PSDs  is  evident  in  both  plots.  However,  the  MUSIC  algorithm 
not  only  shows  larger  amplitudes,  but  also  a  greater  relative  sensitivity  to  fatigue.  The  rather  equal 
spacing  between  the  lines  of  the  PSD  for  the  MUSIC  algorithm  compared  to  the  Burg  method  indicates 
a  rather  more  linear  relationship  of  the  fatigue  progression. 

sEMG  data  of  two  experiments  for  static  force  (50  pounds)  were  processed  and  the  maximum 
PSDs  of  five  segments  using  classical,  model-based,  and  eigenvector  based  methods  were  computed. 
Data  from  both  the  experiments  show  similar  results  as  the  dynamic  case.  Table  2.11  lists  the  peak 
values  of  the  PSDs  of  five  segments  using  classical  and  eigenvector  based  methods  for  static  force  (50 
pounds)  for  one  experiment.  Table  2.12  lists  the  maximum  values  of  the  PSD  for  model-based 
methods:  Y-W,  Burg,  Covariance,  and  modified  covariance. 

Table  2.11:  Maximum  Value  of  PSD  for  Classical  Methods  -  Static  Force  -  50  Pounds  -  Experiment  1 

(lEEE-CDC  2011) 


Segment 

No. 

Classical-Methods 

Eigenvector- 

Methods 

FFT 

Welch 

MUSIC  EIG 

1st 

1.03e+5 

6.81e-5 

1413  9.93e-4 
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2nd 

1.80e+5 

1.12e-4 

1793 

16e-4 

3rd 

3.21e+5 

1.80e-4 

2296 

28e-4 

qth 

4.25e+5 

2.62e-4 

3102 

37e-4 

5th 

6.23e+5 

3.58e-4 

7723 

104e-4 

Table  2.12:  Maximum  Value  of  PSD  for  Classical  Methods  -  Static  Force  -  50  Pounds  -  Experiment  1 

(lEEE-CDC  2011) 


Segment 

No. 

1st 

2nd 

3rd 

qth 

5th 

Model- 

Based 

Methods 

7.7e-7 

1.3e-6 

2.3e-6 

3.1e-6 

7.81-6 

All  of  these  methods  resulted  in  the  same  maximum  values  for  each  segment.  Comparing 
Table  2.11  and  XII,  we  recognize  the  large  difference  in  maximum  value  between  the  model-based 
methods  and  the  corresponding  values  from  the  FFT  and  MUSIC  method.  Figure  2.59  shows  the 
overlapping  plot  of  PSDs  for  five  parts  using  eigenvector  algorithm  based  spectral  estimation  method. 
The  increase  in  the  maximum  PSD  value  is  evident  from  the  to  the  5^^  segment  of  the  static  force 
sEMG  data. 


Eig  -  Static  Force  50  Pounds  -  Experiment  1 
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Figure  2.59:  PSD  vs.  frequency  plot  for  Eigenvector  method  -  static  force  of  50  pounds. 

The  eigenvector  method  produces  a  similar  characteristic  as  the  MUSIC  algorithm  and 
distinguishes  itself  by  also  providing  a  more  linear  characteristic  of  the  fatigue  progression  and  a 
greater  relative  sensitivity.  Figure  2.60  depicts  the  PSD  generated  by  using  FFT  method  for  the  and 
5^^  segments  of  a  static  force  experiment.  While  providing  a  large  maximum  value,  the  FFT  method  is 
limited  by  its  own  spectral  resolution  (1/A^)  and,  due  to  windowing  of  the  finite  data  set,  results  into 
spectral  leaking. 

All  the  model-based  methods  for  both  dynamic  and  static  force  levels  produce  the  same  peak 
values  and  the  same  PSD  for  the  corresponding  experiment.  Since  Burg  and  Y-W  methods  guarantee 
stability  while  the  covariance  and  modified  covariance  methods  have  conditions  for  stability  to  be 
satisfied  (i.e.  min.  order  must  be  of  certain  length  of  the  input  frame  size).  Burg  and  Y-W  should  be  the 
preferred  methods  for  sEMG  analysis.  However,  the  Burg  method  is  to  be  preferred  if  short  data  sets 
are  used. 
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FFT  -  Static  Force  -  50  Pounds  -  1st  and  5th  Segment  -  Exp33 


Frequency  (Hz) 


Figure  2.60:  PSD  vs.  frequency  plot  for  FFT  method  -  static  force  of  50  pounds. 

Comparing  the  eigenvector  based  methods  (MUSIC  and  Eigenvector),  both  of  these  methods 
are  frequency  estimator  techniques  based  on  eigenanalysis  of  the  autocorrelation  matrix  where  the 
resulting  estimate  has  sharp  peaks  at  the  frequencies  of  interest.  The  eigenvector  method  uses  inverse 
eigenvector  weighting  whereas  the  MUSIC  method  uses  unity  weighting,  implying  that  the  eigenvector 
method  gives  fewer  spurious  peaks  than  the  MUSIC  algorithm  [125].  As  seen  from  the  dynamic 
experiment  results,  the  MUSIC  method  provides  for  a  better  spacing  between  the  segments  based  PSDs 
compared  to  the  Burg  and  eigenvector  method.  From  static  experiments,  we  conclude  that  all  three 
(MUSIC,  Burg,  and  Eigenvector)  methods  perform  similarly  if  a  linear  relationship  of  the  fatigue 
progression  is  desired. 

This  research  characterizes  muscle-fatigue  using  a  PSD  representation  of  different  segments 
of  sEMG  data.  Classical  (fast  Fourier  transform  and  Welch’s  averaged  modified  periodogram),  model- 
based  (Y-W,  Burg,  Cov.,  and  Mcov.  autoregressive  (AR)  method)  and  eigenvector  based  methods 
(MUSIC  and  EIG.  spectral  estimation  method)  are  used  to  compute  the  PSDs.  Classical  and 
eigenvector  based  methods  are  more  sensitive  than  the  model-based  methods  for  analyzing  the  fatigue 
related  changes  in  the  sEMG  signal.  However,  the  MUSIC  algorithm  provides  good  maximum  value  in 
the  PSD  as  well  as  a  clear  distinction  between  the  segmented  sEMG  data.  The  latter  point  is  indicative 
of  a  relative  linear  fatigue  progression  in  time  for  the  same  case  when  the  MUSIC  algorithm  is  utilized. 
In  the  future  work  these  results  can  be  used  to  design  and  improve  the  skeletal-muscle  ‘Force-sEMG- 
Fatigue’  based  models  [108]  for  prosthetic  design  and  other  rehabilitation  research. 

2.4  Hand  Finger  Motion 


2.4.1  A  Novel  Adaptive  Hybrid  Finger  Angle  Estimation  from  sEMG  Data  with  Multiple  Linear 

and  Nonlinear  Model  Data  Fusion 


This  section  presents  a  novel  approach  to  estimate  the  finger  joint- angles  for  smart  prosthetic 
control  using  surface  electromyographic  (sEMG)  signals.  All  currently  available  prostheses  use  a 
motion  control  strategy  that  utilizes  pre-programmed  commands  upon  reaching  some  threshold  value 
of  the  measured  sEMG  signal  for  a  particular  motion  set.  In  this  work  we  use  a  novel  approach  to 
model  the  finger  joint-angle  with  the  help  of  System  Identification  (SI)  techniques.  The  dynamic  model 
obtained  allows  the  instantaneous  control  of  the  finger  motions.  sEMG  data  is  acquired  using  an  array 
of  nine  sensors  and  the  corresponding  finger  angle  data  is  acquired  using  a  finger  angle  measuring 
device  and  a  data  glove.  A  nonlinear  Teager-Kaiser  Energy  (TKE)  operator  based  nonlinear  spatial 
filter  is  used  to  filter  sEMG  data  whereas  the  angle  data  is  filtered  using  a  Chebyshev  Type-II  filters. 
The  filtered  signals  are  resampled  and  smoothed  using  a  smoothing  spline  curve  fitting  method.  Using 
SI  techniques,  a  set  of  linear  and  nonlinear  models  are  obtained  with  the  smoothed  sEMG  data  as  input 
and  the  respective  smoothed  finger  angle  data  as  output.  An  adaptive  probabilistic  Kullback 
Information  Criterion  (KIC)  based  data  fusion  algorithm  is  applied  to  the  outputs  of  the  linear  and 
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nonlinear  models  to  aehieve  better  estimates  of  the  finger  angles.  The  resulting  adaptive  fusion  based 
output  of  this  approaeh  gives  improved  estimates  of  the  finger  joint- angles. 

Present  researeh  foeuses  on  the  dynamie  modeling  and  estimation  of  the  angles  of  the 
proximal  interphalangeal  (PIP)  joint  of  the  index  and  the  middle  finger  with  the  eorresponding  sEMG 
signal.  Two  different  systems  and  experiment  designs  are  used  to  aequire  the  data  for  the  index  and 
middle  finger  angles  and  the  eorresponding  sEMG  signals.  For  the  index  finger  data  an  array  of  nine 
sEMG  sensors  is  used  to  reeord  sEMG  signals  and  joint-angles  are  reeorded  using  a  wheel 
potentiometer  from  the  arm  of  a  healthy  subjeet.  For  the  middle  finger  data  an  array  of  three  sensors  is 
used  to  reeord  sEMG  signals  and  joint-angles  are  reeorded  using  a  NODNA  X-IST  DataGlove.  Both 
experiment  designs  are  explained  in  the  following  seetion.  Both  signals  are  filtered  and  smoothing- 
spline-eurve  fitted  with  0.993  as  smoothing  parameter.  The  dynamie  modeling  is  aehieved  using 
System  Identifieation  (SI)  where  smoothed  sEMG  data  is  the  input  and  the  smoothed  joint- angle  data  is 
the  output.  Multiple  linear  and  nonlinear  models  are  obtained.  To  aehieve  better  estimate  of  the  finger 
angles,  an  adaptive  probabilistie  Kullbaek  Information  Criterion  (KIC)  for  model  seleetion  based  data 
fusion  algorithm  is  applied  to  the  linear  and  nonlinear  models  outputs.  In  all  the  eases,  the  final  fusion 
based  output  of  this  approaeh  results  in  improved  estimates  of  finger  angles. 

Experiment  Design 

A.  First  Experiment  Design 

The  first  experiment  design  is  designed  to  simultaneously  aequire  the  sEMG  from  the  motor 
point  of  the  flexor  digitorum  superfieialis  (EDS)  of  the  index  finger  and  the  joint- angle  of  the  PIP  joint 
of  the  finger.  The  motor  point  was  identified  by  the  use  of  a  wet  probe  musele  stimulator  at  the  EDS 
(RICH-MAR,  HV  1000).  Nine  DE-3.1  sEMG  sensors  of  the  DEESYS®  Bagnoli-16  EMG  system  are 
plaeed  in  a  three-by- three  array  [113];  the  arrangement  eovers  the  four  direetional  spatial  distributions 
of  the  sEMG  signal.  The  middle  three  sEMG  sensors  were  attaehed  direetly  on  the  skin  surfaee  above 
the  motor  point  of  the  index  finger  of  a  healthy  subjeet.  Using  a  lOk-Q  wheel  potentiometer,  an  angle 
measurement  deviee  is  designed  to  measure  the  joint-angles  of  the  PIP  joint  of  the  index  finger  of  a 
healthy  subjeet.  An  Interlink™  Eleetronies  FSR  0.5”  eireular  foree  sensor  on  a  stress  ball  is  used  to 
press  with  the  movement  to  introduee  some  resistanee  to  the  movement  of  the  PIP  joint  of  the  index 
finger. 


Figure  2.61:  First  experiment  design. 

Experiment  design  is  shown  in  Figure  2.61.  Here  nine  sensors  are  shown  on  a  healthy  subjeet 
forearm,  with  an  angle  measurement  deviee  on  the  PIP  joint  of  the  index  finger  and  having  a  stress  ball 
for  foree  measurements.  The  various  signals  are  sampled  at  a  rate  of  2000  Hz  using  EabVIEW™  in 
eonjunetion  with  DEESYS®  Bagnoli-16  EMG  and  NI  EEVIS™. 


B.  Second  Experiment  Design 

For  the  seeond  experiment  design  different  sEMG  sensors  and  angle  measuring  DataGlove 
was  used.  In  this  ease  the  PIP  joint-angle  of  the  middle  finger  was  aequired  using  a  NODNA  X-IST 
DataGlove.  The  sEMG  system  is  a  NORAXON  MyoSystem  2000  and  sEMG  eleetrodes  are  dual 
eleetrodes  whieh  are  disposable,  self-adhesive  Ag/AgCl  dual  snap  eleetrodes  for  surfaee  EMG 
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applications.  Data  acquisition  rate  for  the  sEMG  is  1000  Hz  and  for  the  eorresponding  angle  data  on 
the  DataGlove  is  60-62  Hz.  Several  experiments  were  eondueted  with  sEMG  sensors  on  the  extensor 
and  flexion  side  or  the  arm.  In  this  work  the  data  eaptured  from  the  flexion  side  is  used  for  the 
simulations.  The  experiment  design  is  given  in  Figure  2.62. 


Figure  2.62:  Seeond  experiment  design. 


Prior  to  plaeing  sEMG  sensors,  the  skin  surfaee  of  the  subjeet  was  prepared  aeeording  to 
International  Soeiety  of  Eleetrophysiology  and  Kinesiology  (ISEK)  protoeols  [119].  With  these  set-ups 
we  eondueted  several  experiments  of  30  seeonds,  45  seeonds  and  60  seeonds  durations. 


Signal  Pre-Processing 

The  reeorded  sEMG  signal  for  the  index  finger  is  filtered  using  nonlinear  spatial  filtering 
using  the  “Nonlinear  Teager-Kaiser  Energy  (TKE)  Operator,”  [113].  Equation  (43)  gives  the  TKE 
operator  in  the  time  domain  of  the  sEMG  signal  [113]. 

W[x(ri)]  =  x^2  (n)  -  x(n  -hi)*  x(n  -  1).  (43) 

Here,  W  is  the  TKE  operator  and  x(n)  is  the  time  domain  sEMG  signal  at  loeation  n.  Data  from  first 
experiment  design  was  filtered  with  four-direetional  spatial  filter  whereas  the  data  from  the  seeond 
experiment  design  is  filtered  with  one-direetional  spatial  filter.  Both  of  the  filters,  the  one-direetional 
and  the  four-direetional  nonlinear  spatial  filters,  ean  be  derived  from  the  TKE  operator.  Equations  (44) 
and  (45)  give  the  one-direetional  and  four-direetional  nonlinear  spatial  filters,  respeetively. 

^d,i  [x(jn,  n)]  =  x^  (m,  n)  —  x(m  —  1,  n)  *  x(m  -h  1,  ri).  (44) 

[x(jn,  ri)]  =  4  *  (m,  n)  —  x(m  —  1,  n)  *  x(m  +  l,n)  —  x(m,  n  —  1)  *  x(m,  n  +  1)  —  x(m  — 

1,  n  -h  1)  *  x(jn  -h  1,  n  —  1)  —  x(m  —  1,  n  —  1)  *  x(m  -h  1,  n  -h  1).  (45) 

Figs.  2.63  and  2.65  show  the  eomparison  between  the  measured  and  four  and  one  direetional 
nonlinear  spatial  filtered  sEMG  signals  from  the  first  and  seeond  experiment  designs,  respeetively.  A 
Chebyshev  Type  II  infinite  impulse  response  (HR)  low  pass  filter  with  a  550  Hz  pass  band  frequeney  is 
used  to  filter  the  PIP  joint-angle  data  for  both  first  and  seeond  experimental  data  sets.  Figs.  2.64  and 
2.66  show  the  eomparison  between  the  measured  and  Chebyshev  Type  II  filtered  PIP  joint- angle  data 
for  first  and  seeond  experimental  data  sets  respeetively. 
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Index  Finger  Raw  sEMG  at  Motor  Point 


4-Directional  Spatially  Filtered  9-sEMG  Sensor  Array  Signal 


Figure  2.63:  Raw  and  spatially  filtered  sEMG  signal  from  Index  finger  -  first  experiment  design. 

Measured  Angle  Theta  -  Index  Finger 


Figure  2.64:  Raw  and  Chebyshev  Type  II  filtered  PIP  joint-angle  for  Index  finger  -  first  experiment 

design. 


Raw  sEMG  Data  -  Motor  Point  -  Middle  Einger 


1 -Directional  Spatial  Filter  sEMG  Sensor  Array  Data 


Figure  2.65:  Raw  and  spatially  filtered  sEMG  signal  from  Index  finger  -  seeond  experiment  design. 
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Raw  Angle  Data  -  Middle  Finger  PIP  Joint 


Chebyshev  Type  II  Filtered  Angle  Data  -  Middle  Finger  PIP  Joint 


Time 

Figure  2.66:  Raw  and  Chebyshev  Type  II  filtered  PIP  joint-angle  for  Index  finger  -  seeond  experiment 

design. 


Smoothing  Spline  Curve  Fitting 

The  input  and  output  data  from  both  the  experiment  designs  i.e.  the  first  and  the  seeond  are 
fitted  with  a  smoothing  spline  whieh  is  a  pieeewise  polynomial  eomputed  from  a  smoothing  parameter 
(p)  of  0.993.  Smoothing  spline  ean  be  ehanged  by  ehanging  the  smoothing  parameter  (p)  whieh  is  a 
number  between  0  and  1.  For  p  =  0  the  smoothing  spline  is  a  least-square  straight-line  approximation 
to  the  data,  whereas  for  p  =  1  it  gives  the  "natural"  eubie  spline  interpolant  to  the  data  [117]. 

For  the  speeified  weight  (Wj)  and  smoothing  parameter  (p),  a  smoothing  spline  s  is  formed 
that  minimizes  the  parameter  J  given  by  Equation  (46). 

y  =  P Xi  Wiiyi  -  s(Xi))^  +  (1  -  p)  / (46) 

where  Xj  and  are  predietor  and  response  data  respeetively. 

The  smoothing  parameter  p  should  be  ehosen  to  make  the  error  F  (5)  =  Hi  Wj(yj  —  5(Xi))^ 

cL^  s 

and  roughness  J (— )^dx  small.  Here  in  this  work  the  smoothing  parameter  p  is  ehosen  as  0.993  [117]. 

System  Identification 

System  Identifieation  (SI)  is  a  tool  to  model  a  dynamie  system  based  on  input-output  data 
[110].  In  this  researeh,  we  use  SI  to  model  two  sets  of  signals  from  two  different  experiment  designs 
whieh  are  smoothing- spline-eurve  fitted.  For  both  the  experimental  data  the  sEMG  is  the  input  to  the 
system  and  the  intended  PIP  joint- angle  is  the  output.  PIP  joint- angle  data  from  the  index  and  the 
middle  finger  are  proeessed  with  the  eorresponding  sEMG  signals.  Multiple  linear  and  nonlinear 
models  are  obtained  for  modeling  of  sEMG  and  PIP  joint-angle  signals  of  the  dominant  hand  of  a 
healthy  subjeet.  For  the  data  from  the  first  experiment  design,  five  linear  and  three  nonlinear  models 
are  obtained  for  the  input  and  output  data  set.  For  the  data  from  the  seeond  experiment  design,  six 
linear  and  six  nonlinear  models  are  obtained.  Tables  XIII  and  XIV  give  the  struetures  of  the  linear  and 
nonlinear  models,  respeetively. 

For  the  data  from  the  first  experiment  design,  the  model  order  of  the  various  models  used  are 
as  follows:  linear  models  for  the  input  and  output  data  set,  OE  model  of  order  16,  ARX  model  of  order 
18,  ARMAX  model  of  order  16,  state-spaee  model  with  subspaee  method  (N4SID)  of  order  18  and  a 
State-Spaee  model  with  predietion  error/maximum  likelihood  method  (PEM)  of  order  12  are  obtained 
using  SI.  For  the  data  from  the  seeond  experiment  design,  the  model  order  of  the  various  models  used 
are  as  follows:  linear  models  for  the  input  and  output  data  set,  OE  model  of  order  46,  ARX  model  of 
order  73,  ARMAX  model  of  order  36,  Box-Jenkins  model  of  order  12,  state-spaee  model  with  subspaee 
method  (N4SID)  of  order  40  and  a  state-spaee  model  with  predietion  error/maximum  likelihood 
method  (PEM)  of  order  40  are  obtained  using  SI. 

Table  2.13  gives  the  strueture  of  all  the  linear  models.  In  Table  2.13,  y  is  output,  t  is  diserete 
time,  B(q),  F(q),  A^q),  C(q),  F(q),  are  polynomials,  q  is  a  baekward  shift  operator,  u  is  input,  is 
delay  and  e  is  error  [104].  For  State-Spaee  models:-  x  is  state,  t  is  diserete  time,  75  is  sampling  time,  u 
is  input,  e  is  qyyoy,  A,B,K,C,  andF  are  system  matriees,  and  y  is  output  [104].  Table  2.14  gives  the 
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structures  of  nonlinear  models.  The  nonlinear  models  for  the  input  and  output  data  set  from  the  first 
experiment  design  are  obtained  as,  the  nonlinear  Hammer  stein- Wiener  models  with  nonlinearity 
estimators  of ‘pieeewise  linear -pwlinear,’  ‘sigmoidnet,’  and  ‘wavelet  network.’ 


_ Table  2.13:  Linear  Models  and  Their  Struetures  (lEEE-TBE  2011) 

Linear  Model  Name  Linear  Model  Strueture 


Output  Error 

ARX 
ARM  AX 


Box-Jenkins 

State- Spaee  - 
subspaee  method 


y(0  =  ~  ’^k)  +  e(t) 

A(q)y(.t)  =  Biq)uit  -  rik)  +  e(t) 
A{q)y(t)  =  B(q)u(t  -  n^)  + 


y(0  =  g|K(t- 


C(q)e(t) 

■  rife)  +  ^^e(t) 

D(q)  ^  ^ 


x(t  +  Ts)  =  Ax(t)  +  Bu(t)  +  Ke(t) 
y(t)  =  Cx(t)  +  Du(t)  +  e(t) 


State-Spaee  -  predietion  x(t  +  Ts)  =  Ax(t)  +  Bu(t)  +  Ke(t) 

error/maximum  y(t)  =  Cx(t)  +  Du(t)  +  e(t) 

likelihood 
method 


The  nonlinear  models  for  the  input  and  output  data  set  from  the  seeond  experiment  design  are 
obtained  as,  the  nonlinear  ARX  models  with  nonlinearity  estimators  of  ‘wavelet  network,’  and  ‘tree 
partition,’  the  nonlinear  Hammerstein- Wiener  models  with  nonlinearity  estimators  of  ‘pieeewise  linear 
-  pwlinear,’  ‘sigmoidnet,’  ‘deadzone,’  and  ‘wavelet  network.’  In  Table  2.14,  for  the  nonlinear  ARX 
model  with  wavelet  network  as  nonlinearity  estimator,  k(s)  as  a  wavelet  funetion,  and  is  a  row 
veetor  sueh  that  (x  —  is  a,  sealar.  For  the  nonlinear  ARX  model  with  the  nonlinear  estimator  as 
‘treepartition,’  the  output  y  is  a  nonlinear  funetion,  where  F  is  pieeewise  linear  (affine)  funetion  of  x,  y 
is  sealer,  and  x  is  a  l-by-m  veetor.  F  is  a  loeal  linear  mapping,  where  x -spaee  partitioning  is 
determined  by  a  binary  tree.  In  F,  L  is  l-by-m  veetor,  Q  is  l-by-(?n  +  1)  veetor  and  d  is  sealar  [104]. 


Table  2.14:  Nonlinear  Models  and  Their  Struetures  (lEEE-TBE  2011) 


Nonlinear 

Model  Name 

Nonlinear  Model  Strueture 

Nonlinear  ARX  - 

n 

Wavelet  Network 

aM  =  2_^  -  Kfc)) 

Nonlinear  ARX  - 

k=l 

y  =  F(x) 

Tree-partition 

F(x)  =  X  *  L  +  [1,  x]  *  Ca  +  d 

Nonlinear  HW  - 

w(t)  =  /(u(t)), 

Pieeewise  Einear  - 

Pwlinear 

x(t)  -  J  wit), 

y(t)  =  /i(x(t)); 

Nonlinear  HW  - 

yp(0  =  /(y(t  -  i).y(t  -  2),y(t  -  3), ... 

Sigmoidnet 

u{t  —  l),w(t  —  2), ...); 

sigmoid  funetion. 

Nonlinear  HW  - 

y  =  F(x)  ; 

Deadzone 

a  <  X  <  b,  F(x)  =  0 

X  <  a,  F(x)  =  X  —  a 

X  >  b,  F(x)  =  X  —  b 

Nonlinear  HW  - 

n 

Wavelet  Network 

dM=  2_,  -  Kfc)) 

k=l 
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For  the  Hammer  stein- Wiener  model,  u(t)  and  y(t)  are  the  inputs  and  outputs  for  the  system, 
respeetively.  /  and  h  are  nonlinear  funetions  that  eorresponds  to  the  input  and  output  nonlinearity, 
respeetively.  w(t)  andx(t)  are  internal  variables.  w(t)  has  the  same  dimension  as  u(t).  x(t)  has  the 
same  dimension  as  y(t).  B(q)  and  F(q)  in  the  linear  dynamie  bloek  are  polynomials  in  the  baekward 
shift  operator.  For  the  nonlinear  Hammerstein- Wiener  model  with  nonlinear  estimator  as  ‘sigmoidnet,’ 
/(z)  is  the  sigmoid  funetion  [104].  The  nonlinear  Hammerstein- Wiener  model  with  nonlinear 
estimator  as  ‘deadzone,’  defines  a  nonlinear  funetion  y,  where  F  is  a  funetion  of  x,  and,  y  andx  are 
sealars  [104].  For  the  nonlinear  Hammer  stein- Wiener  model  with  wavelet  network  as  nonlinearity 
estimator,  k(s)  is  a  wavelet  funetion,  and  is  a  row  veetor  sueh  that  (x  —  is  a  sealar.  If  only 
the  input  nonlinearity  is  present,  the  model  is  ealled  the  Hammerstein  model.  If  only  the  output 
nonlinearity  is  present,  the  model  is  ealled  the  Wiener  model  [104]. 


Adaptive  Data  Fusion 

Data  fusion  of  multiple  outputs  of  the  linear  and  nonlinear  models  is  done  by  assigning  a 
partieular  probability  to  eaeh  individual  output  [105].  This  method  gives  good  estimation  of  the  PIP 
joint-angles.  The  goodness  of  the  fit  of  eaeh  linear  and  nonlinear  model  output  ean  be  eomputed  using 
SI  model  fit  value,  whieh  is  given  by  Equation  (47). 

FIT  =  [1  -  |T  -  f  \/\Y  -  F  I  ]  *  100.  (47) 

In  Equation  (47),  Y  is  measured,  F  is  estimated  and  F  is  mean  output  signal.  The  model 
seleetion  eriterion  used  in  this  seetion  is  Kullbaek  Information  Criterion  (KIC)  whieh  has  shown  to 
perform  well  for  sEMG  sensor  data  fusion  [109],  [108],  [112],  [111],  [126].  The  sum  of  two  direeted 
divergenees,  whieh  is  the  measure  of  the  models  dissimilarity,  is  known  as  Kullbaek’ s  symmetrie  or  J- 
divergenee  [106],  as  given  by  Equation  (48). 


■nrp^^^)  + g(n), 


(48) 


where  gin)  =  n*  log  and  i/)  is  known  as  digamma  funetion  which  is  logarithmie  derivative  of 
the  gamma  funetion.  xpix)  =  digammaix) 
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The  adaptive  fusion  algorithm  as  given  in  [105]  is  applied  for  data  fusion  of  the  outputs  of  the  linear 
and  nonlinear  models  obtained  using  SI: 

1)  Estimate  the  linear  and  nonlinear  models  outputs  M^,  M2, ,  M/^  for  /c  number  of  outputs. 


2)  Compute  the  residual  square  norm  Fj 
where  0i  =  and 

=  ||T 

-O;  0, 

■IP  =  111^ 

-P  IP. 

r 

4 

Yp-1 

...  ul 

0  = 

^p+i 

Up+1 

Y'r 

Ip 

..  ul 

L^n-l 

uj-i 

Y^ 

in-2 

■■  <_p 

3)  Caleulate  the  model  eriteria  eoeffieient  using  Equation  (48). 

4)  Compute  the  model  probability  p(Mj|Z)  =  where  I  is  model  seleetion  eriterion,  i.e. 

KlCipt). 


5)  Compute  the  data  fusion  based  model  output  Yf  =  Xfii  p(Mj  |Z)Fi. 

In  this  algorithm,  the  eomputation  from  step  2)  to  5)  is  adaptive  i.e.  the  residual  square  norm, 
F/C(pi),  model  probability  p(Mi|Z),  and  fused  model  output!^  are  being  updated  with  time  or  for 
eaeh  data  point. 


Results  and  Discussion 

Two  different  experiment  designs  are  designed  to  eapture  the  sEMG  and  PIP  joint-angles  of 
index  and  middle  finger.  For  the  index  finger  an  angle  measuring  deviee  was  designed  whereas  for  the 
middle  finger  a  DataGlove  was  used  to  eapture  the  joint- angle  data.  The  first  and  seeond  experiment 
designs  in  Figs.  67  and  68  are  for  the  index  and  middle  finger  experiments,  respeetively.  For  both 
eases,  sEMG  signals  from  the  sensor  array  and  angle  signals  of  PIP  joint  of  index  and  middle  finger  are 
filtered;  smoothing  spline  eurve  fitted  and  modeled  using  multiple  linear  and  nonlinear  models.  In  eaeh 
ease,  first,  the  outputs  of  linear  and  nonlinear  models  are  fused  separately  and  then  the  resultant  outputs 
are  fused  using  an  adaptive  KIC  based  probability. 
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Curve  Fitted  Angle  Vs.  Data  Fusion  Angle  Using  Linear  Models 


Figure  2.67:  Curve  fitted  vs.  adaptive  data  fusion  based  angle  using  linear  models  -  first  experiment 

design  data. 

This  approaeh  gives  improved  estimates  of  the  finger  angles  of  the  PIP  joint  of  the  index  and 
middle  finger  of  the  dominant  hand  of  a  healthy  subjeet.  Results  are  presented  in  the  following  figures. 
For  the  first  experiment  design:  Figure  2.67  shows  the  overlapping  plot  of  the  measured-eurve  fitted 
angle  vs.  adaptive  data  fusion  based  angle  using  linear  models. 


Curve  Fitted  Angle  Vs.  Data  Fusion  Using  Nonlinear  Models 


Figure  2.68:  Curve  fitted  vs.  adaptive  data  fusion  based  angle  using  nonlinear  models  -  first 

experiment  design  data. 

Figure  2.68  shows  the  overlapping  plot  of  the  measured-eurve  fitted  angle  vs.  adaptive  data 
fusion  based  angle  using  nonlinear  models.  Figure  2.69  shows  the  overlapping  plot  of  the  eurve  fitted 
angle  vs.  adaptive  data  fusion  based  angle  using  linear-nonlinear  models.  It  is  elearly  evident  to  us  that 
the  adaptive  data  fusion  based  output  follows  the  measured-eurve  fitted  output.  Standard  deviation  ean 
be  eomputed  as,  s  =  where  x  =  -  Yi=iXi  andn  is  the  number  of  elements  in 

\Y—Y\ 

the  sample.  Pereentage  error  ean  be  eomputed  using  the  formula;  %  error  =  *  100%. 


120  of  329 


Curve  Fitted  Angle  Vs.  Data  Fusion  Using  Linear  -  NL  Models 


Figure  2.69:  Curve  fitted  vs.  adaptive  data  fusion  based  angle  using  linear-nonlinear  models  -  first 

experiment  design  data. 

The  mean  value  and  the  standard  deviation  of  the  measured  angle  data  is  2.0074  and  0.0756, 
respeetively.  The  mean  value  of  the  adaptive  data  fusion  based  estimated  angle  for  linear,  nonlinear 
and  linear-nonlinear  models  eombined  is  2.0131,  2.0075  and  2.0102,  respeetively.  The  respeetive 
standard  deviations  are  0.0450,  0.0448  and  0.0467.  Mean  pereentage  error  of  the  linear,  nonlinear  and 
linear-nonlinear  models  data  fusion  based  angles  are  2.0060e-004,  2.1128e-004,  and  1.5067e-004 
respeetively.  Figure  2.70  shows  the  pereentage  error  plot  for  the  final  estimated  output  based  on  linear- 
nonlinear  models. 


Percentage  Error  -  Linear  -  Nonlinear  Model  Data  Fusion 


Time 


Figure  2.70:  Pereentage  error  plot  for  the  final  estimated  output  based  on  the  linear-nonlinear  model  - 

first  experiment  design. 
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Validation  Plot  1  -  Curve  Fitted  Angle  Vs.  Data  Fusion  Based  Angle 


Time 

Figure  2.71:  Validation  plot  -  curve  fitted  vs.  adaptive  data  fusion  based  angle  using  linear-nonlinear 

models  -  first  experiment  design  data. 

Figure  2.71  shows  the  first  validation  plot  for  a  different  experimental  data  where  the 
measured- curve  fitted  and  the  linear-nonlinear  modeled  data  fusion  based  angle  signal  shows  a  elose 
follow  up.  The  mean  value  and  the  standard  deviation  value  of  the  measure  angle  data  in  this  ease  is 
1.9655  and  0.1840,  respeetively.  The  mean  value  of  the  adaptive  data  fusion  based  estimated  angle  for 
linear,  nonlinear  and  linear-nonlinear  models  eombined  is  1.9718,  1.9729  and  1.9642,  respeetively.  The 
respeetive  standard  deviations  are  0.1767,  0.0653  and  0.1727.  Mean  pereentage  error  of  the  linear, 
nonlinear  and  linear-nonlinear  models  data  fusion  based  angles  are  2.8653e-004,  4.3135e-004,  and 
2.925  le-004  respeetively. 

Figure  2.72  shows  the  seeond  validation  plot  for  a  different  experimental  data  where  the 
measured- eurve  fitted  and  the  linear-nonlinear  modeled  data  fusion  based  angle  signal  shows  a  elose 
follow  up.  The  mean  value  and  the  standard  deviation  value  of  the  measured  angle  data  in  this  ease  is 
1.9720  and  0.1832,  respeetively.  The  mean  value  of  the  adaptive  data  fusion  based  estimated  angle  for 
linear,  nonlinear  and  linear-nonlinear  models  eombined  is  1.9767,  1.9728  and  1.9652,  respeetively.  The 
respeetive  standard  deviations  are  0.1811,  0.0677  and  0.1784.  Mean  pereentage  error  of  the  linear, 
nonlinear  and  linear-nonlinear  models  data  fusion  based  angles  are  2.4654e-004,  3. 694 le-004,  and 
2.2478e-004  respeetively. 


Validation  2  -  thetalcftout  Vs.  YHATl  -  Expt  1 1 


Figure  2.72:  Validation  plot  -  eurve  fitted  vs.  adaptive  data  fusion  based  angle  using  linear-nonlinear 

models  -  first  experiment  design  data. 

For  the  seeond  experiment  design:  Figure  2.73  shows  the  overlapping  plot  of  the  measured- 
eurve  fitted  angle  vs.  adaptive  data  fusion  based  angle  using  linear  models. 
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Q2CFT0UTVS.YHAT1 


Figure  2.73:  Curve  fitted  vs.  adaptive  data  fusion  based  angle  using  linear  models  -  seeond  experiment 

design  data. 
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Figure  2.74:  Curve  fitted  vs.  adaptive  data  fusion  based  angle  using  nonlinear  models  -  seeond 

experiment  design  data. 

Figure  2.74  shows  the  overlapping  plot  of  the  measured-eurve  fitted  angle  vs.  adaptive  data 
fusion  based  angle  using  nonlinear  models.  Figure  2.75  shows  the  overlapping  plot  of  the  eurve  fitted 
angle  vs.  adaptive  data  fusion  based  angle  using  linear-nonlinear  models.  It  is  elearly  evident  to  us  that 
the  adaptive  data  fusion  based  output  follows  the  measured-eurve  fitted  output.  The  mean  value  and  the 
standard  deviation  of  the  measured  angle  data  in  this  ease  is  627.1338  and  78.6537,  respeetively.  The 
mean  value  of  the  adaptive  data  fusion  based  estimated  angle  for  linear,  nonlinear  and  linear-nonlinear 
models  eombined  is  604.8511,  623.6136  and  615.8080,  respeetively.  The  respeetive  standard 
deviations  are  68.1358,  53.6293  and  62.4144.  Mean  pereentage  error  of  the  linear,  nonlinear  and  linear- 
nonlinear  models  data  fusion  based  angles  are  6.0430e-004,  5.3726e-004,  and  4.2376e-004 
respeetively.  Figure  2.76  shows  the  pereentage  error  plot  for  the  final  estimated  output  based  on  linear- 
nonlinear  models. 
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Figure  2.75:  Curve  fitted  vs.  adaptive  data  fusion  based  angle  using  linear-nonlinear  models  -  seeond 

experiment  design  data. 


Pereentage  Error  -  Linear-Nonlinear  Model  Data  Fusion 


Figure  2.76:  Pereentage  error  plot  for  the  final  estimated  output  based  on  the  linear-nonlinear  model  - 

seeond  experiment  design  data. 

Figure  2.77  shows  the  first  validation  plot  for  a  different  experimental  data  where  the 
measured- eurve  fitted  and  the  linear-nonlinear  modeled  data  fusion  based  angle  signal  shows  a  elose 
follow  up.  The  mean  value  and  the  standard  deviation  value  of  the  measure  angle  data  in  this  ease  is 
853.1549  and  70.7298,  respeetively.  The  mean  value  of  the  adaptive  data  fusion  based  estimated  angle 
for  linear,  nonlinear  and  linear-nonlinear  models  eombined  is  313.6785,  635.6205  and  614.6949, 
respeetively.  The  respeetive  standard  deviations  are  245.3495,  40.8147  and  76.6001.  Mean  pereentage 
error  of  the  linear,  nonlinear  and  linear-nonlinear  models  data  fusion  based  angles  are  0.0058,  0.0023 
and  0.0026,  respeetively. 
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Validation!  -  Q2^sCFTOUT  Vs.  YHATlnl  -  Validation  Plot  1 


Figure  2.77:  Validation  plot  1  -  curve  fitted  vs.  adaptive  data  fusion  based  angle  using  linear-nonlinear 

models  -  second  experiment  design  data. 


Q2^sCFT0UT  Vs.  YHATlnl  -  Validation  Plot  2 


Figure  2.78:  Validation  plot  2  -  curve  fitted  vs.  adaptive  data  fusion  based  angle  using  linear-nonlinear 

models  -  second  experiment  design  data. 

Figure  2.78  shows  a  second  validation  plot  for  a  different  experimental  data  where  the 
measured- curve  fitted  and  the  linear-nonlinear  modeled  data  fusion  based  signal  shows  a  close  follow 
up.  The  mean  value  and  the  standard  deviation  value  of  the  measure  angle  data  in  this  ease  is  602.3498 
and  75.0967,  respeetively.  The  mean  value  of  the  adaptive  data  fusion  based  estimated  angle  for  linear, 
nonlinear  and  linear-nonlinear  models  eombined  is  367.2863,  606.6189  and  599.6719,  respeetively. 
The  respeetive  standard  deviations  are  121.4799,  39.6640  and  49.22210.  Mean  pereentage  error  of  the 
linear,  nonlinear  and  linear-nonlinear  models  data  fusion  based  angles  are  0.0042,  5.9129e-004  and 
5.4813e-004,  respeetively. The  dynamie  modeling  of  the  filtered  and  smoothed  sEMG  and  PIP  joint- 
angle  of  the  index  and  middle  finger  is  aehieved  using  SI  with  sEMG  as  the  input  and  the  joint- angle  as 
the  output.  Multiple  linear  and  nonlinear  models  are  obtained  for  the  input  and  output  data.  To  aehieve 
a  better  estimate  of  the  finger  angles,  an  adaptive  probabilistie  Kullbaek  Information  Criterion  (KIC) 
for  model  seleetion  based  data  fusion  algorithm  is  applied  to  the  linear  and  nonlinear  models  outputs. 
For  both  the  eases,  the  final  adaptive  fusion  based  output  of  this  approaeh  results  in  improved  estimates 
of  PIP  joint- angles  of  the  index  and  middle  finger.  The  approaeh  is  validated  using  different  sets  of 
experimental  data.As  this  initial  study  shows  good  potential  for  eontrolling  an  artifieial  hand  in  real 
time,  we  will  implement  the  reeent  eontrol  strategies  developed  in  [107],  [127],  [128],  [129],  [107]  to 
eontrol  a  hand  prototype.  We  will  further  investigate  on  improving  the  data  eolleetion  teehniques  and 
optimizing  the  experimental  proeedure  as  well  as  optimizing  the  smoothing  parameter  for  the 
smoothing-spline-eurve  fitting. 
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Goal  2 A:  Intelligent  Control 


The  overall  research  is  accomplished  under  four  goals:  Goal  1:  EMG  Signal  Identification  and  Estimation,  Hand 
Motion  Estimation,  Goal2:  Intelligent  Control  of  Prosthetics,  Goal  3:  Robotic  Hand  and  Goal  4:  Biocompatibility 
and  Signaling.  The  schematic  diagram  of  the  proposed  work  is  shown  in  Eigure  1  (see  the  works  of  Light  et  al. 
(2002);  Rodriguez-Cheu  and  Casals  (2006);  Zhao  et  al.  (2006)).  The  overall  system,  in  brief,  consists  of 
electromyographic  (EMG)  signal  acquisition  from  user  arm  for  surface  or  implanted  electrodes  (in  the  implanted 
case  we  focus  on  biocomptibility  based  on  nano -materials  research).  The  EMG  signal  is  then  processed  for  feature 
extraction  and  classification  or  identification  of  EMG  signal  to  correspond  to  different  motions  of  the  prosthetic 
hand.  The  classified  signal  is  then  used  to  control  the  prosthetic  hand  using  actuators  and  driving  mechanisms. 


Biomatcrials  & 
Biocompatibility 


Eigure  1:  Schematic  Diagram  of  Prosthetic  Hand  Technology 


Soft  computing  (SC)  or  computational  intelligence  (Cl)  (Konar  (2005))  is  an  emerging  field  based  on  synergy  and 
seamless  integration  of  neural  networks  (NN),  fuzzy  logic  (PL)  and  genetic  algorithms  (GA)  (Karray  and  De  Silva 
(2004)).  The  previous  works  on  prosthetic  hand  used  artificial  neural  networks  by  Hudgins  (1991);  Christodooulu 
and  Pattichis  (1999);  Light  et  al.  (2002),  fuzzy  logic  by  Weir  and  Ajiboye  (2003);  Chan  et  al.  (2000);  Ajiboye  and 
Weir  (2005),  genetic  algorithms  in  (Pernandez  et  al.  (2000))  etc  mostly  for  EMG  signal  classification  for  various 
movements  or  functions  of  the  prosthetic  hand. 


Kinematics,  Dynamics  and  Control  of  Prosthetic  Hand  with  Extended  Degrees  of  Freedom 

Abstract 

It  is  obvious  to  all  that  the  human  hand  represents  a  mechanism  of  the  most  intricate  fashioning  and  one  of  great 
complexity  and  utility.  Its  ability  to  adapt  to  different  surfaces  and  shapes,  touch  and  grasp  objects  has  made  it  a 
versatile  tool.  But  beyond  this,  it  is  ultimately  correlated  with  the  brain  both  in  the  evolution  of  the  specie  and  the 
development  of  the  individual. 

In  this  report,  we  present  a  virtual  hand  that  closely  mimics  the  human  hand.  Based  on  the  anatomy  of  the  hand, 
we  designed  a  hand  with  22  degrees  of  freedom  (DOE),  with  each  of  the  carpometacarpal  joints  (CMC)  having  2 
degrees  of  freedom  each  and  metacarpal  joints  (MP)  and  inter-phalangeal  (IP)  joints  having  one  each.  The  two 
degrees  of  freedom  at  the  CMC  joints  are  non-intersecting  and  are  responsible  for  the  flexion  and  extension  (PE) 
motion  as  well  as  the  abduction  and  adduction  motion..  It  is  important  to  note  that  because  of  the  constraint  in  the 
range  of  the  abduction  adduction  motion  in  the  index,  middle,  ring  and  small  fingers,  the  workspace  is  limited. 

In  our  approach,  the  problem  of  forward  kinematics  using  the  Denavit-Hartenberg  (D-H)  method  was  applied  to 
compute  the  position  of  the  end-effector  (fingertip)  given  the  joint  variable.  This  followed  by  the  inverse  kinematics 
which  is  a  little  more  difficult  problem.  The  inverse  kinematics  calculates  the  joint  variables  given  the  position  of 
the  hand.  Based  on  the  kinematic  structure,  a  mathematical  model  that  describes  the  dynamics  of  the  hand  was 
calculated.  These  dynamic  models  were  calculated  using  the  Lagrangian  and  Newton  Euler  formulations.  Hard 
control  strategies  such  as  feedback  linearization  and  proportional  integral  derivative  (PID)  control  were  applied  to 
control  the  hand  based  on  the  kinematic  and  dynamic  models. 


126  of  329 


1.1.  Introduction 

In  robotics  terms,  the  hand  can  be  said  to  be  the  end-effector  of  the  human  form.  Because  of  its  correlation  or 
connection  with  the  brain,  it  is  able  to  perform  tasks  like  grasping,  touching,  lifting  and  so  on.  Attempts  has  been 
made  in  the  past  by  various  researchers  to  build  a  prosthetic  hand  that  closely  mimics  the  human  hand  and  various 
propositions  has  been  made  as  to  the  numbers  of  degrees  of  freedom  the  human  hand  has.  Our  own  virtual  model  is 
a  22  degree  of  freedom  smart  prosthetic  hand  that  will  work  with  My o -electric  signals  from  the  hand  muscles. 

1.2.  Literature 

The  Human  hand  consists  of  connected  parts  composing  kinematic  chains  so  that  the  hand  is  highly  articulated. 
At  the  same  time,  many  constraints  among  fingers  and  joints  make  the  hand  motion  even  hard  to  model.  Over  the 
years,  there  has  been  an  increasing  interest  in  the  area  of  prostheses  which  lead  to  the  creation  of  various  models. 
Vardy  proposed  a  26  degree  of  freedom  (DOF)  hand  model  based  on  the  Danavit-Hartenberg  methodology  [5].  The 
model  from  [5]  is  in-complete  because  the  wrist  was  not  in-cooperated  and  the  palm  was  modeled  as  a  seven  DOFs 
articulation  whereas  in  our  model,  all  fingers  have  the  same  essential  structure,  so  that  the  D-H  methodology  is 
applied  to  all  fingers.  The  wrist  was  modeled  as  a  2  DOF  articulation  made  up  of  flexion/extension  (FE)  and 
abduction  and  abduction  motion  (AA)  motions.  We  placed  the  global  reference  frame  on  the  wrist  so  that  the 
forward  kinematics  of  the  finger-tip  frame  is  calculated  with  respect  to  the  reference  frame  at  the  base  of  the  wrist. 

In  similar  model  to  ours  is  [6],  where  the  thumb  was  modeled  as  two  DOFs  and  the  rest  of  the  fingers  3  DOFs.  In 
[6],  chen  assumed  a  serial  link  planer  manipulators  for  all  fingers. 

2.  Kinematics 

Kinetics  being  the  science  of  geometry  is  restricted  to  a  pure  geometrical  description  of  motion  by  means  of 
position,  orientation  and  their  time  derivatives  [1].  The  kinematic  study  of  manipulators  and  their  various  roles  is 
fundamental  to  the  formation  of  the  equations  of  motion  (dynamics)  and  control  of  the  manipulator.  The  manipulator 
may  be  thought  as  a  set  of  bodies  connected  in  a  chain  by  joints  [2].  However,  for  the  purpose  of  deriving  the 
kinematic  description  of  a  robot  hand,  a  link  is  considered  as  a  rigid  body  which  defines  the  relationship  between 
two  neighboring  joint  axes  of  a  manipulator.  To  develop  a  systematic  kinematic  description  and  representation  of  the 
location  of  the  arms  of  a  robot  with  respect  to  a  global  fixed  reference  frame  G,  we  utilize  the  matrix  algebra  or  the 
Clifford  algebra 

2.1  Robot  kinematics  using  matrix  algebra 

We  model  any  mechanical  system,  including  robots  as  a  series  of  rigid  link  connected  by  joints.  The  joints  restrict 
the  relative  movements  of  adjacent  links  and  are  generally  powered  and  equipped  with  sensors  to  control  the 
movements.  To  apply  number  synthesis  to  hand  mechanisms,  we  first  define  mobility  and  connectivity.  The  degrees 
of  freedom  of  a  robot  also  called  mobility  are  defined  as  the  number  of  independent  parameters  needed  to  specify 
completely  (or  within  a  finite  set)  the  position  of  everybody  in  the  system  at  the  instant  of  concern  [3].  In  order  to 
compute  the  mobility,  we  employ  the  following  version  of  Grubler’s  formula  (Hunt  1978). 


M>E^.+Zg/-6L 

(2-1) 

M'>Zg/-6L 

(2.2) 

Where; 

M  -  Mobility  of  system  with  finger  joints  free  to  move. 

M  -  Mobility  of  system  with  finger  joints  locked. 

gj  -  Degrees  of  freedom  of  motion  at  the  jth  contact  point. 

L-  Number  of  independent  loops  in  the  system 

However,  for  a  serial  robot,  the  degrees  of  freedom  are  equal  to  the  number  of  joints  multiplied  by  the  mobility 
allowed  by  each  joint.  Once  the  mobility  is  defined  and  the  active  joints  of  the  hand  identified,  the  two  main 
problems  of  kinematic  analysis  of  robot  are  forward  kinematics  and  inverse  kinematics.  In  the  forward  kinematics 
also  known  as  direct  kinematics,  we  define  the  position  of  the  end-effector  as  a  matrix  which  is  a  function  of  the 
angles  or  slides  at  each  joint.  If  the  joint  angles  are  known,  the  position  of  the  end-effector  is  completely  specified. 
The  inverse  kinematic  problem  which  is  a  more  difficult  problem  is:  given  the  desired  position  and  orientation  of  the 
hand  relative  to  the  station,  how  do  we  compute  the  set  of  joint  angles  which  will  achieve  this  result  [2]. 
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The  solution  of  forward  kinematics  defines  the  workspace  of  the  individual  fingers  of  the  hand  as  well  as  the  hand 
in  general.  The  workspace  can  be  defined  as  a  set  of  all  possible  positions  of  the  end-effector  (finger-tip), 
constructed  using  all  possible  values  of  the  joint  variables  within  the  range.  Note  that  the  position  means  location 
plus  orientation;  the  workspace  of  the  robot  hand  is  a  six-dimensional  subset  of  the  six-dimensional  space  of 
rotations  and  translations. 

Several  workspace  have  been  defined  [4] 

Reachable  workspace  ( ):  Set  of  all  locations  of  the  origin  of  the  fingertip/  hand  frame  that  the  robot 
can  reach.  It  is  a  three-dimensional  subset  of  the  workspace. 

Dexterous  workspace  ( ):  Set  of  all  location  of  the  origin  of  the  end-effector  frame  that  the  robot  can 

reach  with  any  orientation.  It  is  useful  because  the  robot  has  full  dexterity  in  this  subspace,  which  ensures 
that  any  task  can  be  performed  within  it. 

Workspace  with  constant  orientation  (W^):  Set  of  all  locations  of  the  origin  of  the  finger-tip  frame  that 
the  robot  can  reach  with  a  specified  orientation  for  the  finger-tip. 


2.2  Forward  Kinematics  Equations 

Consider  a  rigid  body  with  a  fixed  reference  frame  {A}  specified  as  X,  Y  &  Z  and  another  moving  body  {B}.  A 
possible  description  of  frame  {B}  with  respect  to  frame  {A}  is  to  start  with  the  frame  coincident  with  a  known 

frame  {A}.  First  rotate  {B}  about  by  an  angle  (X  ,  then  rotate  about  by  an  angle  (5  and  then  rotate  about 

Xg  by  an  angle  y  .  In  this  representation,  each  rotation  is  performed  about  an  axis  of  the  moving  frame  {B},  rather 

than  the  fixed  reference  frame  {A}.  These  sets  of  three  rotations  are  called  Euler  angles  [2].  The  Euler  angle  rotation 
matrix  for  XYZ  axes  are  as  follows: 


R, 

Rz- 


^10  0  ^ 
=  0  cos  a  -sin  a 
^0  sin  a  cos  a  ^ 

^cos/3  0  siny^^ 
0  1  0 
^-siny^  0  cos  (5^ 
^cos^  -sin^  0^ 
sin  6  cos  6  0 

V  0  0  1, 


(2.2.1) 


(2.2.2) 


(2.2.3) 


We  can  represent  local  transformations  from  joint  to  joint  using  a  4  x  4  homogeneous  matrices.  The  composition 
of  these  displacements  is  given  as  a  result  of  the  displacement  from  the  base  to  the  end-effector.  In  order  to  create 

the  local  transformations  along  any  chain,  we  identify  the  line  locating  the  joint  axes,  S- ,  and  we  compute  the 

common  normal  line  A  ,i-i-l  between  .  We  consider  that  the  link  joining  two  consecutive  joints  extends  along 
the  common  normal  line,  regardless  of  its  real  shape. 

We  assign  local  coordinate  frames  with  the  z  axis  along  the  joints  axes  and  the  x  axis  along  the  common  normal 
line.  Local  displacements  will  take  us  from  local  coordinate  frame  to  local  coordinate  frame,  from  the  base  to  the 
end-effector. 

2.2.1  Denavit-Hartenberg  Parameters 

In  1995,  Denavit  and  Hartenberg  introduced  the  methodology  of  4  x  4  homogeneous  matrix  transformations  to 
analyze  robotic  systems,  which  became  a  standard  tool  in  robotics  [11,  12,  1].  The  shaped  the  local  transformations 
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along  the  chain  as  screw  displacements  about  z  and  x  axes,  dependent  on  only  four  parameters.  Although  a  few 
modifications  has  been  made  over  the  years.  The  D-H  notations  we  used  are  similar  to  Craig  [3]. 

We  locate  the  first  local  frame  with  the  x  axis  along  the  common  normal  Ai  .  The  origin  of  the  frame  is  located  at 

the  intersection  of  these  two  lines.  Assume  that  a  general  displacement  [G]  locates  the  first  local  frame  with  respect 
to  the  fixed  frame,  as  shown  in  fig.  2.1. 


The  second  local  frame  has  the  same  x  axis  but  now  the  z  axis  is  aligned  with  S2  ,  with  its  origin  at  the  intersection 

point  of  these  two  lines,  while  the  third  local  frame  has  same  z  axis  as  the  second  and  the  line  ^23  ^ 

the  local  frame  attached.  Two  parameters  are  needed  to  transform  from  local  fame  to  local  frame  along  links:  Link 

twist  and  link  length.  This  is  X-screw  displacements.  Link  twist,  a-_^  ■ :  This  defines  the  relative  location  of  two 

axes,  whose  common  normal  lines  are  mutually  perpendicular  and  it  is  measured  along  this  line.  Link  length,  a._^ . : 

This  is  the  distance  measured  along  a  line  that  that  is  mutually  perpendicular  (common  normal)  to  two  axes. 

Also,  links  that  are  next  to  each  other  have  a  common  joint  axis  between  them.  The  first  parameter  describes  the 

distance  along  the  common  axis  from  one  link  to  the  next.  This  parameter  is  called  the  link  offset,  d- .  A  second 
parameter  describes  the  amount  of  rotation  about  this  common  axis  between  one  link  and  the  next.  This  parameter  is 
called  joint  angle,  9-. 

The  human  hand  consists  of  connected  parts  composing  kinematical  chains  so  that  the  hand  motion  is  highly 
articulated.  Various  models  of  the  human  hand  have  been  created  with  varying  degrees  of  freedom.  The  aim  of  this 
research  is  to  obtain  a  model  that  closely  mimics  the  human  hand,  as  natural  as  possible.  The  Kinematical  scheme 
was  considered  to  be  consisting  of  22  re  volute  joints  linking  together  the  palm  and  the  phalanges  as  rigid  bodies. 
The  Denavit-Hartenberg  methodology  becomes  necessary  because  we  have  four  open-loop  kinematic  structure  and  a 
high  number  of  degree  of  freedom  (DOF). 
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2.2.2  KINEMATIC  SCHEME  OF  THE  HUMAN  HAND 

The  kinematic  scheme  of  the  human  hand  contains  the  palm  and  the  phalanges  as  rigid  bodies  linked  by  22 
revolute  joints.  The  joint  variables  for  all  the  fingers  are  ql,  q2,  q3  and  q4.  The  kinematic  chain  structure  is  the  same 
for  the  little,  ring,  middle  and  index  fingers. 


2.2.3  KINEMATIC  MODEL  OF  THE  THUMB 

The  kinematic  properties  of  the  thumb  should  mimic  those  of  a  human  thumb.  Matching  the  robotic  thumb  joints 
to  the  anatomic  thumb  joints  creates  the  proper  relative  motion  between  the  bones.  Working  from  the  wrist  up  to  the 
thumb  tip,  the  four  bones  of  the  thumb  are  the  trapezium  carpal,  the  metacarpal,  the  proximal  phalanx,  and  the  distal 
phalanx.  The  three  thumb  joints  are  named  the  carpometacarpal  (CMC),  metacarpophalangeal  (MCP),  and 
interphalangeal  (IP)  joints,  as  shown  in  fig.  1. 


CMC 


Figure  1.  Bones  and  joints  of  the  thumb  [11] 
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Based  on  the  kinematic  model  described  above  the  resulting  location  of  the  axes  within  the  thumb  bones  are  shown 
in  fig.  2. 


Fig.  2  Kinematic  Model  of  the  thumb  with  four  rotational  degrees  of  freedom  thumb.  [11] 

The  resulting  locations  of  the  axes  within  the  thumb  bones  are  shown  in  fig.  2.  The  IP  joint  FE  axis  passes 
through  the  distal  end  of  the  proximal  phalanx  and  is  not  perpendicular  to  the  sagittal  plane  of  the  thumb.  The 
flexion-extension  (FE)  and  the  adduction-abduction  (AA)  rotational  degrees  of  freedom  (DOE)  at  the  CMC  joint  are 
non-orthogonal  and  non-intersecting,  as  shown  in  figure  2.  The  EE  axis  is  fixed  relative  to  the  trapezium  bone  at  the 
base  of  the  thumb.  However,  the  anatomy  of  the  interfacing  bone  surfaces  of  the  trapezium  and  the  thumb 
metacarpal  bones  suggests  a  saddle  joint  model  with  two  axes  that  are  non-intersecting  and  non  -orthogonal  (skew) 

The  Four  degrees  of  freedom  Thumb 
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Fig. 3  Four-DOF  thumb  illustration 


Figure  1.0  shows  the  illustration  of  a  four-link  thumb.  LI,  L2,  L3,  L4  and  L5  are  the  link  lengths  of  the  respective 
links;  SI,  S2,  S3  AND  S4  are  the  joint  axis  of  the  respective  joints;  ql,  q2,  q3,  q4,  and  q5  are  the  twist  angles  of  the 
respective  joints.  The  orientation  of  the  fingertip  (end-effector),  P(x,  y)  can  be  obtained  using  the  Denavit- 
Hartenberg  Method.  The  Denavit-Hartenberg,  D-H  matrices  are  obtained  by  the  by  the  product  of  the 
transformations  from  the  origin  (fixed  frame)  to  the  various  local  frames  and  the  finger-tip  (end-effector  frame) 


Table  1.0:  DH  Parameter  Table  for  Four-link  shown  In  Figure  1.1 


Link  No. 

a  i  - 1,  i 

CXi  - 1,  i 

6i 

1 

0 

-nil 

0 

qi+  nil 
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2 

L2 

0 

0 

q2 

3 

L3 

0 

0 

q3 

4 

L4 

0 

0 

q4 

OCi  - 1,  /  :  Twist  angle  between  S  /  - 1  to  S  i 
a  /  - 1,  / :  Link  length  from  S  /  - 1  to  S  i 
d  i  :  offset 

0i  :  Joint  angle  between  Ai  -l, i  and  A /  +  l,  / 


From  the  DH  table  for  four-link  thumb  shown  in  Table  2.0,  the  transformation  matrices 
and,  can  be  written  as 


^1  0  0  0" 

0  10  0 
0  0  10 
^0  0  0  1, 

^cos(q5)  -sin(qj)  0  lijCos(^j)^ 

sin(qj)  cos(qj)  0  IijSin(g|) 

0  0  10 

^0  0  0  1  , 


^10  0  0 

0  cos(q2)  ■sin(q2)  L  005(^2) 

0  -sin(q2)  cos(q2)  ^28111(^2) 
^0  0  0  1 
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cos(q3 )  -sin(q3 )  0  ^  cos(^3 ) 

sin(q3)  cos(q3)  0  Ii3  5111(^3) 

0  0  10 

0  0  0  1 


cos(q4)  -sin(q4)  0  L'^cosC^') 
sin(q4)  cos(q4)  0  1.48111(^4) 

0  0  10 
0  0  0  1 

Here  is  the  transformation  matrix  from  thumb  local  base  frame  (zero)  to  Global  frame.  Is  the 
transformation  matrix  from  frame  1  to  base  frame  (zero),  is  the  transformation  matrix  from  frame  2  to  frame  1, 
is  the  transformation  matrix  from  frame  3  to  frame  2  and  is  the  transformation  matrix  from  frame  4  to 
frame  3.  The  transformation  matrix  from  thumb  local  frame  4  to  global  frame  can  be  written  as 

Grrit  _  Grr^t  Orrft  \r-pt  2nnt  3rjlt 

2.2.4  The  Four  degrees  of  freedom  Index  finger 

The  Index,  the  middle,  the  ring  and  the  little  fingers  can  be  considered  to  be  made  up  of  four  links  as  against  the 
human  hand  configuration  which  is  made  up  of  three  links  and  three  bones  (Metacarpal  phalangeal  MP,  Proximal 
interphalangeal  and  Distal  interphalangeal). 


X 


Fig.  4  Configuration  of  the  joints  of  the  index  finger 

The  coordinate  of  the  fingertip,  P\X\Y^)  and  the  orientation  (j/  of  the  thumb  finger  (t)  can  be  written  as 


X  ^^(^123  )  ^4^(^1234  ) 

Y  —  )  +  Z^rS’(^^2)  ^^(^123)  ^^^(^1234) 
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4>  -  +  ^2  +  ^3  +  ^4 


The  Homogeneous  transformation  matrix  to  transform  the  thumb  Local  coordinate  frame  base  JCq  —  Jq  —  Zq 

G  G  G 

to  the  global  frame  X  —  y  —  Z  is  expressed  as  a  product  of  two  basic  homogeneous 
transformations  R{X^ ^  (X)andR(Y^ ,  J3)  . 


2.3  Inverse  Kinematics  of  4 -Link  thumb 

As  presented  in  the  previous  section,  the  forward  kinematics  problem  of  a  robot  manipulator  is  to  determine  the 
configuration  (position  and  orientation)  of  the  end-effector  of  the  manipulator  as  a  function  of  the  manipulator  joint 
angles.  The  inverse  kinematics  problem  is  to  determine  the  joint  angle.  The  inverse  kinematics  problem  is  to 
determine  the  joint  angles  given  a  desired  end-effector  configuration.  Different  approaches  to  solving  the  inverse 
kinematics  problem  has  been  studied  [10].  The  method  adopted  requires  that  the  number  of  unknown  is  the  same  as 
that  of  equations  and  finally  it  solves  a  set  of  highly  non-linear  equations.  The  Newton-Raphson  (N-R)  method  is 
Implemented  for  4  DOFs,  5  DOFs  and  6  DOFs,  but  for  some  configuration  the  system  of  equations  will  not 
converge. 

The  thumb  has  4DOFs  and  to  solve  the  inverse  kinematics,  we  use  the  theory  of  robotics  [11],  where 

X  =  X  •  X  •  X  •  X  (2-3.1) 

and  from  equation. 


Where  the  vector  d  =  [d^d  d^Y  is  a  known  vector  position  of  the  fingertip  and  each  element  of  the  right  hand 
form  the  equation  of  transformation  matrix: 


Grjit  _ 


n.  0.  P.  X 

^  0.  Py  X 

n.  0.  P.  < 

0  0  0  1 


(2.3.2) 


cos^j'  -cos(-^)sin(^j' +— )  sin(--^)sin(^j' +-^)  0 


sin(^i'+^)  cos(-^)cos(^i'  +  ^)  -sin(-^)cos(^i' +  ^)  0 


sin(-f) 


cos(-— ) 
2 


(2.3.3) 


COS  ^2  -cos(0)sin(^2)  sin(O)  sin(^2 )  L^cos{q[) 

sin(^')  cos(0)cos(^2)  -  sin(O)  cos(^' )  Z^sinC^') 

0  sin(O)  cos(O)  0 


(2.3.4) 
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2rpt 


3 


jt 


f  t 
COS  <2^3 

sin(^3) 

0 

V  0 

cos  ^4 
sin(^') 
0 


-cos(O)  sin(^3) 
cos(O)  cos(^3 ) 
sin(O) 

0 

-cos(O)  sin(^4) 
cos(O)  cos(^4 ) 
sin(O) 

0 


sin(O)  sin(^3 ) 

-  sin(O)  cos(^3 ) 

cos(O) 

0 

sin(O)  sin(^4 ) 

-  sin(O)  008(^4 ) 

cos(O) 

0 


Lj  cos(^3 
I3  sin(^3 ) 
0 

1  . 
L4  cos(^4 

0 


(2.3.5) 


(2.3.6) 


The  unknown  angles  are  q[ ,  ^2  ’  ^3  ^4  pre-multiply  the  equation  on  both  sides  for  the  inverse  (  ) 

and  the  equation  is  now 

.Ojtyl  Gjt  _  Ijt  2jt  3rpt 

y  ^1)  U  ^2  H  U  (2.3.7) 

With  the  convenient  operation,  we  can  see  that  from  the  left  matrix  the  element  [3, 4]^  is  —d^  COS  q[  —  sin  q[ 


and  for  the  right  hand  the  element  [3, 4]^  is  0.  We  can  assume  that  [3, 4]^  =  [3, 4]^  and  we  calculate  the  first 
unknown  with 


tan^j  = 


(2.3.8) 


The  tangent  has  two  solutions  with  a  variation  of  tt,  but  the  thumb  has  constrained  the  movement,  the  range  of 
motion  is  between  -13/18071  and  7/3071  and  we  only  accept  one  solution  within  the  range  of  motion.  Note  that  this 
equation  is  only  for  this  four  DOFs  system  and  its  D-H  table.  We  need  three  more  independent  equations  to  find  the 


three  unknowns.  Following  a  similar  method,  the  equation  can  be  pre -multiplied  for 


on  both  sides  and 


CTiy\%y^  %  = 


2 


jt  3jt 

^3  ^4 


(2.3.9) 


For  this  equation,  [1, 4]^  =  [1, 4]^  and  [2, 4]^  =  [2, 4]^  ;  from  this,  we  have  two  equations  and  three  unknowns. 


dy  cos ql  cos ^2  “ cos q\  sin q[  -d^sinq^- L^=  cos q[+L^  cos q[  cos q\-L^  sin q[  sin q\ 

(2.3.10) 


and 


dy  cosql  sinq^  sin^^  sin^{  -d^  sinq^  “A  ^  A  sin^^  +  A  sin^3  cosq^  +  L^  cosq^  sinq^ 

(2.3.11) 


We  need  more  equations  to  pre-multiply  for  (  ) 


.  The  next  equation  is 


(V/ A  •('Ar'  •("Ar'  •  ""A  =  % 

With  the  new  equation,  we  can  extract  for  [1,  —  [1, 4]^  ,  as  follows 


(2.3.12) 
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— Lj  cos  ql—L^—d^  ((cos  sin  ^2  +  cos  q^  sin  ^3  +  d  cos  q[  ((cos  q^  cos  q[  -  sin  q'^  sin  q[)) 

—d^  sin  q^  cos  q^  cos  q[  —  sin  q^  sin  q[=L^  cos  q^  (2  3  13) 

We  have  one  system  of  equations  with  three  unknowns.  This  is  a  system  of  non  -linear  equations  and  to  solve  this 
system  of  equations,  we  need  some  iteration  method  or  applied  optimization. 

2.4.  DIFFERENTIAL  KINEMATICS 

Differential  Kinematics  establishes  the  relationship  between  the  linear  and  angular  velocities  and  accelerations  of 
fingertips  and  the  angular  velocities  and  accelerations  of  joints  by  the  manipulator  geometric  Jacobian. 


2.4.1.  Four-link  thumb 

If  we  only  consider  the  linear  velocities  of  the  fingertip,  then  the  angular  velocities 
and  angular  accelerations  of  joints  can  be  obtained  by  taking  the  first  derivative  and 

second  derivative  on  the  finger-tip  co-ordinate  thumb 


• 

■  -I\S{,q[ )  -  )  -  45(^123 ) "  ^^(^34 )  ’ 

• 

Y 

_  I\C{q‘, )  +  Il,C(q[,  )  +  4C(^j'23  )  +  I^ACWnu  )  _ 

2.4.2.  Jacobians 

The  jacobians,  J  is  a  multidimensional  form  of  the  derivative.  Suppose,  for  example  we  have  four  functions,  each  of 
which  is  a  function  of  four  independent  variables: 

Yl=fl(ql,q2,  q3,  q4), 

Y2=f2(ql,q2,  q3,  q4), 

Y3=f3(ql,q2,  q3,  q4), 

Y4=  f4(ql,  q2,  q3,  q4). 

Now  if  we  wish  to  calculate  the  differentials  of  y-  as  a  function  of  differentials  of  Xj ,  we  simply  use  the  chain  rule 
to  calculate  and  we  get 


dx, 


8x. 


dxx 


dx. 


dy^=^5x,+^5x,+ 


^4  ,  ^4 


^x^ 


dx^ 


dxx 


■  Sxx  +  — -  dx. 

dxx  " 


This  again  might  be  written  more  simply  using  vector  notation  as 


dY  = 


ex 


The  6x6  matrix  of  partial  derivatives  is  what  we  call  the  Jacobian,  J. 


The  differential  derivative  of  the  coordinate  of  the  points  of  the  finger-tip  can  be  written  as 

.  <  .t 


p  =J'pW)q 


137  of  329 


The  matrices  p  ,  q  q‘andJ‘^  {q‘ )  as  follows 


P  = 


X‘ 

Y‘ 


q‘  = 


% 


Qi 


% 


^4 


^2 

^3 

.^4. 


■  -I\siql )  -  4-5(4 )  -  4-5(43)  -  45(434) ' 


{C(ql)  +  Ii,C(ql,)  +  Il,C{q\,, )  +  ) 

The  matrix  )  is  called  a  sub-matrix  of  the  geometric  Jacobian  of  the  thumb.  We  will  only  consider  the 

geometric  Jacobian  for  the  planer  location  P‘  {X‘  ,Y‘)  and  not  the  orientation,  that  is,  a  sub-matrix  of  the 
geometric  Jacobian. 


.t  ^  t  .  f 


The  angular  velocities  ,  ^2  ’  joints  1,  2,  and  3  are 


4. A 

V  y 


-1 


<1  =4, 

••  •• 

Similarly,  the  angular  accelerations  q[ ,  ^2  ’  ^3  ^4  the  Joints  1 ,  2  and  3  are  obtained  as 


y=4 


r-V/4 


q 

V  y 


q ) 


Where  P  is  the  linear  acceleration  vector  of  the  fingertip.  P  ,  q‘ ,  and 


dJ‘^{q') 

dt 


are  denoted  as 


P  = 


X‘ 

•• 

Y‘ 


qi 


^2 


^3 


^4 


dJ‘^{q‘) 

dt 


-I\  COS(^i' )  -  Z4  COS(^|2 )qi2-^  C0S(^[23 )  ^123 -  4  COS(^|234 )  ? 


1234 


-I\  sin(^j' )  -  4  sin(^!2 )  ^12  “  4  sin(43 )  ^123  “  4  sin(434 )  q 


1234 
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2.4.3.  Finger-tip  Workspace 

The  solutions  of  the  direct  kinematics  define  the  workspace  of  the  finger.  The  workspace  can  be  defined  as  the  set  of 
all  possible  positions  of  the  finger-tip,  constructed  using  all  possible  values  of  joint  variables  within  their  range. 
Because  of  the  difficulty  in  visualizing  the  workspace,  several  subspaces  have  been  defined 

•  Reachable  workspace:  This  is  a  set  of  all  locations  of  the  origin  of  the  finger-tip  frame  that  the  robot  finger 
can  reach.  It  is  a  three  dimensional  subset  of  the  workspace. 

•  Dexterous  workspace:  Set  of  all  locations  of  the  origin  of  the  finger-tip  frame  that  the  robot  finger  can 
reach  with  any  orientation.  This  useful  because  the  robot  has  full  dexterity  in  this  subspace,  which  ensures 
that  any  task  can  be  performed  within  it 

•  Workspace  with  constant  orientation:  Set  of  all  locations  of  the  origin  of  the  end-effector  frame  that  the 
robot  can  reach  with  a  specified  orientation  for  the  end-effector. 

2.4.4.  Three-link  thumb 

The  three-link  thumb  with  four  degree  of  freedom  is  shown  in  the  figure.  The  red  region  is  the  reachable  workspace 
of  the  thumb.  The  first,  second  and  third  positions  (joint  angles)  are  constrained  in  the  ranges  of  [0,90],  [-80,0]  and 
[60,0]  respectively. 


0.1 


0.08 


0.06 


^  0.04 

CD 

oS 

>  0.02 

0 


-0.02 


-0.04 

-0.02  0  0.02  0.04  0.06  0.08  0.1 

X  (meter) 

Figure  2.0.  Workspace  of  thumb  in  Flexion  and  extension  motion 

Also  for  the  combined  workspace  of  the  thumb  and  index  finger  during  extension  and  flexion  is  show  in  the  figure. 
The  Index  finger  is  constrained  within  the  range  [0,  90],  [0,110]  and  [0,  80].  In  the  figure  a  square  shaped  object  is 
within  the  reachable  workspace  of  the  thumb-index  fingers  motion. 
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_0  04  ^  ^ ^  ^ ^  ^  ^  ^  ^ 

■-0.04  -0.02  0  0.02  0.04  0.06  0.08  0.1  0.12  0.14  0.16 

X  (meter) 

Figure  2.1.  Configuration  of  a  Square  shaped  object  within  the  workspace  of  a  thumb-index  finger 

3.  Dynamics 

In  other  to  derive  a  control  technique  for  the  prosthetic  hand,  a  mathematical  model  that  describes  the  dynamic 
behavior  of  the  hand  must  be  calculated.  An  ideal  model  of  a  4-link  with  4-R  finger  is  studied  in  this  section.  It  is 
called  ideal  because  it  is  assumed  that  the  links  are  massless  and  there  is  no  friction.  The  equation  of  motion  that 
describes  the  dynamic  behavior  of  systems  can  be  obtained  via  Newton’s  equation  of  motion  or  Legrange’s 
approach.  We  will  use  the  Legrange’s  form  of  Newton’s  equation  of  motion  to  derive  the  dynamic  equations. 

The  Legrangean  form  of  Newton’s  equation  are  given  by 


r=l,  2,...,n 


(3.00) 


Where 


L  =  K-V 


(3.10) 


Equation  (3.10)  is  called  the  Lagrangean  of  the  system,  is  the  non-potential  generalized  force;  K  and  V  are  the 
potential  energy  of  the  n  degree  of  freedom  prosthetic  hand  respectively. 

3.1.  Four-link  index  finger 

The  Legrangean  equation  of  the  index  finger  can  be  expressed  as 


E=K'-V\ 


(3.20) 


Where 


(3.30) 


n=A 


n=4 


(3.40) 


m=] 


m=l 
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Here,  n  is  the  number  of  links  of  the  index  finger;  is  the  mass  of  link  m;  we  take  the  absolute  angle  0^  and  the 
relative  angles  Or^^O^andO^  as  the  generalized  coordinates  to  express  the  configuration  of  the  index  finger. 


The  global  position  of  lflf\ ,  ifYlr^ ,  rn^andm^  are 

r  Xi  ”1  _  r  /Icos^i  ”1 

\_yi  [_/lsin<9i  J  (3.50) 

r  ^2  n r  4cos^i+/2cos(^i+^2)n 

1^72  J  |_ /iSin^^+/2sin(^^+^2)  J  (3.60) 

I  _  r  COS0^-\-l2  COS(^]^+^2  )"^^3  COS(^]^ +^2 3” ^3  )  ”1 

F3  J  4  sin  01 +I2  sin(6\  +02  )+l^  sin(6\  +6*2  +0^ )  J  (3.70) 

X^  j  _  I  cos  0^  +^2  ~^02  )~^^3  ~^02  )~^^4  COS(^]^  ~^02  ~^^3  ”^^4  )  I 

I  I  4  sin 0\  +^2  sin(^]^  ~^02  )~^^3  sin(^j^  "b^2  “i'^3  )"f^4  sin(^j^  t-^2  "^^3  "b^4 )  I  (3.80) 


The  global  velocities  of  the  masses  are  the  time  derivative  of  the  global  position  of  the  masses. 


• 

-/j  01  sin(9j 

L>'.  J 

• 

/j  0^  COS^J 

•  • 

-/j  01  sin  01 -I2  012  sin  6^2 


/j  6*[  cos  01 +I2  012  cos  012 


(3.90) 


(3.91) 


^3 

^3 


^1  sin  0^  I2  012  sin  0]^2  ^3  0123  sin  0^23 

•  •  • 

ll  01  COs6\+/2  012  COs6\2+^3  ^123  COS  6^23 


(3.92) 


•  •  •  • 

X4 

-li  01  sin  ^1-/2  012  sin  ^12  “^3  ^123  sin^|23  ~h  ^1234  sin  6^234 

_^4  _ 

•  •  •  • 

ll  0^  COS  0^  “f  ^2  ^12  COS  0\2  ~^^3  0123  COS  0\23  “f  ^4  ^1234  COS  0\23^ 

The  kinetic  energy  of  the  finger  is  made  up  of  the  kinetic  energy  of  the  masses  and  is  equal  to 

K  =  K^+K^+K^+K2, 
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K  ■■= 


ml  sm{dl{t)f  eijtf'  +  Lp-  cos{  ei[t)f  61  {tf') 

2 

+  ^{m2{Lp-  s.m{ei{t)f  dl{t)^  -  if  im[dl(t) 

+  dlit))^  {dl[t)  +  e2{t)f  +  ifi  cos{dl[t)f'  eiitf' 

+  L2cos{ei{t)  +  d2(t)f  [di(t)  +  d2{t)f)) 

+  y(?n5  [if-  sin[ei{t)f  ei{t)^  -  sin(07(?) 

+  e2[t)f  {Bi{t)  +  e2{t)f  - 13^ sm[ei[t)  +e2{t) 

+  e3(t)f{ei{t)  +  e2{t)  +  e3{t)f  +  if  cos{ei{t)f  ei{tf 
+  L2^cos{ei{t)  +  e2(t)f{ei(t)  +  e2(t)f 
+  L3^cos{ei{t)  +92it)  +  e3it)f  {ei{t)  +62(1)  +05(0)^)) 

+  ■j{m4  {if  sm{ei{t)f  ei{t)^  -  L2sm{ei{t) 

+  d2(t)f  (dlit)  +  d2{t)f  +  L3^  sm(91{t)  +  92(t) 

+  65(?))  (91  (t)  +  92{t)  +05(^))  +  L4^  sin(  91  (t)  +  92  (t) 

+  93(t)  +  94{t))  (91(t)  +  92{t)  +  93(f)  +  94(t)^ 

+  Ll^  cos(91(t)f  91(t)^  +L^cos(91(t)  +  92(t)f  (91  (t) 

+  92(t)f  +  L3^  cos(91(t)  +  92(t)  +  93(t)f  (91(t)  + 

92(t)  +  93(t)f  +  L4^  cos(91(t)  +  92(t)  +  93(t) 

+  94(t)')  (91  (t)  +  92 (t)  +  93 (t)  +  94(t) )  ) ) 

The  Potential  Energy  of  the  manipulator  V=vl+v2+v3+v4 

=  Ji\gY^+m^gY^+m^gY^+m^gY^ 

n\gl^  sin d  +  m^gQ^  sin 0^  +/2sin^^2)  +  ^^(4^ii^^i  +4^111^123) 

+m^gQ^  sin  0^  +  4  sin  0^^  +  4  ^123  +  4  ^1234) 

Here  is  the  length  of  link  k;  0^  is  the  angle  at  joint  m  and  a  function  of  time;  g  is  the  acceleration  due  to  gravity. 


Therefore  the  Lagrangean  is  obtained  from  equations  (3.95)  and  (3.96)  by  substituting  it  in  (3.20)  .  Here  is  the 
length  of  link  k;  0^  is  the  angle  at  joint  m  and  a  function  of  time;  g  is  the  acceleration  due  to  gravity. 
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L  =  K-V 


ml  {lP-  sin(  +  Lp'  cos(  Oljtf') 

2 

+  ^(m2(z.7^  sin(e7(?))^  s\rv{ei{t') 

+  02(2“))^  {ei{t)  +  02(2“))^  +Z72cos(07(2‘))^  Qlitf' 

+  7:2 cos(  07(2')  +  02(2'))^  (  &/(«')  +  02(2'))^)) 

+  ^(m2  (7:7^  sin(07(2‘)  —  i^2^  sin(07(2') 

+  02(2'))^  (07(2')  +  02(2'))^  —7:2^  sin(  07(2')  +02(7) 

+  05(7))^  +  02(7)  +  05(7))^  +  7:7^  cos(  07(7))^  ei{t)^ 

+  7.2^cos(07(7)  +  02(7))^  (07(7)  +  02(7))^ 

+  7:5^  cos(  07(7)  +  02(7)  +  05(7))^  {01{t)  +  02(7)  +  02(7))^)) 
+  ■^{m4  {l1^  sin(07(7)  02(7)^  —  7^2  sin(  07(7) 

+  02(7))^  (07(7)  +  02(7))^  +7:2^  sin(  07(7)  +  02(7) 

+  02(7))^  (07(7)  +  02(7)  +  02(7))^  +  7.^^  sin(07(7)  +  02(7) 

+  02  (  7  )  +  04 (  7 )  )  (  07  (  7 )  +  02  (  7 )  +  03  (  7 )  +  04 (  7 )  ) 

+  Z7^cos(07(7))^  02(7)^  +  7.2^  cos(  07(7)  +  02(7))^  (02(7) 

+  ^2(7))  +  7/2^  cos(  07  ( 7)  +  02(7)  +  02(7))  (07(7)  + 

02  ( 7 )  +  03  ( 7 )  )  +  L4^  cos  (  07  (  7 )  +  02  ( 7 )  +  02  ( 7 ) 

+  07(7))^  (02(7)  +  02(7)  +  02(7)  +  ^(7))^)) 

—  ml  g  1^1  sin{  G1  (t))  — m2  g  1^1  sin{  01  (t))  — m2  g  1^2  sin{  01  (t) 
-h  02(t))  —  m3  g LI  sin(  01  (t))  —  m3  g L2  sin{  01  {t)  3-02(1)) 

—  m3  gL3  sin{  01  (t)  3-  02(t)  3-  03(t))  — m4 g LI  sin{  01  (t)) 

—  m4  gL2  sin^  01  (t)  3-  02(t))  — m4  g L3  sin(^  01  (t)  3-  02(t) 

3-  03(t))  —  m4  gL4  sin(  01  (t)  3-  02(t)  +  03(t)  +  04(t)) 


—  =  -(rr\  +m^+m^+  cos  6^  -  +m^+  cos(^^  +  ^2) + (^2 + ^3  +  ^4)sh  +  ^2) + +  ^2  +  ^3) 

dO^ 

•  •  •  •••  •••• 

— —  —  {jfl^  fU^  )/|  6^  — {jn2~\~M2~\~  171^^12  (^1  +  ^2  )  "^  (^3  ^4  )  4  (^1  "I"  ^2  ^3  )  ^4^  (^1  "I"  ^2  ^3  ^4  ) 

d9, 


3.2.  Dynamics  for  a  3R  Planer  Index  finger 

We  can  derive  a  set  of  recursive  equations  to  relate  each  link  in  the  coordinate  frame  attached  to  the  previous  link 
based  on  the  velocity  and  acceleration  kinematics.  We  may  generalize  the  method  of  analysis  to  be  suitable  for  a 
robot  index  finger  any  number  of  links.  The  Newton-Euler’s  equations  of  motion  application  in  robot  dynamics 
enables  us  to  calculate  the  joint  forces  one  link  at  a  time  starting  from  the  end-effector  (finger-tip)  link. 

The  backward  Newton-Euler  equations  of  motion  for  the  link  (i)  in  the  local  coordinate  frame  Bi  are 


F._,=Y.'F^.+m^^a, 
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M 


+{'d.  -  'r.yF.  +  'I.  qOT.  +  qCO.  X  ‘I. 


‘f  =  H-i  - 

'lU:  =  'd,  —  'r 


Translational  acceleration  of  link  (i)  is  denoted  by  aOi  and  is  measured  at  the  mass  center  Ci.  Angular  acceleration 
which  is  the  same  for  all  points  of  a  rigid  link  (i)  is  denoted  by  aOi  and  is  usually  shown  at  the  mass  center  Ci.  The 
forces,  Fi-1  and  moment  Mi-1  are  the  resultant  force  and  moment  that  link  (i)  applies  to  link  (i+1)  at  joint 
When  the  driving  force  system  (Fi-1,  and  Mi-1)  is  found  in  frame  Bi,  we  can  transform  them  to  the  frame  Bi-1  and 
apply  the  Newton-Euler  equation  for  link  (i-1). 

«-l  ry  _  i  rp 


The  negative  of  the  converted  force  system  acts  as  the  driven  force  system  (Fi-1,  and  Mi-1)  for  the  link  (i-1). 


3.3.  Three-link  Index  finger  Dynamics 

Fig. 

The  Torques  of  the  actuators  are  parallel  to  the  z-axis  and  are  shown  to  be  QO,  Q1  and  Q3. 
The  Newton  Euler  equations  of  motion  for  the  first  link  are 


Fo-Foi+Mi^-  =  Miaoi 

Cl  —  ^2  +  ^01  ^01  ^  ^01  ~  ^01^01 


(3.2.1) 


Equations  of  motion  for  the  second  link  are 


^01  ^02  ~  ^2^02 


(3.2.2) 


(3.2.3) 


Q\  Q2  ^02  ^  ^01  ^02  ^  ^02  “  ^02^02 

Equations  of  motion  for  the  third  link  are 

^02+^3.g/=^3«03 

0-2  ^03  ^  ^02  ~  ^03^03 

There  are  six  equations  with  six  unknowns;  FO,  El,  F2,  QO,  Q1  and  Q2 

However  in  robot  dynamics,  actuator  torques  is  usually  applied  in  the  control  not  the  joint  forces.  So  we  do  not 
necessarily  need  to  find  the  joint  forces.  We  may  eliminate  FO,  El  and  F2  and  reduce  the  number  of  equations  by 
half. 

Eliminating  F2  in  equation  (3.2.3) 

Q2  ~  ^03^03  “^03(^3^03  ~^3Sj) 

Eliminating  FI  and  F2  in  equation  (3.22) 

Cl  =  C2  +  ^2^02  +  "^02  ^  "^3  (<^03  -  g/)  -  %2  ("^2  («02  “  «/)  “  "*3  («03  “  S/)) 

Eliminating  FO  and  FI  in  equation  (3.2.1) 

Qo=Qi+Ioi<^oi+miXfrh  («03  “  g/)  “  «oi  («oi  “  S/)  “  "^2  (<^02  “  S/)  “  («03  “  S/)) 

(3.2.6) 


(3.2.4) 


(3.2.5) 


Using  MAPLE,  the  position  of  Ci  and  the  links’  angular  velocity  and  acceleration  are  calculated.  The  translational 
acceleration,  aOl  at  the  center  of  mass  of  each  link  is  also  calculated.  Substituting  these  results  in  equations  (3.2.1), 
(3.2.2)  and  (3.2.3),  provides  the  dynamic  equations  for  the  3R  robotic  finger  in  appropriate  form. 
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a2  ■■= 


L3  +  e2it)  +  eiJC?))  m3 


X7cos(07(/))  Oljty 
2 


7:7  siii(  07(/‘)  ) 
2 


7:2cos(  07(;-)  +  e2(;-))  (e7(j-)  H-  e2it)) 

2 


7:2sin(07(?)  +  02(t))  (PyCt)  +  02(t)) 

2 


7.3cos(  07(/-)  +  02(t)  -h  03(0)  (Oy(t)  -h  02(f)  -h  03(f)) 


Z.3sin(OJ(t)  -h  02(0  -h  03(0)  +  02(t)  -h  03(t)) 


Z.3  sin(  07  (t)  -+-  62  (t)  -h  63  (t))  m3 


7:7  siti(  07(^^)  )  61  jt) 

2 

Z.2sin(67{t)  -+-  62{t))  (6Jit)  -+-  62(t)) 


7:7  cos(  07(?-)  )  67  (t) 
2 

2 


j:2cos(6J(t)  -h  62(t))  (07(/‘)  H-  0-2(/)) 

2 

JL3  siii(  6J(t)  +  62(f)  +  63(t))  (67(t)  -h  62{t) 


—  gL3  cos(  07  +  02  +  05) 


O 


13(61(0  -+-  62(0  -+-  63(0) 


02(0) 


Z.3  cos(OJ  (t)  +  0^(0  +  03(t))  -h  dsjt)) 


4.  Hard  Control  of  the  Prosthetic  Hand 

Control  is  the  science  of  desired  motion.  The  prescribed  motion  of  a  robot  is  related  to  the  dynamics  and  kinematics 
by  control.  In  applying  controls,  certain  optimal  indices  should  be  considered  to  enable  the  system  (device)  function 
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optimally.  For  example  performance  of  task  by  the  prosthesis  in  the  shortest  possible  time.  This  is  where  the  concept 
of  path  planning  for  the  robotic  finger  comes  into  play. 

An  integral  part  of  robot  control  is  planning  the  path  (path  planning)  the  robot  should  follow  in  carrying  out  specific 
tasks.  Task  compliance  or  constrained  motion  is  critical  in  situations  where  the  robot  comes  in  contact  with 
obstacles.  This  could  be  done  in  either  Cartesian  or  joint  space.  Path  planning  in  the  joint  space  appear  to  be  easier 
compared  to  Cartesian  space. 

There  are  number  control  algorithms  that  can  be  used  to  control  the  robotic  hand,  each  of  which  is  best  applicable  to 
particular  class  of  robots  in  a  particular  task.  Some  of  these  control  methods  are:  Feedback  linearization  or  computed 
torque  control,  linear  control  technique,  adaptive  control,  robust  control,  gain  scheduling  and  also  the  proportional 
controls  (PI,  PD,  and  PID). 

4.1.  Feedback  Linearization 

In  feedback  linearization  or  computed  torque  approach,  a  control  law  is  defined  to  obtain  a  linear  differential 
equation  for  error  command  and  then  use  the  linear  control  design  technique.  An  alternate  dynamics  of  a  robot 
finger  can  be  written  in  the  form. 


Q  =  D(q)  q+  H(q,  q)  +  G{q) 


(4.1.1) 


Where  q  is  the  joint  variable  vector  and  is  the  torques  applied  at  joints.  Assume  a  desired  path  in  joint 

space  is  given  by  twice  differentiable  function  ^  ^  C  pj.Qjjj  jjjg  dynamics,  the  desired  time  history  of 

joints’  position,  velocity  and  acceleration  are  known.  Hence,  by  introducing  a  computed  torque  control  law,  we  can 
control  the  robot  fingers  to  follow  desired  path. 


Q  =  D(q){q^  -  K^e  -  KpC)  +  H{q,  q)  +  G{q)  (4. 1 .2) 

Where  e  ,  the  tracking  error  is  defined  as 

e  =  q-q^  (4.1.3) 

KD  and  KP  are  constant  gain  diagonal  matrices.  The  control  law  is  stable  and  applied  as  long  as  all  the  eigen 
values  of  the  matrix  below  have  negative  real  parts. 

f  0  I  ^ 

[A]  = 

[-Kp  -Kj 

The  idea  behind  the  introduction  of  a  feedback  signal  is  to  make  the  robot  fingers’  actual  path  track  the  desired  path. 
Unlike  in  the  open  loop  approach,  there  is  always  a  difference  between  the  robot  finger’s  actual  path  and  the  desired 
path.  This  is  due  to  non-modeled  parameters  and  also  errors  in  adjustment. 


4.2.  PID  CONTROL 

The  proportional-integral-derivative  (PID)  control  has  simple  structure  and  clear  physical  meanings  for  the  gain.  It’s 
a  widely  accepted  control  strategy  in  most  industrial  robot  design.  In  most  cases,  feedback  loops  are  controlled  using 
PID  algorithm.  The  main  reason  why  feedback  is  very  important  in  systems  is  to  be  able  to  attain  a  set  point 
irrespective  of  disturbance  or  any  variation  in  characteristics  of  any  form.  The  PID  control  is  always  designed  to 
correct  error(s)  between  process  values  and  particular  desired  set  point  in  a  system. 

Consider  the  characteristic  parameters-  Proportional  (P),  integral  (I)  and  derivative  (D)  controls  as  shown  in  the 
diagram  below  is  to  be  applies  to  the  robotic  hand  (system).  The  system,  S  is  to  be  controlled  using  a  controller,  C; 
where  C  depends  on  the  P,  I  and  D  parameters. 

Considering  the  nonlinear  equation  that  are  derived  from  Euler-Lagrange  equation  (),  the  control  input  variable  F 
which  represents  the  torque  applied  to  the  robot,  is  unknown,  (  assumed  that  the  considered  robot  actuators  were 
ideal  sources  of  torques  and  forces).  However  it  requires  a  control  in  the  joints  to  reach  a  final  position.  Therefore 
we  use  the  classical  PID  law  as  shown  below; 

• 

F  =  Kpe  +  Kj‘Qe{T)dT  +  K^e  (4.2.1) 

Where  e  —  q^—d,  q^  is  the  desired  joint  angle,  ,  K.  and  are  the  proportional,  integral  and  derivative 
gains  respectively. 
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4.2.1.  4  DOF  Index  finger 

For  this  experiment,  what  we  want  to  control  with  PID  is  the  force  applied  to  the  robot  to  take  it  to  a  desired  position 
using  as  parameter  the  error  between  the  actual  and  the  desired  coordinate.  To  develop  the  dynamic  model  we  will 
consider  the  index  finger  configuration  shown  in  figure  3. 

Considering  the  nonlinear  equation  that  are  derived  from  Euler-Lagrange  equation  (),  the  control 
From  equation  4.1.1  we  can  describe  the  motion  of  the  system  as  follows; 


D(q)  = 

M2jM22M23M24 

6»3 

^3 1^32^33^34 

A. 

The  matrix  entries  for  D  (q),  C  (q,q)  and  g(q)  can  be  are  obtained  from  the  dynamic  equation  of  a  4DOF  thumb 
obtained  in  section  3. 

Where 

Mn  = 

bll=(Ml+M2+M3+M4)*L1^2+(M2+M3+M4)*L2^2+(M3+M4)*L3^2+M4*L4^2+2*(M2+M3+M4)*Ll*L2*cos(x 

(4))+2*(M3+M4)*Ll*L3*cos(x(6)+x(7))+2*(M3+M4)*L2*L3*cos(x(7))+2*M4*Ll*L4*cos(x(6)+x(7)+x(8))+2* 

M4*L2*L4*cos(x(7)+x(8))+2*M4*L3*L4*cos(x(8)) 

^22~ 

(M2+M3+M4)*L2^2+(M3+M4)*L3^2+M4*L4^2+2*(M3+M4)*L2*L3*cos(x(7))+2*M4*L2*L4*cos(x(7)+x(8))+ 

2*M4*L3*L4*cos(x(8)) 

M33  =  (M3+M4)*L3^2+M4*L4^2+2*M4*L3*L4*cos(x(8)) 

M44=M4*L4^2 

Mi2  =  M21  =(M2+M3+M4)*L2^2+(M3+M4)*L3^2+M4*L4^2+(M2+M3+M4)*Ll*L2*cos(x(6))+(M3+M4)*Ll* 

L3*cos(x(6)+x(8))+2*(M3+M4)*L2*L3*cos(x(7))+M4*Ll*L4*cos(x(6)+x(7)+x(8))+2*M4*L2*L4*cos(x(7)+x(8) 

)+2*M4*L3*L4*cos(x(8)) 

M^3  =M3^=(M3+M4)*L3^2+M4*L4^2+(M3+M4)*L1*L3*cos(x(6)+x(7))+(M3+M4)*L2*L3*cos(x(7))+M4*L1 
*L4*cos(x(6)+x(7)+x(8))+M4*L2*L4*cos(x(7)+x(8))+2*M4*L3*L4*cos(x(8)) 

Mi4  =  =M4*L4^2+M4*Ll*L4*cos(x(6)+x(7)+x(8))+M4*L2*L4*cos(x(7)+x(8))+M4*L3*L4*cos(x(8)) 

M23  =  A/32  = 

(M3+M4)*L3^2+M4*L4^2+(M3+M4)*L2*L3*cos(x(7))+M4*L2*L4*cos(x(7)+x(8))+2*M4*L3*L4*cos(x(8)) 
M24  =  M42  =M4*L4^2+M4*L2*L4*cos(x(7)+x(8))+M4*L3*L4*cos(x(8)) 

M34  =  M43  =M4*L4^2+M4*L3*L4*cos(x(8)); 


The  Centrifugal  force,  C-  {q,  q)  are  as  follows 


C^{q,q)  = 

((M2+M3+M4)*L1  *L2*sin(x(6))+(M3+M4)*Ll  *L3  *sin(x(6)+x(7))+M4*Ll  *L4*sin(x(6)+x(7)+x(8)))*(2*x(9)*x( 
10)+x(10)^2)+((M3+M4)*Ll*L3*sin(x(6)+x(7)) 

+(M3+M4)*L2*L3*sin(x(7))+M4*Ll*L4*sin(x(6)+x(7)+x(8))+M4*L2*L4*sin(x(6)+x(8)))*(2*(x(9)*x(ll)+x(10) 
*x(ll))+x(ll)^2)+(M4*Ll*L4*sin(x(6)+x(7)+x(8))+M4*L2*L4*sin(x(7)+x(8))+M4*L3*L4*sin(x(8)))*(2*(x(9)*x 
( 1 2)+x(  1 0)  *x(  1 2)+x(  1 1 )  *x(  1 2))+x(  1 2)^2) 
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{q,  q)  =-((M3+M4)*L2*L3*sin(x(7))+M4*L2*L4*sin(x(7)+x(8)))*(2*(x(9)*x(l  l)+x(10)*x(l  l))+x(l  1)^2)- 

(M4*L2*L4*sin(x(7)+x(8))+M4*L3*L4*sin(x(8)))*(2*x(9)*x(12)+x(12)^2)- 

(M4*L2*L4*sin(x(7)+x(8))+M4*L3*L4*sin(x(8)))*2*(x(10)*x(12)+x(ll)+x(12)) 

C3  (<7,  q)  =((M3+M4)*L2*L3*sin(x(7))+M4*L2*L4*sin(x(7)+x(8)))*(2*x(9)*x(10)- 

x(10)^2)+(M4*L3*L4*sin(x(8))*(2*x(9)*x(12)+2*x(10)*x(12)+2*x(ll)*x(12)+x(12)^2)+(M3+M4)*L2*L3*sin(x( 

7))+(M3+M4)*Ll*L3*sin(x(6)+x(7))+(M4*Ll*L4*sin(x(6)+x(7)+x(8))+M4*L2*L4*sin(x(7)+x(8)))*x(9)^2); 

C^(q,q)  =(M4*L2*L4*sin(x(7)+x(8))+M4*L3*L4*sin(x(8)))*(2*x(9)*x(10)+x(10)^2)+(M4*L3*L4*sin(x(8)))*( 

2*(x(9)*x(ll)+x(10)*x(ll))+x(ll)^2)+(M4*Ll*L4*sin(x(6)+x(7)+x(8))+M4*L2*L4*sin(x(7)+x(8))+M4*L3*L4* 

sin(x(8)))*x(9)^2; 


The  Vector  of  gravity  torques  are  as  follows 

gj  (q)  =-(Ml+M2+M3+M4)*g*Ll  *sin(x(5))-(M2+M3+M4)*g*L2*sin(x(5)+x(6))- 
(M3+M4)*g*L3*sin(x(5)+x(6)+x(7))-M4*g*L4*sin(x(5)+x(6)+x(7)+x(8)) 

g2iq)  =-(M2+M3+M4)*g*L2*sin(x(5)+x(6))-(M3+M4)*g*L3*sin(x(5)+x(6)+x(7))- 
M4*g*L4*sin(x(5)+x(6)+x(7)+x(8)) 

g^iq)  =-(M3+M4)*g*L3*sin(x(5)+x(6)+x(7))-M4*g*L4*sin(x(5)+x(6)+x(7)+x(8)) 
84  (^)  =-M4*g*L4*sin(x(5)+x(6)+x(7)+x(8)) 


From  the  system  equation,  4.1.1  we  can  have 


q  =  D{qy\-C{q,  q)  -  g(^)]  +  F 

(4.2.4) 

With 

F  =  D{qy^F  <^M{q)F 

(4.2.5) 

The  error  signals  of  the  system  are 

II 

I 

(4.2.6) 

Where  i  =  joint  angle  1  to  4  and  f  is  the  final  positions  of  the  joint  angles. 

Where  6-^  is  the  final  position  of  joints  i  =  1,  2,  3  and  4.  For  the  control,  the  final  positions  are  given  by 


^1/ 

nil 

^2/ 

n  12 

^3/ 

n !  A 

_^4f  _ 

71 !  6 

The  index  finger  is  considered  to  be  parallel  to  the  x-axis  so  all  initial  positions  are  zero 

Figures  4.1  and  4.2  are  the  simulations  obtained  using  the  PID  controller  for  a  3DOF  thumb.  The  best  performance 
of  the  controller  parameter  where  obtained  with  the  following  values  after  considering  3  cases  of  different  PID 
combinations. 
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PID  PARAMETERS 

CASEl 

CASE2 

CASE3 

Kp  (1,  2,  3,  &  4) 

35,  35,  35  &  35 

25,  25,  25  &  25 

50,  50,  50  &  50 

3,  &4) 

10,  13,  17&20 

20,  23,  27  &  30 

15,20,  35  &40 

Kp,{\,2,  3,  &4) 

25,  25,  25  &  25 

20,  20,  20  &  20 

45,  45,  45  &  45 

Table  4.1.  Three  cases  of  best  performance  of  PID  parameters 
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thetaS  torque  theta2  torque 


Torque  of  theta  2 


time  (sec) 
Torque  of  theta  3 
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thetal  error  (rad)  theta4  torque 


Torque  of  theta  4 


of  Case  2 

Theta-1  error 
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thetaS  torque  theta2  torque 


Torque  of  theta  2 


Torque  of  theta  3 
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thetal  error  (rad)  g  theta4  torque 


Torque  of  theta  4 
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theta4  error  (rad) 


Theta-4  error 


time  (sec) 


Torque  of  theta  1 


time  (sec) 
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thetaS  torque  theta2  torque 


Torque  of  theta  2 


time  (sec) 
Torque  of  theta  3 
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Torque  of  theta  4 


5.  Conclusion 

In  this  report,  section  1  addressed  the  problem  of  kinematics,  inverse  kinematics  and  Differential  kinematics  of  the 
thumb  and  index  finger  of  a  prosthetic  hand.  These  kinematic  structures  could  be  applied  to  the  rest  of  the  fingers  to 
form  a  complete  prosthetic  hand.  In  Section  3,  we  derive  the  dynamic  models  for  a  4  DOFs  finger  via  the 
Lagrangian  convention  and  the  Newton  Euler  postulations.  A  Proportional  Integral  Derivative  control  strategy  was 
applied  to  the  parameters  from  the  dynamics  and  simulation  results  gotten.  Our  first  approach  to  control  the  robotic 
finger  arm  is  by  trial  and  error,  the  two  parameters  of  the  controller  will  be  tuned  manually  to  obtain  the  best  results. 
The  best  performance  of  the  controller  parameters  values  were  shown  in  table  4.1  in  three  different  cases. 
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Optimal  Control  Strategy  for  Smart  Prosthetic  Hand 


Summary 

Optimization  is  a  very  desirable  feature  in  day-to-day  life.  We  like  to  work  and  use  our  time  in  an  optimum 
manner,  use  resources  optimally  and  so  on.  The  subject  of  optimization  is  quite  general  in  the  sense  that  it  can  be 
viewed  in  different  ways  depending  on  the  approach  (algebraic  or  geometric),  the  interest  (single  or  multiple),  the 
nature  of  the  signals  (deterministic  or  stochastic),  and  the  stage  (single  or  multiple)  used  in  optimization. 

This  report  presents  a  control  technique  of  finite -time  linear  quadratic  optimal  control  for  five -fingered 
smart  prosthetic  hand.  The  optimal  control  is  used  for  feedback  linearized  dynamics  to  minimize  tracking  error.  This 
work  is  different  than  the  work  done  in  [2]  as  in  this  work  the  reference  input  can  be  chosen  to  be  constant,  ramp, 
sinusoidal  values  etc.  The  simulations  of  this  optimal  controller  showed  good  performance. 

Introduction 


Optimal  control  theory  is  a  mature  mathematical  discipline  with  numerous  applications  in  both  science  and 
engineering.  It  is  emerging  as  the  computational  framework  of  choice  for  studying  the  neural  control  of  movement, 
in  much  the  same  way  that  probabilistic  inference  is  emerging  as  the  computational  framework  of  choice  for 
studying  sensory  information  processing.  Despite  the  growing  popularity  of  optimal  control  models,  however,  the 
elaborate  mathematical  machinery  behind  them  is  rarely  exposed  and  the  big  picture  is  hard  to  grasp  without  reading 
a  few  technical  books  on  the  subject. 

The  main  objective  of  optimal  control  is  to  determine  control  signals  that  will  cause  a  plant  to  satisfy  some 
physical  constraints  and  at  the  same  time  (maximize  or  minimize)  a  performance  index  or  cost  function.  We  are 
interested  in  finding  the  optimal  control  u*(t)  (*  indicates  optimal  condition)  that  will  drive  the  plant  P  from  initial 
state  to  final  state  with  some  constraints  on  controls  and  states  and  at  the  same  time  extremizing  the  given 
performance  index  J. 

The  formulation  of  optimal  control  problem  requires: 

1.  a  mathematical  model  of  the  process  to  be  controlled  (generally  in  state  variable  form), 

2.  a  specification  of  the  performance  index,  and 

3.  a  statement  of  boundary  conditions  and  the  physical  constraints  on  the  states  and/or  controls. 

We  can  describe  a  physical  plant  by  a  set  of  linear  or  nonlinear  differential  equations. 

Classical  control  design  techniques  have  been  successfully  applied  to  linear,  time -invariant,  single-input,  single 
output  (SISO)  systems.  Typical  performance  standards  are  system  time  response  to  step  or  ramp  input  characterized 
by  rise  time,  settling  time,  peak  overshoot,  and  steady  state  accuracy;  and  the  frequency  response  of  the  system 
characterized  by  gain  and  phase  margins,  and  bandwidth. 

In  modern  control  theory,  the  optimal  control  problem  is  to  find  a  control  which  causes  the  dynamical  system  to 
reach  a  target  or  follow  a  state  variable  (or  trajectory)  and  at  the  same  time  extremize  a  performance  index. 
Performance  index  in  general  can  be  in  the  form  as 

J  =  +  u'{t)Kuit)]dt 

Jto 

Where,  R  is  a  positive  definite  matrix,  and  Q  and  F  are  positive  semi  definite  matrices,  respectively.  Note  that  the 
matrices  Q  and  R  may  be  time  varying.  The  particular  form  of  this  performance  index  is  called  quadratic  (in  terms  of 
the  states  and  controls)  form. 

In  tracking  (trajectory  following)  systems,  we  require  that  the  output  of  a  system  track  or  follow  a  desired 
trajectory  in  some  optimal  sense.  Thus,  we  see  that  this  is  a  generalization  of  regulator  system  in  the  sense  that  the 
desired  trajectory  for  the  regulator  is  simply  the  zero  state. 

The  optimal  control  u_(t)  is  given  by 

11*(/)  =  -R-hOB'P(0x*(0  = -K(0x*(0 

Here,  K(t)  is  called  Kalman  gain  and  P(t),  the  symmetric  positive  definite  matrix  is  the  solution  of  the  matrix 
differential  Riccati  equation  (DRE) 
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p{f)  =  -P{f)A- AT{t)-Q{t)  +  P{t)BR-\t)B'P{t) 

Satisfying  the  final  condition: 

P(/  =  f/)  =  F{tf) 

The  optimal  state  x*  is  the  solution  of: 

x*(f)  =  [A  -  BR"‘(f)B'P(f)]  x*(i) 


And  the  optimal  cost  J*  is 

r  =  ix*'(f)P(f)x*(f) 

The  optimal  tracking  system  can  be  summarized  in  the  next  figure. 


Modeling: 

It  is  necessary  to  have  a  mathematical  model  that  describes  the  dynamic  behavior  of  prosthetic  hand  for  the 
purpose  of  designing  the  control  system.  Hence,  in  this  section  the  dynamic  equations  of  hand  motion  are  derived 
via  Lagrangian  approach  using  kinetic  energy  and  potential  energy,  from  Lagrangian  approach,  dynamic  equations 
of  thumb  can  be  obtained  as  below. 

M{q}q  +  C{q,q)  +  G(q)  =  r  -  Fvq  -  FsSigii(q)  -  J'Fcxt 

Where  M(q)  is  the  inertia  matrix;  C(q,  ’q)  is  the  Coriolis/centripetal  vector  and  G(q)  is  the  gravity  vector;  Fv  denotes 
the  diagonal  positive  definite  matrix  of  viscous  friction  coefficients;  Fs  is  a  diagonal  positive  definite  matrix  and 
sign(  ’q)  is  a  vector  whose  components  are  given  by  the  sign  functions  of  the  single  joint  velocities;  J  is  the  Jocobian 
and  Text  denotes  the  vector  of  external  forces  in  each  direction.  It  can  also  be  written  as: 

M(q)q  +  N(q,  q)  =  r. 

Where 

N(q,q)  =  C(q,q)  +  G(q)  +  Fvq  +  FsSigll(q)  +  J'Fext 

Represents  nonlinear  terms  in  q  and  ’q. 

This  work  is  different  than  the  work  done  in  [2]  as  in  this  work  the  reference  input  can  be  chosen  to  be  constant, 
ramp,  sinusoidal  values,. .  .etc. 
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In  obtaining  the  linear  system  from  the  original  nonlinear  system,  there  has  been  no  state -space  transformation. 
Further,  the  difficult  design  of  a  controller  for  the  original  nonlinear  system  has  been  transformed  into  a  simple 
design  of  a  controller  for  the  linear  system.  If  we  select  the  control  function  u(t)  to  stabilize  the  linear  system  and 
make  the  tracking  error  zero,  then  the  nonlinear  torque -control  will  command  the  prosthetic  hand  to  follow  the 
desired  trajectory.  The  original  robotic  hand  system  becomes: 

M(q(0)  q(0  +  N(q(0,q(0)  =  [M(q(0)]  [qd(0  -  u(0] +  N(q(0,q(0) 

Where 


e{t)  =  u(f) 

Therefore,  the  required  torque  can  be  calculated  by  the  optimal  control  u  (t). 

T*{t)  =  M{q(t))(qd{t)  -  u*{t))  -h  N(q(0,  q(t)) 

The  next  figure  shows  the  block  diagram  of  a  hybrid  finite -time  linear  quadratic  optimal  controller 


Simulation  Results: 

Optimal  control  coefficients.  A,  B,  F(tf ),  R(t)  and  Q(t)  of  all  fingers  are  chosen  as: 
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The  model  that  is  built  in  Simulink  is  shown: 
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1 


And  the  next  figures  shows  some  study  cases  to  show  the  designed  control  method  affectivity: 
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Case  1  angles 
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Conclusion: 

This  report  presented  a  control  technique  of  finite-time  linear  quadratic  optimal  control  for  five- 
fingered  smart  prosthetic  hand.  The  optimal  control  used  for  feedback  linearized  dynamics  to  minimize  tracking 
error.  This  work  is  different  than  the  work  done  in  [2]  as  in  this  work  the  reference  input  can  be  chosen  to  be 
constant,  ramp,  sinusoidal  values  etc.  The  simulations  of  this  optimal  controller  showed  good  performance.  This 
work  can  be  expanded  to  five  fingers  hand  with  22  degree  of  freedom 
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Goal  2AB:  Real-Time  Control 


In  this  research  different  strategies  for  controlling  a  smart  prosthetic  hand  will  be  investigated.  The  aim  of 
the  controller  is  to  define  how  the  fingers  should  move  considering  the  amputee’s  intention  and  an 
appropriate  grasp  shape.  Two  major  kinds  of  plants  will  be  covered:  fully  actuated  and  underactuated 
hands.  In  fully  actuated  hands  all  the  joints  of  the  are  active  and  they  have  separate  actuators,  while  in  an 
underactuated  hand  the  number  of  actuators  are  less  than  degrees  of  freedom.  Besides  grasp  formation 
strategies,  control  techniques  that  allow  accurately  following  command  signal  from  EMG  analysis  in  real¬ 
time  will  be  investigated.  These  commands  can  be  in  the  form  of  position  (angle)  or  force  signals.  All  the 
purposed  control  strategies  are  designed  for  real-time  implementation. 

Human  hand  is  one  of  the  most  important  and  complex  parts  of  the  body,  which  has  the  ability  to  handle  different 
tasks.  The  ultimate  goal  of  a  robotic  hand  is  to  achieve  the  functionality  of  a  human  hand.  In  the  past  three  decades, 
there  have  been  numerous  investigations  to  achieve  dexterity  and  ability  of  human  hand,  especially  in  the  fields  of 
humanoid  robotics  and  prosthetic  hand  [1-6].  In  spite  of  all  these  advances  in  this  field,  the  current  state  of  research 
on  prosthetic  hands  is  far  from  that  objective  of  achieving  the  functionality  of  human  hand.  Commercially  available 
prosthetic  hands  have  very  limited  functionality  and  they  are  just  simple  grippers.  The  present  research  on  prosthetic 
hands  involves  complex  control  schemes  to  achieve  the  most  important  functions  of  the  hand  [7-8]. 

Grasping  can  be  categorized  into  two  main  groups:  precision  and  power  grasping.  In  precision  grasping  the  object  is 
held  by  tips  of  the  fingers,  while  in  power  grasping,  the  whole  the  finger  is  active  and  in  contact  with  the  object  [9]. 

Many  control  methods  require  the  knowledge  of  the  shape  of  the  object.  For  humans  this  information  is  available  by 
visual  feedback  from  eyes,  while  in  case  of  a  prosthetic  hand  this  visual  information  is  not  directly  available  for 
hand  controller,  and  the  only  available  information  is  electromyographic  (EMG)  signal  related  to  patient’s  arm 
muscle  activities.  However,  normally  the  EMG  signal  is  not  available  for  all  individual  joints  and  besides,  due  to 
measurement  noise,  accessing  high  quality  EMG  signal  is  hard  [10].  Moreover,  using  EMG  signal  to  control  all  the 
movements  requires  lot  of  attention  during  grasping  and  leads  to  fatigue  for  the  amputees  [11].  Hence  it  is  required 
for  prosthetic  hand  to  be  semi-autonomous  which  means  a  part  of  command  information  will  be  provided  by  the 
EMG  signal  and  the  rest  of  the  required  command  should  be  provided  automatically  by  hand  controller. 

Defining  finger  trajectory  without  the  knowledge  of  shape  of  object  to  be  grasped  is  a  challenging  task  for  many 
path  planning  techniques.  For  multi  DOFs  robots  there  are  two  common  methods  for  trajectory  planning  which  are 
“inverse  kinematic”  and  “inverse  dynamic”  [12-15].  Both  these  methods  require  object  shape  and  are  based  on 
solving  optimization  problem  which  requires  high  computation,  hence  they  are  hard  to  implement  for  real-time 
applications. 


To  avoid  solving  the  path  planning  problem  for  prosthetic  hands,  many  researchers  advocated  under-actuated 
mechanisms,  which  are  capable  of  adapting  to  object  shape  mechanically  and  without  additional  computation  [16- 
18].  In  these  mechanisms,  the  number  of  actuators  is  less  than  the  DOFs,  and  because  of  less  actuators  they  have  less 
weight.  However  fewer  actuators  result  in  less  functionality,  because  fingers  joints  can’t  move  independently.  In  this 
research  the  control  methods  for  both  underactuated  and  fully  actuated  hands  will  be  covered. 

In  this  repot,  in  section  2  power  grasping  control  for  fully  actuated  hand  based  on  virtual  spring  damper  hypothesis 
is  investigated.  Section  3  focuses  on  precision  grasping  of  fully  actuated  hand.  Section  4  discuses  the  underactuated 
hand  position  and  force  control  method.  Section  5  covers  robust  control  method  to  follow  accurately  angle  command 
signal  from  EMG  analysis  in  presence  of  plant  uncertainty.  Section  6  concludes  current  works  and  presents 
considered  future  works  and  corresponding  time  table. 
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2.  Power  Grasping  Control  for  fully  actuated  prosthetic  hand 

Arimoto  et  al.  [19]  used  “virtual  spring-damper  hypothesis”  for  control  of  robotic  arm-hand  systems.  A  similar 
method  called  “virtual  model  control”  is  also  suggested  by  J.Pratt  et  al.  [20]  used  for  walking  robots,  and  it  is  based 
on  defining  virtual  forces  between  two  points.  Both  methods  are  based  on  the  use  of  Jacobian  matrix  to  relate  task 
space  movement  to  joint  space.  In  [20]  it  is  shown  that  any  kind  of  force  can  be  defined  between  two  points  and  the 
other  study  [19]  shows  that  use  of  spring-damper  forces  will  result  in  human  like  movement.  From  physiological 
point  of  view,  human  skilled  multi -joint  reaching  movement  has  these  characteristics  that  1)  endpoint  trajectory 
become  a  quasi- straight  line  and  less  variable,  2)velocity  profiles  of  the  endpoint  has  a  bell-shape,  and  3)  joint 
trajectories  are  rather  variable  from  trial  to  trial  [19]. 

In  this  research,  a  new  control  scheme  is  proposed  that  can  efficiently  address  the  problem  of  power  grasping 
without  complete  knowledge  of  the  shape  of  the  object  which  may  be  called  “blind  power  grasping”  for  prosthetic 
hand.  The  proposed  method  is  based  on  the  works  by  Arimoto  et  al.  [19]  using  virtual  spring-damper  (VSD) 
hypothesis  used  for  control  of  robotic  arm-hand  systems.  In  our  research,  we  use  the  above  mentioned  hypothesis,  in 
particular  for  the  power  grasping  of  a  prosthetic  hand.  In  this  method,  we  define  a  virtual  spring -damper  between 
finger  tip  and  desired  point  for  control  of  movement  of  fingers.  Further,  in  this  method  there  is  no  need  to  introduce 
any  performance  indices  to  solve  inverse  kinematics  uniquely  and  Jacobian  pseudo-inverse  or  inverse  dynamics 
which  are  common  methods  to  define  trajectories  of  redundant  DOFs  robots.  Besides,  in  the  present  method,  there  is 
no  need  for  any  information  on  tactile  or  force  sensing. 

2.1.  Modeling  of  Prosthetic  Hand 

In  this  control  method,  controller  is  not  derived  directly  from  dynamic  model  of  the  system.  Kinematics  equation 
and  Jacobian  matrix  are  the  required  for  controller  design. 

A  model  of  a  robotic  hand  system  is  shown  in  Fig.l.  The  model  consists  of  a  finger  with  3DOF  which  represents 
three  joints  of  a  finger  and  palm. 


In  this  research  we  assume  the  following: 

1-  Movement  of  both  finger  and  object  are  confined  to  a  two  dimensional  horizontal  plane,  and  therefore  there 
is  no  gravity  effect. 

2-  The  object  is  assumed  to  be  initially  stable  in  its  position. 

3-  The  initial  movement  toward  object  is  handled  by  amputee,  so  the  hand  is  close  enough  to  the  object  before 
grasping. 

The  position  of  the  tip  of  the  finger  is  evaluated  as  (see  Figure  1): 

X  =  cos  -h  I2  cost^q^  F  qj]  "f  ^2  "f  (1) 

y  =  sfnCg^ -|- ijj]  +  fg  SEnCg^-l-q:  +  qg)  (2) 
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where,  Ij,  I2,  and  1 3  are  lengths  of  each  finger  and  qj,  q2,  and  qs  are  angles  of  each  corresponding  joint. 
Based  on  above  equation  the  Jacobian  matrix  is  as: 


J  —  pLi  Aa  Aal  (3) 

Uai  hi  A  3 -I’ 

hi  =  -^1  91  -  h  -I-  9:5  “  ^'«(9i,  +  9j  +  935, 


(4) 

;l2  =  -h  +  9:5  -  h  -l-  9:  +  9g5,  (5) 

ill  =  -h  -  Ig  -|-  gj  +  gg],  (6) 

/la  =  -^a  ^'^1(91.  +  9:  +  935  ,  (7) 

7:1  ~  9l  ^2  cosfgj_  "I-  g^^  "I-  7g  cos^g^^  "I”  gg  "1“  gg5  , 

(8) 

/jj  =  fj  cos(q^  +  gj]  +  fg  CDsfgi^  +  9:  +  9g5'  (9) 

/jg  =  fg  CDS(gi  +  gj  +  gg>  (10) 


2.3.  Virtual  Spring-Damper  Method 

“Virtual  model  control”  is  a  motion  control  scheme  that  uses  simulations  of  virtual  components  to  generate  desired 
joint  torques  [20].  These  joints  produce  the  same  effect  that  the  virtual  elements  placed  on  robot  would  have  created; 
hence  they  create  the  illusion  that  these  virtual  elements  are  connected  to  the  real  robot.  Virtual  elements  can  be  any 
kind  of  real  physical  elements  such  as  springs,  dampers,  gravity  fields,  nonlinear  fields  or  any  other  components. 
Virtual  model  control  was  proposed  by  J.  Pratt  et  al  [20]  for  biped  walking  robot.  In  a  study  by  Arimoto  [19]  on 
robotic  hand  arm  system,  it  is  shown  that  using  a  virtual  spring  damper  between  robot  end  effector  and  desired  point, 
and  virtual  dampers  at  each  joint,  human  like  movement  can  be  achieved. 

For  power  grasping  by  a  prosthetic  hand,  one  of  the  best  options  is  the  use  of  Virtual  Spring -Damper  (VSD) 
hypothesis.  Some  benefits  of  VSD  control  scheme  are  that  it  has  a  simple  structure  and  requires  relatively  less 
computation.  Besides,  it  doesn’t  need  inverse  dynamics  to  precisely  define  the  robot  movement.  Thus,  we  use  spring 
set  points  instead  of  commanded  movement  and  robot  automatically  adapts  its  shape.  Since  finger  joints  at 
prosthetic  hand  work  as  virtual  dampers,  which  is  sensitive  to  velocity  and  not  to  position,  they  don’t  have  a  forced 
shape,  instead  just  finger  tip  follow  a  defined  path  as  will  be  discussed  more  in  control  strategy  section. 

The  joint  torques  to  virtual  forces  is  given  by: 

r=ff,  (11) 

where  x  is  the  torque,  and  F  is  the  force  due  to  virtual  spring  damper  given  as 

F  = +  k&xl  (12) 

and 

~  ~/  F  (13) 

where  k  represents  the  stiffness  of  the  virtual  spring.  Ax  is  distance  between  finger  tip  and  desired  point,  and  ^  is  the 
damping  ratio.  The  damping  force  is  defined  at  each  joint  as 

~  (14) 

where,  C  denotes  a  diagonal  positive  definite  matrix  as  follows: 

C  =  dtagic^ _ (15) 
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Hence  control  signal  would  be  sum  of  these  two  terms 


u  =  -Cq  -  (q')Q\fkx  -h  . 


(16) 


Higher  values  of  k  result  in  more  accurate  and  faster  response  to  the  desired  point  and  higher  C  provides  more 
stability.  Thus  k  and  C  are  chosen  as  design  variables. 

2.4.  Control  Strategy 

Virtual  spring-damper  hypothesis  is  suitable  for  point  to  point  control.  Defining  the  desired  trajectory  as  a  semicircle 
(in  order  to  have  a  full  grasp  of  the  object)  given  by, 

-H  2^2  -H  Iq)  t],  (17) 

yd  =  (i^i -h  ^2 -h  (18) 


Where  t  is  proportional  to  EMG  signal  which  is  scaled  to  change  between  0<t<7i. 

As  shown  in  Fig.  2,  after  passing  this  semi-circle,  finger  tip  goes  toward  center  to  make  a  tighter  grasping.  This  is 
achieved  by  defining  a  desired  point  close  to  center. 

As  mentioned  earlier,  the  goal  is  not  exactly  following  the  defined  path.  If  the  object  is  big,  due  to  contact  of  hand 
and  object,  it  would  be  impossible  to  follow  exact  path  and  following  this  path  is  just  to  achieve  grasping. 

Fig.  3  illustrates  the  physical  counterparts  of  the  virtual  forces  for  control  strategy  and  Fig.  4  shows  structure  of  the 
proposed  control  system.  As  shown,  the  command  force  comes  from  EMG  signal,  and  controller  provides  the 
movement  for  hand  which  has  dynamic  interaction  with  the  object. 


Fig.  2:  Semi-Circle  Path  of  Finger  Tip 


Desired  Point 
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Fig.  4:  Control  Diagram  of  Prosthetic  Hand  System 


2.5.  Numerical  Simulation 

In  order  to  show  the  effectiveness  of  the  proposed  control  strategy,  numerical  simulations  were  conducted  to  grasp 
three  different  objects,  based  on  the  physical  parameters  of  a  hand  system  and  objects  summarized  in  Table  1. 

In  order  to  simulate  dynamics  of  the  hand  and  interaction  with  object,  Adams  software  is  used.  This  software  is  a 
multi-body  analysis  simulation  program  that  solves  the  rigid  body  dynamic  equilibrium  equations  and  directly 
interfaces  with  Matlab/Simulink  software  in  order  to  implement  controller.  The  contact  between  object  and  hand  is 
modeled  and  three  sets  of  simulations  with  different  objects  are  performed.  In  all  three  simulations  the  same  control 
strategy  is  used  which  shows  controller  can  handle  grasping  without  information  about  physical  parameters  of 
object.  Fingers  and  objects  are  assumed  to  be  rigid.  In  these  simulations  the  EMG  signal  is  assumed  to  increase 
linearly  with  time. 


Table  1.  Parameters  used  for  simulation 


Index  finger  link  1 

5  cm 

Index  finger  link  2 

2.5  cm 

Index  finger  link  3 

2.5  cm 

Damping  at  joints 

0.01  kg/s 

Virtual  damping  ratio  (c) 

1 

Virtual  spring  stiffness  (k) 

50N/m 

Rectangular  object  width 

3  cm 

Circular  object  radius 

3  cm 

Star  shape  object  outer  radius 

2  cm 

2.5.1  Simulation  One 

For  first  simulation  a  rectangular  (cubic)  object  is  used,  and  as  mentioned  earlier  the  movement  is  restricted  to  2D 
movement.  Object  is  not  moving  initially.  Hand  starts  movement  from  open  finger  configuration.  The  hand  positions 
at  1  second  time  interval  are  shown.  Fig.  5  shows  finger  tip  angle  with  respect  to  palm. 

As  it  is  shown  in  Fig.  6  the  grasping  is  accomplished  successfully. 
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Fig.  5:  Finger’s  Tip  Angle  at  Rectangular  Object  Grasping 


2.5.2  Simulation  Two 

For  the  second  simulation  a  glass  (circular  object)  is  used.  The  control  parameters  are  identical  to  previous 
simulation. 

As  shown  in  Fig.  7  the  grasping  is  done  successfully  and  the  hand  positions  for  1  second  time  interval  are  depicted. 
Similarly  the  finger  tip  angle  respect  to  palm  is  shown  in  Fig.  8. 

Regardless  of  object  shape,  by  use  of  proposed  control  scheme  the  hand  can  successfully  grasp  objects. 


C 
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(d) 


(h) 


Fig.  7  (a-h) :  Grasping  of  a  Glass  (1  sec.  Intervals) 
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(C) 
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(g) 


Fig.  9  (a-h)  :  Grasping  of  Star  Shape  Object  (1  sec.  Intervals) 


2.5.3.  Simulation  Three 

For  the  third  simulation  a  star  shape  object  is  used.  The  control  parameters  are  identical  to  previous  simulation. 

As  shown  in  Fig.  9  the  grasping  is  done  successfully  and  the  hand  positions  for  1  second  time  interval  are  illustrated. 
Similarly  the  finger  tip  angle  respect  to  palm  is  shown  in  Fig.  10. 

The  complicated  shape  of  object  shows  that  controller  is  able  to  handle  grasp  for  wide  variety  of  objects,  without 
information  of  object  shape. 
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Fig.  10:  Finger’s  Tip  Angle  at  Star  Shape  Object  Grasping 
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3.  Precision  grasping  control  for  fully  actuated  prosthetic  hand 

Using  the  similar  technique  discussed  in  previous  section  for  power  grasping  which  is  virtual  spring  damper 
hypothesis  a  control  strategy  is  developed  for  precision  grasping.  In  precision  grasping  the  object  is  held  by  tips  of 
the  fingers,  while  in  power  grasping,  the  whole  finger  is  active  and  in  contact  with  the  object.  First  a  model  is 
derived  for  kinematic  of  the  hand,  then  the  control  strategy  and  numerical  simulations  are  provided. 

3.1.  Modeling  of  Prosthetic  Hand 

In  this  control  method,  controller  is  not  designed  based  on  dynamic  model  of  the  system.  Instead,  kinematics 
equation  and  Jacobian  matrix  are  used  for  controller  design. 

A  model  of  a  robotic  hand  system  is  shown  in  Fig.l.  The  model  consists  of  a  finger  with  3DOF  which  represents 
three  joints  of  index  finger,  palm  and  a  finger  with  2DOF  which  represents  thumb. 


In  this  reseach  we  assume  the  following: 

•  Movement  of  both  finger  and  object  are  confined  to  a  2  dimensional  horizontal  plane,  and  therefore  there  is 
no  gravity  effect. 

•  The  object  is  assumed  to  be  initially  stable  in  its  position. 

•  The  initial  movement  toward  object  is  handled  by  amputee,  so  the  hand  is  close  enough  to  the  object  before 
grasping. 

The  position  of  the  tip  of  index  fingers  is  evaluated  as  (see  Fig.  1): 

“  ^Ll  "I"  ^L2  "I"  9  is)  "I"  "I"  ^L2  "I" 

(1) 

y,  =  sin  Ijii  +  la  smCgii  +  +  ^ia  +  ^12+  (2) 

where.  In,  la,  and  la  are  lengths  of  index  finger  and  qn,  qa,  and  qa  are  angles  of  each  corresponding  joint.  Similarly 
the  position  of  thumb  finger  is  evaluated  as: 

Xf  =  CDS  gfi.  +  CDsCgfi  +  (3) 

y  =  4i.  sin  qfi.  +  sfn(gfi  +  (4) 

where.  In  and  la  are  lengths  of  thumb  finger  and  qn  and  qa,  are  angles  of  corresponding  joints. 

Based  on  above  equation  the  Jacobian  matrix  for  index  finger  is  as: 

dx  dx 

j  _ 

^  ^  dy  dy 

and  Jacobian  for  thumb  finger  is  as: 


to  1 


dy 


(5) 
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(6) 


■  dx 

dx  ■ 

IL. 

S-iTrz- 

3.2.  Control  Strategy 

Virtual  spring -damper  hypothesis  is  suitable  for  point  to  point  control.  In  precision  grasping  two  approaches  can 
be  considered.  1)  Defining  a  virtual  spring  damper  between  fingers  tip  and  geometrical  center  of  the  object,  which 
requires  information  about  the  object  position  and  shape,  and  this  information  is  not  available  in  case  of  a  prosthetic 
hand  for  the  controller  which  is  used  in  [13]  2)  Defining  a  virtual  spring  damper  between  tips  of  two  fingers,  then 
fingers  attract  together  and  grasp  the  object  in  between,  without  exact  knowledge  of  object  position  and  shape.  In 
this  case  the  amputee  should  place  the  hand  close  to  the  object  and  in  appropriate  position.  Besides,  a  virtual  damper 
force  is  considered  at  each  finger  joint.  The  latter  method  is  used  and  physical  counterpart  of  virtual  forces  are 
depicted  at  Fig.  2. 


Virtual  Spring  Damper 


Higher  values  of  k  (virtual  spring  stiffness)  results  in  faster  movement  of  fingers  as  well  as,  higher  grasping  force. 
Thus  by  defining  k  proportional  to  EMG  signal,  amputee  have  control  over  speed  of  movement  and  grasping  force. 
The  damping  coefficient  of  finger  joints,  can  change  the  final  shape  of  fingers.  The  joints  with  lower  damping  tends 
to  move  more,  while  higher  damped  joints  move  more.  The  appropriate  values  of  damping  are  evaluated  based  on 
trial  and  error  to  reach  positions  close  to  normal  hand  and  they  are  held  constant  for  further  simulations. 

3.3.  Numerical  Simulation 

In  order  to  show  the  effectiveness  of  the  proposed  control  strategy,  numerical  simulations  were  conducted  to 
grasp  two  different  objects,  based  on  the  physical  parameters  of  a  hand  system  and  objects  summarized  in  Table  I. 

The  Adams  software  which  is  multi -body  dynamic  simulation  software  is  used  for  numerical  analysis.  The 
software  is  capable  to  conduct  information  between  Matlab/  Simulink  software  environment,  hence  the  plant  is 
modeled  by  Adams  and  controller  is  implemented  in  Matlab/Simulnk. 

TABLE  I 

PARAMETERS  USED  FOR  SIMULATION 
Parameter  Value 

index  finger  link  1  length  5  cm 
index  finger  link  2  length  2.5  cm 
index  finger  link  3  length  2.5  cm 
thumb  finger  link  1  length  4  cm 
thumb  finger  link  2  length  3  cm 
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distance  between  thumb 

6  cm 

and  index 

damping  at  joints 

0.01  kg/s 

virtual  damping  ratio 

1 

virtual  spring  stiffness 

50N/m 

rectangular  object  width 

2  cm 

circular  object  radius 

2  cm 

Fig.  3.  Finger  movements  in  4  different  position  (0.25  sec.  intervals) 

For  first  simulation,  two  fingers  are  modeled  without  any  object  in  between.  As  shown  in  Fig.  3,  two  fingers  come 
together,  and  final  position  is  close  to  normal  hand  coordination. 


Fig.  4.  Rectangular  object  grasping  (0.25  sec  intervals) 

For  the  second  simulation,  a  rectangular  object  is  chosen  to  be  grasped.  The  object  is  free  to  move  in  2 
dimensional  plane,  and  contact  and  friction  force  are  simulated  between  finger  tip  and  the  object.  The  object  is 
placed  at  arbitrary  final  position  of  previous  experiment.  The  finger  movement  at  0.25  sec  time  intervals  and  finger 
tip  angles  relative  to  palm  are  shown  respectively  in  Figs.  4  and  5. 
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Finger  Tip  Angles 


Fig.  5.  Finger  tips  angle  at  rectangular  object  grasping 
(index  finger  solid  line  and  thumb  finer  dashed  line) 


As  it  is  shown  after  contact  with  object  at  approximately  1.5  second  the  angles  are  not  changing  much.  The  small 
changes  are  due  to  object  movements  toward  left. 


thumb 


index  finger 

Fig.  6.  Circular  object  grasping  (0.25  sec  intervals) 


For  third  simulation  a  round  object  is  selected.  The  object  is  not  subjected  to  any  constrain  in  2  dimensional 
plane.  The  contact  and  friction  force  are  defined  between  object  and  finger  tip.  The  virtual  spring  coefficient  which 
is  proportional  to  EMG  signal  is  assumed  to  be  constant.  Almost  after  1  sec,  the  fingers  contacted  with  the  object. 
The  finger  movement  at  0.25  sec  time  intervals  and  finger  tip  angles  relative  to  palm  are  shown  respectively  in  Figs. 
6  and  7. 
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Finger  Tip  Angles 


Fig.  7.  Finger  tips  angle  at  circular  object  grasping 
(index  finger  solid  line  and  thumb  finer  dashed  line) 


Appropriate  object  position  and  friction  force  between  fingers  and  object  are  important  parameters  that  help 
successful  grasping.  For  the  case  of  a  round  object  if  the  object  has  inappropriate  position  or  friction  is  not  enough, 
the  grasping  might  be  unstable,  but  guarantied  successful  grasping  under  all  conditions  require  information  about 
object  shape  and  position  which  are  not  available  for  case  of  a  prosthetic  hand  hence  this  control  strategy  is 
appropriate  for  most  of  the  daily  activities. 
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4.  Underactuated  prosthetic  hand 

In  underactuated  mechanisms  the  number  of  actuators  is  less  than  their  degree  of  freedom.  These  mechanisms  are 
widely  used  in  prosthetic  hands  because  of  two  useful  properties:  the  first  advantage  is  less  weight  due  to  less 
actuator  which  is  used  in  their  design  and  the  second  advantage  is  easier  control  method. 

Underactuation  can  be  implemented  through  the  use  of  passive  elements  like  mechanical  limits  and  springs  leading 
to  a  mechanical  adaptation  of  the  finger  to  the  shape  of  the  object  to  be  grasped.  Underactuated  robotic  hands  are  the 
intermediate  solution  between  fully  actuated  robotic  hands  for  manipulation  and  simple  grippers.  It  takes  advantage 
of  the  mechanical  intelligence  embedded  into  the  design  of  the  hand  allowing  the  shape  adaptation  of  the  fingers.  In 
an  underactuated  finger,  the  actuation  torque  (or  more  generally  wrench)  is  applied  to  the  input  of  the  finger  and  is 
transmitted  to  the  phalanges  through  suitable  mechanical  design,  e.g.  linkages,  pulleys  and  tendons,  gears,  etc. 


Fig  1. Closing  sequence  of  a  two-phalanx  underactuated  finger 
An  example  of  underactuated  two-phalanx  finger  using  linkages  performing  a  typical  closing  sequence  is  illustrated 
in  Fig.  1.  The  finger  is  actuated  through  the  lower  link,  as  shown  by  the  arrow  in  the  figure.  Since  there  are  two 
DOFs  and  one  actuator,  one  (two  minus  one)  elastic  element  is  used.  In  the  first  two  steps  of  the  Figure,  the  finger 
behaves  as  a  single  rigid  body  in  rotation  about  a  fixed  pivot.  When  the  proximal  phalanx  makes  contact  with  the 
object,  the  second  phalanx  is  rotated  away  from  the  mechanical  limit,  and  the  finger  is  closing  on  the  object  since 
the  proximal  phalanx  is  constrained.  During  this  phase,  the  actuator  has  to  produce  the  force  required  to  extend  the 
spring.  Finally,  both  phalanges  are  in  contact  with  the  object  and  the  finger  has  completed  the  shape  adaptation 
phase.  The  actuator  force  is  distributed  among  the  two  phalanges  in  contact  with  the  object.  It  should  be  noted  that 
this  sequence  occurs  with  a  continuous  motion  of  the  actuator.  Notice  also  the  mechanical  limit  that  allows  a  pre- 
loading  of  the  spring  to  prevent  any  undesirable  motion  of  the  second  phalanx  due  to  its  own  weight  and/or  inertial 
effects,  and  to  prevent  hyperextension  of  the  finger.  Springs  are  useful  for  keeping  the  finger  from  incoherent 
motion,  but  when  the  grasp  sequence  is  complete,  they  still  oppose  the  actuator  force.  Thus,  they  should  be  designed 
with  the  smallest  stiffness  possible,  however  sufficient  to  keep  the  finger  from  collapsing. 

The  basic  property  of  the  transmission  system  of  an  underactuated  finger  is  to  offer  n  >\  DOF  produced  with  fewer 
than  n  actuators.  In  Figure  2,  the  transmission  stage  consists  of  a  five -bar  linkage  (the  base  joint  is  a  double  pivot) 
with  two  DOFs  but  one  angle  is  initially  constrained  to  a  particular  value  with  the  spring  and  the  mechanical  limit. 

4.2.  Force  analysis  of  underactuated  finger 

A  two  phalanx  finger  is  considered  in  Fig. 2.  The  input  torque  Tf  is  applied  to  the  link  a  which  transmits  the  torque  to 
the  whole  finger  trough  phalanges.  A  rotational  spring  with  force  T  is  located  at  O  which  moves  the  phalanx  back  to 
its  original  position  in  absence  of  external  force.  The  closing  process  is  shown  in  Fig  2.  Providing  a  mechanical  limit 
can  help  in  order  to  make  pre -tension  for  the  spring  to  prevent  undesirable  motion  of  the  second  phalanx  and  also 
hyper-flexion  of  the  finger. 
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Fig. 2.  Underactuated  hand  model  and  exerted  forces 

To  obtain  the  static  model  between  inputs  and  outputs  of  the  finger  the  virtual  work  principle  is  used.  Equating  the 
input  and  output  virtual  powers  results 

(1) 

Where  t  is  the  input  torque  vector  exerted  by  the  actuator  and  the  spring,  the  rotational  velocity  vector, /is  the 
vector  of  contact  forces,  and  v  is  the  velocity  of  the  contact  points  along  the  normal  vector  of  each  phalanx.  Contact 
forces  are  assumed  to  be  normal  to  the  phalanges  and  without  friction.  Each  element  in  the  above  equation  can  be 
expressed  as 

^  Lr  =  -fcA&J 


i:;] 

Ki 

^  hciyi] 

The  normal  velocities  of  the  contact  point  can  be  expressed  as  a  Jacobian  matrix  /t  and  the  derivatives  of  the 
phalanx  joint  coordinates  which  is  a  natural  choice,  as  i?  =  J  j  S  or 


(2) 

(3) 

(4) 

(5) 


yl|  _ 
y2 


+  l^^cos 


:i 


(6) 


Through  differential  calculus,  one  also  can  relate  vector  to  the  derivatives  of  the  phalanges  joint  coordinates 
defined  previously  with  an  actuation  Jacobian  matrix  Ja  as  ^ 


Where  X=1  and 


Finally,  one  obtains 


Y  = 


=  1*  nP* 


C  [[j  mB[9i-9^  +  92-\P^] 

c  [[i  sin  J  01  -  3^) +-C  sin  (.0i-02  +  02-ijSO] 


(7) 


(8) 


f=lT^lft  (9) 

which  is  the  equation  that  provides  a  practical  relationship  between  the  actuator  torque  and  contact  forces.  If  the 
spring  contribution  is  neglected  the  analytical  expression  are  rather  simple  linear  functions  of  the  actuator  torque. 


€.  ki  k;  (cot  ^  CCS  -cfi  +  sin  ^Ti) 

f  = - - - T 

41  kj  (cot  j?  CCS  4ri  +  sin  CTi )  ^ 


(11) 
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where  h  =  c(:Cos(&2  “  sin(  02  —  cot/?)  is  the  distance  between  point  O^and  the  intersection  of  lines 

(00^^  and  ).  Also,  oij^is  the  angle  between  link  a  and  the  first  phalanx.  It  can  be  shown  that 

cot  ^?  cos  a  1  -h  sin  a  i  (12) 

■  ^  ^  BIB  ^  ^  ^ 

where  X  is  the  angle  between  links  a  and  b. 


4.3.  Design  optimization 


After  obtaining  the  forces  equation  two  consideration  form  the  guidelines  for  design  parameters  selection:  first  grasp 
should  be  stable  which  means  ejection  should  be  prevented  and  differences  between  the  phalanx  forces  should  be 
minimum  possible  value.  In  Ejection  phenomena  the  finger  slide  and  push  the  object  out  instead  of  a  secure 
grasping.  To  prevent  ejection  the  exerted  forces  by  each  phalanx  to  the  object  should  be  positive.  It  is  also  desirable 
that  forces  at  each  phalanx  to  be  close  to  their  mean  value  and  force  distribute  evenly  between  phalanxes  which  is 
referred  to  as  force  isotropy.  So  the  conditions  which  should  be  satisfied  can  be  expressed  as: 


l/i.  >0  and  fi  >Q  ^  ’ 

In  order  to  have  force  isotropy  it  is  necessary  that  forces  by  each  phalanx  are  equal,  but  forces  are  function  of 
contact  position  and  &2  angle  hence  it  is  a  local  property.  Therefore  if  the  object  moves  these  conditions  are  not  true 
anymore.  However  in  this  case,  another  step  is  necessary  since  h  is  a  function  of  the  design  parameters  and  the  angle 
^2 .  Furthermore,  many  design  variables  are  available  to  satisfy  the  latter  equation,  namely  a,  b,  c,  and  d. 

For  instance,  if  one  chooses  a  =  b,  sl  known  c  (e.g.  resulting  from  minimal  distance  considerations)  and  T/f  =  ^,  a  is 


completely  defined  as 
with  , 


2  lit  sin  ij+t^  +  Ei 
a  = - 

2  B 

A  =  iC  —  l3(CC  —  l)  c^  F  +  c^il 


(14) 

(15) 


B  =  —c^  F  Cc^  —  F  2Ci^csm&2  F  (16) 


C  =  -K&2 


F 


_ ^2 _ 

■ftj  +h  +  ^ii 


(17) 


The  above  mentioned  relationship  can  be  used  in  order  achieving  isotropic  design.  However,  the  isotropic  property 
is  not  very  robust  with  respect  to  design  parameters,  so  it  suggests  using  the  following  method. 

If  one  obtains  an  isotropic  and  therefore  stable  design  for  a  particular  contact  set  &2X  it  may  be  of  interest 

that  the  finger  is  also  robust  with  respect  to  ejection  around  this  isotropic  point,  in  order  to  ensure  that  a  deviation 
from  this  configuration  does  not  lead  to  an  unstable  grasp.  The  final  aim  is  to  guaranty  stability  for  all  grasps  if 
possible  and  satisfy  certain  “quality”  based  indices  like  the  isotropy.  An  index  that  can  be  used  to  ensure  the  grasp 
stability,  even  if  the  proximal  contact  is  lost,  is: 

u  =  '  (18) 

id.  k  j  d  ^  2 


WherefiCJcj.ei)  is  a  Kronecker-like  symbol  for  characterizing  the  stability  of  the  contact  situation: 

,  00  =  f  ^  (19) 

^  0  otherwise 

This  index  is  the  ratio  between  the  stable  and  unstable  areas  in  the  grasp -state  plane  of  the  finger.  Contour  plots  of 
the  index  [i  is  illustrated  in  Fig  3.  for  a  mechanically  actuated  finger.  The  optimal  design  parameter  values  can  be 
obtained  using  the  following  plot.  In  our  design  equal  lengths  are  considered  for  both  phalanxes  (l2/li=l),  so  the 
optimal  value  for  c/a  is  around  0.6. 
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Performance  index 


Fig  3.  Performance  index  for  linkage  driven  2  phalanx  underactuated  hand 
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4.4.  Control  system 

The  control  is  aimed  at  exploiting  the  main  properties  of  underactuation  to  perform  motion  tasks  close  to  reference 
angles  obtained  by  EMG  signal.  The  ordinary  task  considered  for  design  and  development  of  the  motion  control  law 
is  the  finger  preshaping  for  the  palmar  grasp  of  a  cylindrical  object. 

Kinematic  coupling  among  the  joints  is  related  by  the  relation 

^2(^1  "b  ^2)  (20) 

"b  ^2(^1  "b  ^2'}  (21) 

The  dynamic  relation  among  the  joints  are  derived  in  equations  (10)  and  (11). 

4.4.1.  PD  Control  in  the  joint  space  with  elastic  compensation 

Dynamic  relation  (20)  and  (21)  is  used  to  actively  control  the  first  joint  and  passively  move  the  second  joint.  The 
proposed  control  law  is  a  modified  version  of  the  standard  PD  control  in  the  joint  space  with  gravity  compensation 
and  is  expressed  as 

T-,=Kj-  Kj  T  gm  T  T,,  (22) 

Where  &  =  —9  is  the  joint  position  error  defined  as  the  difference  between  the  reference  set  point  ^b^nd  the 

current  joint  angle  is  the  estimation  of  joint  gravitational  torque,  and  and  i^^jare  the  diagonal  gain 

matrices  for  the  proportional  and  derivative  control  actions,  respectively.  In  addition  to  the  standard  PD  control  plus 
gravity  compensation,  an  elastic  term  is  introduced  in  order  to  compensate  for  the  preload  spring  located  between 
phalanxes  joint. 

The  joint  elastic  torque  is  expressed  as  =  kA&2 . 

4.5.  Numerical  simulation 

Based  on  results  of  optimal  design  a  model  of  two  phalanx  finger  is  made  in  Adams  software  linked  with 
Matlab/Simulink,  which  is  shown  in  Fig.  3.  Both  phalanxes  has  the  equal  length  and  c/a  ratio  is  0.6  based  on  optimal 
design  analysis.  Torsion  spring  is  located  between  two  phalanxes.  The  revolute  joint  is  located  at  joints  and  a  motor 
is  moving  the  finger  which  is  shown  by  round  arrow.  A  circular  object  is  chosen  to  be  grasped  and  the  proposed 
controller  is  used  to  control  finger  movement. 


Fig. 3.  The  two  phalanx  finger  modeled  in  Adams  software 
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By  applying  the  control  algorithm  to  the  mechanism  the  finger  can  grasp  the  object.  The  grasping  sequence  is  shown 
in  Fig.  4  . 


Fig.  4.  The  grasping  sequence  of  a  circular  object  by  underactuated  hand 


The  finger  tip  angle  respect  to  horizontal  plane  is  shown  in  Fig.  5.  It  starts  from  90  degree  and  after  first  phalanx  has 
contact  with  the  object  the  rate  of  change  of  angle  is  changed. 
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Analysis:  Last.Run  Time  (sec)  2011-05-16  02:40:16 

Fig.  5.  Finger  tip  angle  respect  to  horizontal  plane  for  underactuated  hand 

Angle  between  two  phalanxes  is  shown  in  Fig.  6.  The  angle  starts  from  180  degree  and  gradually  changes  until 
second  phalanx  touches  the  object. 


finger  tip  angle  respect  to  horizontal  plane 


Angle  between  two  phalanxes 


Analysis:  Last_Run  Time  (sec)  2011-05-16  02:40:16 


Fig. 6.  Angle  between  two  phalanxes  for  underactuated  hand 
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4.6.  Comparison  study  between  fully  actuated  and  underactuated  hand 

Two  general  design  which  are  fully  actuated  and  underactuated  and  appropriate  control  methods  for  each  of  them 
are  provided  for  prosthetic  hand.  In  order  to  compare  the  functionality  of  these  two  methods  a  fully  actuated  finger 
with  the  same  dimension  and  with  a  similar  object  to  grasp  is  simulated.  Power  grasping  algorithm  which  described 
before  is  used  in  order  to  control  the  movement.  The  sequence  of  movement  is  shown  in  Fig.  7.  The  finger  tip 
angle  respect  to  horizontal  plane  is  shown  in  Fig.  8  and  the  angle  between  two  joints  is  shown  in  Fig.  9. 


Fig.  7.  The  grasping  sequence  of  a  circular  object  by  a  fully  actuated  hand 
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Fig. 8.  Finger  tip  angle  respect  to  horizontal  plane  for  fully  actuated  hand 


Analysis:  Last_Run  T»ne(sec)  2011-05-16  05:21:06 

Fig. 9.  Angle  between  two  phalanxes  for  fully  actuated  hand 


As  we  can  see  both  methods  are  capable  to  perform  grasping  and  the  graphs  are  very  similar  for  both  methods. 
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5.  Robust  Control  of  a  Prosthetic  Hand 

A  finger  can  be  considered  as  a  3  link  robot,  while  in  extracting  the  model  for  angle  estimation,  the  PIP  joint  (the 
second)  angle  is  considered,  the  third  link  angle  normally  has  about  70%  of  the  second  joint  angle  and  the  first  link 
angle  is  not  considered  in  this  research.  As  a  result  a  two-link  planar  robot  is  considered  as  a  plant  to  investigate  the 
control  approach  performance. 

A  dynamic  model  can  be  derived  from  the  general  Lagrange  equation  method.  The  modeling  of  a  two -link  planar 
nonlinear  robotic  system  with  assumption  of  only  masses  in  the  two  joints  can  be  found  in  the  literature,  e.g.,  [3,  4]. 
However,  in  practice,  the  robot  arms  have  their  mass  distributed  along  their  arms,  not  only  masses  in  the  joints  as 
assumed.  Thus,  it  is  desired  to  develop  a  detailed  model  for  two -link  planar  robotic  systems  with  the  mass 
distributed  along  the  arms.  We  present  a  new  detailed  consideration  of  any  mass  distributions  along  robot  arms  in 
addition  to  the  joint  mass.  Moreover,  it  is  also  necessary  to  consider  numerous  uncertainties  in  parameters  and 
modeling.  Thus,  robust  control,  robust  adaptive  control  and  learning  control  become  important  when  knowledge  of 
the  system  is  limited.  We  need  robust  stabilization  of  uncertain  robotic  systems  and  furthermore  robust  performance 
of  these  uncertain  robotic  systems.  Robust  stabilization  problem  of  uncertain  robotic  control  systems  has  been 
discussed  in  [21-23,  24-26]  and  many  others.  Also,  adaptive  control  methods  have  been  discussed  in  [21,27]  and 
many  others.  Because  the  closed-loop  control  system  pole  locations  determine  internal  stability  and  dominate  system 
performance,  such  as  time  responses  for  initial  conditions,  papers  [26,28]  consider  a  robust  pole  clustering  in 
vertical  strip  on  the  left  half  splane  to  consider  robust  stability  degree  and  degree  of  coupling  effects  of  a  slow 
subsystem  (dominant  model)  and  the  other  fast  subsystem  (non-dominant  model)  in  a  two -time- scale  system.  A 
control  design  method  to  place  the  system  poles  robustly  within  a  vertical  strip  has  been  discussed  in  [26,  28-30], 
especially  [26]  for  robotic  systems.  However,  as  mentioned  above,  for  accurate  prosthetic  hand  control  there  is  a 
need  of  a  detailed  and  practical  two -link  planar  robotic  system  modeling  with  the  practically  distributed  robotic  arm 
mass  for  control. 

Therefore  a  practical  and  detailed  two -link  planar  robotic  systems  modeling  and  a  robust  control  design  for  this  kind 
of  nonlinear  robotic  systems  with  uncertainties  considered  for  robust  control  approach  with  both  Hoo  disturbance 
rejection  and  robust  pole  clustering  in  a  vertical  strip.  The  design  approach  is  based  on  the  new  developing  two -link 
planar  robotic  system  models,  nonlinear  control  compensation,  a  linear  quadratic  regulator  theory  and  Lyapunov 
stability  theory. 

5.1.  Modeling  of  Prosthetic  Hand  Systems 

The  dynamics  of  a  rigid  revolute  robot  manipulator  can  be  described  as  the  following  nonlinear  differential  equation 
[21,22,  26,  30]: 

F^,  =  M(q]  q  -h  V(q,  q)  q  -h  N(q,  q)  (4) 

NCq,  q]  =  GCq!)  +  F,3  q  +  (5) 

where  MCq?  is  an  n  x  n  inertial  matrix,  VCq,  q3  an  n  x  n  matrix  containing  centrifugal  and  coriolis  terms,  GCq]  an  n  x 
1  vector  containing  gravity  terms,  q(t)  an  n  xl  joint  variable  vector,  F,,  an  n  xl  vector  of  control  input  functions 
(torques,  generalized  forces),  F^^an  n  x  n  diagonal  matrix  of  dynamic  friction  coefficients,  and  F_g(^  an  n  x  1  Nixon 
static  friction  vector. 

However,  the  dynamics  of  the  robotic  system  (4,5)  in  detail  is  needed  for  designing  the  angle  control,  i.e.,  especially, 
what  matrices  M(q)  ,  VCq,  q)  and  G(q)  are. 

Consider  a  two -link  planar  robotic  system  representing  the  prosthetic  hand  finger  in  Fig.  8,  where  the  system  has  its 
joint  mass  and  of  joints  1  and  2,  respectively,  robot  arms  mass  and  distributed  along  arms  1  and  2 

with  their  lengths  1^  and  Ij  ,  generalized  coordinates  qi  and  q^  ,  i.e.,  their  rotation  angles,  q  =  [qt.  qj],  control 
torques  (generalized  forces)  and  ,  F^,  =  [ft.fj]. 
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Fig  8-  A  two  link  robot  system  representing  prosthetic  hand 


5.2.  Robust  Control 

In  view  of  possible  uncertainties,  the  terms  in  (4,5)  can  be  decomposed  without  loss  of  any  generality  into  two  parts, 
i.e.,  one  is  known  parts  and  another  is  unknown  perturbed  parts  as  follows  [22,  26]: 

M  =  Mp  -h  AM  N  =  N.U  -h  AN.  V=V^-\-  AV  (6) 

where  N,[j,  are  known  parts,  AM,  AN,  A V  are  unknown  parts.  Then,  the  models  in  previous  section  can  be 
used  not  only  for  the  total  uncertain  robotic  systems  with  uncertain  parameters,  but  also  for  a  known  part  with  their 
nominal  parameters  of  the  systems. 

Following  [26],  we  develop  the  torque  control  law  as  two  parts  as  follows: 

=  MoCqiqd  +  VjCq,  q]q  +  N^Cq,  q3  -  Mo(q3u  (7) 

where  the  first  part  consists  of  the  first  three  terms  in  the  right  side  of  (7),  the  second  part  is  the  term  of  u  that  is  to 
be  designed  for  the  desired  disturbance  rejection  and  pole  clustering, is  the  desired  trajectory  of  q,  however,  the 
coefficient  matrices  are  with  all  nominal  parameters  of  the  system.  Define  an  error  between  the  desired  q^  and  the 
actual  q  as: 


e  =  qd  -  q 


From  (4)  and  (6)-(8),  it  yields: 

e  =  M  "^(q)[AM(q]  q^  F  AV(q.  q]  q  F  AN(q.  q]  F  M^^(q)  u]  =  w  F  Ee  F  Fu  F  u 
E  =  -M-Hq]AVCq.  q),  F  =  -M-Hq3AMCq3.  w  =  -Fq^  -  Eq^  F  M"^AN 
From  [26],  we  can  have  the  fact  that  their  norms  are  bounded: 

llwll  <  II Ell  IlFll  <6f 

Then,  it  leads  to  the  state  space  equation  as: 

X  =  Ax  F  Bu  F  B[0  E]x  F  BFu  F  Bw 


X  =  [2  =  [ei  ej 


(8) 

(9) 

(10) 

(11) 

(11) 

(12) 


The  last  three  terms  denote  the  total  uncertainties  in  the  system.  The  desired  trajectory  q^for  manipulators  to  follow 
is  to  be  bounded  functions  of  time.  Its  corresponding  velocity  q^  and  acceleration  q^,  as  well  as  itself  q^  ,  are 
assumed  to  be  within  the  physical  and  kinematic  limits  of  manipulators.  They  may  be  conveniently  generated  by  a 


model  of  the  type: 

qj(t3  FK,.qd(t3  FKpq^W  =  r(t]  (13) 

where  r(t]  is  a  2-dimensional  driving  signal  and  the  matrices  and  Kp  are  stable. 

The  design  objective  is  to  develop  a  state  feedback  control  law  for  control  u  in  (7)  as 

uCtD  =  Kx(t3  (14) 

such  that  the  closed-loop  system: 

X  =  (A  -  BK  F  B[0  E]  -  EFK)x  F  Bw  (15) 

has  its  poles  robustly  lie  within  a  vertical  strip  ^l: 

g  ^>  =  [s  =  X  F  jy|  -  €^2  <  X  <  <  0}  (16) 

and  a  S -degree  disturbance  rejection  from  the  disturbance  to  the  state  x,  i.e., 

llT>:;vCs]IL  =  II (si  -  A^]"^BlL  <  5  (17) 

4,  F  A  -  BKF  B[0  E]_BFK  (18) 


we  derive  the  following  robust  control  law  to  achieve  this  objective  is  discussed  in  [20,26]. 
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Consider  prosthetic  hand  uncertain  system  (15)  with  (4)-(18)  where  the  unstructured  perturbations  in  (10)  with  the 
norm  bounds  in  (1 1),  the  disturbance  rejection  index  S  >  0  in  (17),  the  vertical  strip  in  (16)  and  a  matrix  Q  >  0. 


With  the  selection  of  the  adjustable  scalars  and  ,  i.e., 

(1  —  ^  -El  ^  ,  (1  “  %  “  >  -^  >  0  (19) 

there  always  exists  a  matrix  P  >  0  satisfying  the  following  Riccati  equation: 

AWP  +  PV  -  (l  -  -  j)  PBB'P  +  (J)l  +  (^)l  +  Q  =  0  (20) 

where 

V  =  A  +  %!  =  [  Q "  (21) 

Then,  a  robust  pole-clustering  and  disturbance  rejection  control  law  in  (7)  and  (14)  to  satisfy  (17)  and  (18)  for  all 
admissible  perturbations  E  and  F  in  (1 1)  is  as: 

u  =  -Ex  =  -rB'Px  (22) 

if  the  gain  parameter  r  satisfies  the  following  two  conditions: 

(0  r>  0.5  and  (23) 

Cii)  2aj  P  +  A'P  +  PA  -  f-1 1  -  [2r(l  +  PBB  'P  >  0  (24) 

Proof  for  the  approach  is  provided  in  [26,  28]. 

It  is  also  noticed  that: 


It  is  evident  that  condition  (i)  is  for  the  -ffii  degree  stability  and  S  degree  disturbance  rejection,  and  condition  (ii)  is 
for  the  -04  degree  decay,  i.e.,  the  left  vertical  bound  of  the  robust  pole -clustering. 

There  is  always  a  solution  for  relative  stability  and  disturbance  rejection  in  this  form.  It  is  because  the  Riccati 
equation  (20)  guarantees  a  positive  definite  solution  matrix  P,  and  thus  there  exists  a  Lyapunov  function  to 
guarantee  the  robust  stability  of  the  closed  loop  uncertain  robotic  systems.  The  nonlinear  compensation  part  in  (7) 
has  a  similar  function  to  a  feedback  linearization. 

5.3.  Numerical  Simulation 

Based  on  the  proposed  control  approach,  a  two  link  robot  is  modeled  considering  uncertainties.  Then  the  input  signal 
from  sEMG-Angle  estimation  model  is  used  as  reference  signal  to  the  plant  and  the  performance  is  evaluated. 

The  system  parameters  are:  link  mass:  nin  —™2  =  0-05Kg  ,  lengths  1^  =  12  =  0.03™,  angular  positions 
Ts  applied,  torques  fj  (Nm) . 

The  initial  states  are  set  as  qj^CO!)  =  q.  C03  =  0,  and  q^CO]  =  (O)  =  0.  The  parametric  uncertainties  are  assumed 

to  satisfy  (11)  with  Bf  =  0.05,  0^  =  0.4  ,  =  0.1.  Select  the  adjustable  parameters  =  0.01,  =  0.01  from  (19), 

disturbance  rejection  index  6  =  0.1  ,  the  relative  stability  index  0.1  ,  and  the  left  bound  of  vertical  strip 

cLj  =  2000  since  we  want  a  fast  response.  We  solved  the  Riccati  equation  (20) 
to  get  the  solution  matrix  P  and  the  gain  matrix  as: 

[1269312  15S4I21 

^  “  I  153412^  1643 y 

K=  rBP  =  [95OI29S5I2] 

Numerical  simulation  is  done  in  Matlab  software.  For  the  plant  the  above  mentioned  parameters  is  used.  Two  sets  of 
simulation  are  done.  In  the  first  simulation  nominal  plant  is  used  and  for  the  second  simulation  the  perturbed  model 
considering  uncertainty  is  tested.  The  input  signal  for  both  simulations  is  measured  angles  from  the  above  mentioned 
experiments  from  PIP  joint.  For  the  third  joint  the  70%  of  the  measured  angle  of  PIP  joint  used  which  is  a  good 
estimate  of  that  signal. 

The  system  response  with  nominal  plant  and  perturbed  plant  to  the  input  signal  respectively  are  shown  in  Fig.  9  and 
Fig.  10.  As  it  is  shown  the  input  and  output  signals  are  close  and  system  is  capable  of  following  the  command  signal 
with  sufficient  accuracy.  Obviously  the  system  has  a  better  performance  in  case  of  nominal  plant  compare  to  the 
perturbed  model  in  which  the  uncertainties  are  applied. 


196  of  329 


Fig.  9-  System  response  to  the  nominal  plant 


Fig.  9-  System  response  to  the  perturbed  plant 
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6.  Stable  Grasping  by  Prosthetic  Hand  Using  Tactile  Feedback  and  Hand  Kinematics 

Grasp  planning  is  a  fundamental  problem  in  the  field  of  robotics  that  has  been  attracting  an  increasing  number  of 
researchers  [4],  [15],  [9],  [13],  [12].  One  fact  about  many  existing  grasp  planning  algorithms  is  that  they  all  require 
some  information  about  the  object  to  be  grasped,  i.e.  either  a  2D  image  as  required  in  [15],  [12]  or  a  full  3D 
geometric  model  as  in  [4] .  In  case  of  a  prosthetic  hand  although  visual  information  might  be  exist  by  amputee  but 
the  data  regarding  object  shape  is  not  directly  available  for  prosthetic  hand  controller. 

As  human  beings,  it  is  intuitive  and  straightforward  for  us  to  grasp  objects  even  when  we  cannot  see  them. 
Lederman  and  Klatzky  have  shown  [8]  that  humans  have  the  ability  to  “blindly”  recognize  objects  with  a  high 
degree  of  accuracy.  Humans  can  also  create  stable  grasps  on  unknown  objects  in  the  total  absence  of  any  visual 
feedback.  This  ability  is  sorely  lacking  with  current  robots  that  are  performing  grasping  tasks.  Using  tactile  sensing 
for  object  recognition  has  been  explored  by  many  researchers.  Some  recent  work  includes  [16],  [7],  [11],  [19]  using 
tactile  exploration  for  grasping,  Bierbaum  et  al.  proposed  a  method  to  generate  grasp  affordances  based  on 
reconstructed  faces  of  an  object  through  tactile  exploration  [1].  In  this  report,  we  are  attempting  to  use  non -visual 
tactile  and  kinematic  feedback  to  predict  stable  grasps  on  an  unknown  object  for  a  3  fingers  prosthetic  hand  which  is 
capable  of  expanding  to  a  5  fingers  hand. 

We  take  a  machine  learning  approach  to  this  problem.  A  problem  with  this  approach  is  to  generate  datasets  of 
reasonable  size  that  encode  tactile  and  kinematic  information  on  robotic  grasps.  To  overcome  this,  we  use  a  tactile 
simulator  on  a  large  database  of  objects  to  be  grasped. 

The  Columbia  Grasp  Database  (CGDB)  [6]  consists  of  over  300,000  stable  grasps  over  7,256  objects  and  for  several 
robotic  hands,  including  Barrett  hands  of  different  surface  materials  and  a  simulated  human  hand.  It  provides  us  with 
a  pool  of  robotic  grasp  data  from  which  we  can  simulate  a  tactile  sensor  system  and  collect  useful  tactile  feedback.  It 
then  allows  us  to  use  this  simulated  tactile  feedback  data  to  learn  the  stability  of  a  prosthetic  hand  grasp. 

In  Section  II,  we  describe  a  soft  finger  contact  model  used  to  simulate  tactile  feedback.  In  Section  III,  we  describe 
the  procedure  to  collect  simulated  tactile  feedback  from  grasps  in  CGDB.  In  Section  IV,  we  talk  about  the  feature 
vectors  we  used  to  represent  each  grasp  and  build  an  SVM  that  accepts  these  feature  vectors  as  input  to  predict  the 
stability  of  the  corresponding  grasp.  Simulations  are  described  and  discussed  in  Section  V,  followed  by  conclusions 
in  Section  VI. 

6.1.  SOFT  FINGER  CONTACT  MODEL 

Tactile  sensors  play  an  important  role  in  representing  the  contacts  between  the  surface  of  the  hand  and  the  object 
that  are  touching  each  other.  The  output  of  the  tactile  sensors  around  each  contact  is  characterized  by  the  forces 
applied  at  each  sensor  cell.  So,  a  reasonable  contact  model  that  approximates  the  contact  region  and  the  pressure 
distribution  is  necessary  for  simulating  a  reasonable  tactile  feedback.  Pezzementi  et  al.  [18]  used  a  point  spread 
function  model  to  simulate  the  response  of  a  tactile  sensor  system.  In  our  approach,  we  build  our  tactile  simulation 
system  based  on  a  soft  finger  contact  model  proposed  by  Ciocarlie  et  al.  [3].  We  briefly  introduce  this  model  as 
follows. 

A.  Contact  Region  Approximation 

In  Graspit!  each  contact  is  initially  considered  as  a  point  contact  since  the  two  bodies,  i.e.  the  hand  and  the  object, 
are  assumed  as  rigid  bodies.  In  the  real  world,  however,  the  hand  and  the  object  in  contact  are  actually  deformable  to 
some  extent,  resulting  in  an  area  in  contact  rather  than  a  point.  A  point  contact  assumption  then  no  longer  holds 
reasonably.  To  simulate  the  contact  region  between  the  two  bodies  touching  each  other,  we  use  a  soft  finger  contact 
model  as  is  developed  in  [3].  This  model  takes  into  account  the  local  geometry  and  structure  of  the  objects  in  contact 
and  captures  frictional  effects  such  as  coupling  between  tangential  force  and  frictional  torque.  It  locally 
approximates  the  surfaces  of  the  two  touching  bodies  as 

Zi  =  -h  -h  C^xy,  i  G  [1,2}  (1) 

where  the  local  contact  coordinate  system  has  its  origin  at  the  center  of  the  contact  and  the  z  axis  aligned  with  the 
contact  normal.  The  subscript  i  distinguishes  the  contacting  bodies  from  each  other. 
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Table  I 

Configuration  of  Sensor  Pads  on  a  Prosthetic  Hand 


Location 

Num.  of  Cells 

Res.  (mm) 

Grid 

Palm 

24 

10*10 

4*6 

Mid-Digit 

24 

6*6 

8*3 

Eingertip 

22 

6*6 

7*3-f1  tip 

Table  II 

TEST  ACCURACY  ON  5641  GRASPS  (%) 


Classification 

Ealse  Neg. 

Ealse  Pos. 

Accuracy 

Predct. 

Predct. 

70.4 

19.4 

10.2 

The  seperation  between  the  two  surfaces  h  is 


h  =  (A A2)x^  -h  (.B^  -  -h  (Cl  -  Cjixy  (2) 

By  choosing  the  orientation  of  the  x  and  y  axes  so  that  the  term  in  xy  vanishes,  we  can  end  up  with  the  separation  h 
between  the  two  surfaces  in  the  form  of 


(3) 


where  R  and  J?  are  the  relative  radii  of  curvature  of  the  objects  in  contact,  depending  only  on  their  local  geometry. 


B.  Pressure  Distribution 

After  a  contact  region  is  determined,  we  consider  how  the  forces  are  formed  within  the  contact  region  so  that  the 
response  of  the  corresponding  tactile  sensor  cells  can  be  analyzed  and  evaluated.  To  express  the  pressure  distribution 
inside  a  contact  region  using  non-planar  models  that  take  into  account  the  local  geometry  of  the  objects  involved,  we 
choose  a  Hertzian  model  as  used  in  [3].  In  this  model,  the  ratio  of  frictional  torque  to  contact  load  which  is  used  to 
compute  the  eccentricity  parameter  of  the  friction  ellipsoid  can  be  obtained  from 


p 


(4) 


where  u  is  the  frictional  coefficient,  is  a  frictional  moment  about  the  contact  normal,  P  is  the  contact  load,  and  a 
and  h  are  the  lengths  of  the  semi-axes. 


6.2.  TACTILE  SENSOR  SIMULATION 

A.  Tactile  Sensor  Configuration  of  a  Prosthetic  Hand 

In  prosthetic  hand  simulation  the  tactile  sensors  attached  on  the  surfaces  of  the  palm,  the  mid -digit  links  and  the 
fingertip  links.  The  tactile  sensor  system  contains  seven  major  sensor  pads  which  cover  many  possible  hand-object 
contact  points  of  the  hand.  Each  pad  has  22  to  24  tactile  sensor  cells  which  results  in  a  162 -cell  sensor  system.  The 
configuration  of  these  sensor  pads  and  sensor  cell  arrangement  is  described  in  Table  I. 

Algorithm  1:  Computing  tactile  feedback 

Input:  A  robotic  grasp  with  a  list  of  point  contacts  between  the  hand  and  the  object 

Output:  Seven  2D  arrays  that  carry  the  simulated  tactile  sensor  values  of  the  corresponding  sensor  cells 

1.  Initialize  the  output  tactile  sensor  cell  arrays  to  zero’s 

2.  foreach  point  contact  do 

3.  Calculate  the  relative  radii  at  the  contact 

4.  Calculate  the  contact  region 

5.  Discretize  the  contact  region  to  10  *  10  sub-regions 

6.  Calculate  the  forces  within  each  discretized  sub -region  according  to  the  pressure  distribution 
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7.  foreach  discretized  contact  sub-region  do 

8.  foreach  tactile  sensor  cell  do 

9.  if  the  discretized  contact  sub-region  overlays  on  the  tactile  sensor  cell 

10.  then 

11.  Accumulate  the  force  of  the  discretized  contact  sub -region  onto  the  overlaying  tactile  sensor  cell 

12.  end 

13.  end 

14.  end 

15.  end 

16.  Return  the  sensor  cell  arrays 

B.  Generating  Tactile  Feedback  from  the  CGDB 

Based  on  the  soft  finger  contact  model,  we  can  compute  the  contact  region  for  a  hand-object  contact  as  well  as  the 
pressure  distribution  within  the  contact  region.  Since  a  tactile  sensor  cell  performs  as  an  atomic  sensing  unit,  we 
discredited  the  soft  finger  contact  region  so  that  we  can  accumulate  the  total  forces  within  each  discrete  part  and  use 
this  to  compute  the  forces  sensed  on  each  corresponding  tactile  sensor  cell. 

We  summarize  the  procedure  to  generate  the  tactile  feedback  of  a  robotic  grasp  in  Algorithm  1.  Figure  2  shows  an 
example  of  a  simulated  tactile  feedback. 


6.3.  LEARNING  THE  STABILITY  OF  A  ROBOTIC  GRASP 

Following  the  explanation  of  the  simulation  process,  we  now  discuss  the  way  we  built  an  SVM  classifier  that 
predicts  the  stability  of  a  given  robotic  grasp.  Once  trained,  this  classifier  can  be  used  efficiently  to  estimate  the 
stability  of  a  robotic  grasp  without  even  knowing  the  geometric  or  visual  information  about  the  object  to  be  grasped. 


(e)  Palm  (a)  Grasp 
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Fig.  2.  Tactile  Sensor  Simulation,  Figure  2(a)  show  a  robotic  grasp  of  a  Barrett  hand  on  a  mug,  Figure  2(b),  2(c),  and 
2(d)  show  the  tactile  responses  on  finger  FI,  F2,  F3  respectively.  In  each  group,  the  left  one  is  the  tactile  pad  on  the 
finger  tip  and  the  right  one  is  the  tactile  pad  on  the  mid  finger.  Figure  2(e)  shows  the  tactile  readings  on  the  palm. 
The  8-bit  scale  (0  -  255)  goes  from  blue  (no  response)  to  red  (saturation). 


A.  Grasp  Dataset 

Our  grasp  data  is  from  the  CGDB  database.  This  database  contains  hundreds  of  thousands  of  grasps  constructed 
from  several  robotic  hands  and  thousands  of  object  models.  Object  models  used  in  the  CGDB  are  from  the  Princeton 
Shape  Benchmark  (PSB)  [17].  The  PSB  provides  a  repository  of  3D  models  which  span  across  many  objects  that  we 
encounter  everyday.  One  fact  about  the  PSB  model  set  is  that  the  models  were  not  originally  selected  with  an  eye 
towards  robotic  grasping  or  prosthetic  grasping,  and  so  some  of  the  models  are  not  obvious  choices  for  grasping 
experiments.  For  example,  the  model  set  contains  insects,  which  are  often  outside  our  everyday  grasping  range. 
Although  the  CGDB  provides  grasps  for  all  these  object  models  in  the  PSB,  instead  of  using  the  full  set  of  grasps  in 
the  CGDB,  we  choose  to  select  grasps  computed  on  a  smaller  set  of  objects  that  are  more  frequently  grasped  and 
manipulated  by  us  in  our  everyday  life.  In  total,  we  collected  about  15,000  robotic  grasps  from  936  objects  across  23 
different  classes. 


Fig.  3.  A  robotic  grasp  whose  contacts  are  not  fully  captured  by  the  current  tactile  sensor  syetem.  Figure  3(b)  to  3(e) 
show  the  tactile  sensor  outputs  in  each  of  the  seven  sensor  pads.  Only  contacts  on  the  tip  of  the  Finger3  are  captured 
in  the  system  as  shown  in  3(d).  Contacts  that  are  on  the  other  two  fingers.  Finger  1  and  Finger2,  are  not  captured  by 
the  tactile  system. 


B.  Labeling  Grasps 

In  the  CGDB,  all  of  the  grasps  are  good  in  terms  of  their  physical  properties,  i.e.  they  either  have  good  Ferrari- 
Canny  grasp  metric  volume  qualities  or  good  epsilon  qualities  [5].  The  epsilon  quality,  e,  measures  the  minimum 
relative  magnitude  of  the  outside  disturbances  that  could  destroy  the  grasp.  So,  when  we  take  into  account  the  limit 
of  the  maximum  forces  a  prosthetic  hand  can  apply,  a  grasp  would  be  less  stable  if  it  has  a  smaller  epsilon  quality. 
This  is  because  the  smaller  epsilon  quality  indicates  that  a  relatively  smaller  outside  disturbance  can  break  this  grasp 
even  when  the  robotic  hand  has  already  applied  the  maximum  forces  it  supports. 

Another  consideration  is  from  the  perspective  of  the  environment  uncertainty.  Due  to  the  uncertainty  of  the 
environment,  objects  may  move  away  slightly  from  their  original  position  during  a  grasp  execution.  A  fragile  grasp 
may  fail  to  fully  grasp  the  object  in  this  situation  while  a  stable  one  may  display  its  robustness  and  still  succeed  in 
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grasping  the  object  in  the  perturbation.  We  have  experimentally  found  a  strong  correlation  between  this  robustness 
and  the  epsilon  quality. 

We  have  found  that  grasps  with  epsilon  quality  e  >  0.07  tend  to  be  more  robust  in  uncertain  object  perturbations. 
Based  on  the  above  two  considerations,  for  grasps  that  are  form-closure,  they  may  also  differ  from  each  other  in  the 
sense  of  being  more  stable  or  less  stable.  So,  we  treat  those  more  stable  grasps  as  good  grasps  and  the  less  stable 


Fig.  4.  A  good  robotic  grasp  which  is  classified  correctly.  Figure  4(b)  to  4(e)  show  the  tactile  sensor  outputs  in  each 
of  the  seven  sensor  pads.  All  of  those  contacts  are  captured  by  the  seven  tactile  sensor  pads. 


ones  as  bad  grasps.  Using  a  threshold  =  0.07  as  the  boundary,  we  label  grasp  i  as  a  good  (1)  or  a  bad  (0)  grasp  as 
follows: 


label  (graspi 


if 


E(.grasp{)  < 
otherwise 


(5) 


C.  Feature  Vector 

For  a  normal  human  grasp,  two  properties  are  usually  perceived  by  us.  One  is  the  tactile  sensing  which  specifies  the 
contact  configuration  between  our  hands  and  the  object.  The  other  is  the  hand  kinematics  which  indicates  how  our 
hands  are  shaped  around  the  object  for  the  manipulation.  These  two  pieces  of  information  help  us  predict  whether 
this  is  a  stable  grasp.  In  the  prosthetic  hands,  we  use  the  same  idea  to  synthesize  a  feature  vector  for  a  robotic  grasp: 
we  use  tactile  and  kinematic  information  to  characterize  a  grasp. 

Given  a  robotic  grasp,  the  output  of  the  simulated  tactile  sensor  system  is  a  group  of  seven  2D  arrays.  Each  array  is 
corresponding  to  one  sensor  pad.  Each  element  of  an  array  stores  the  value  of  the  force  sensed  in  the  corresponding 
sensor  cell.  We  vectorize  each  of  these  2D  arrays  into  one  dimensional  vectors  and  concatenate  them  together.  This 
gives  us  a  162-dimensional  vector.  In  addition  to  the  tactile  feedback,  we  also  obtain  the  values  of  the  seven  joint 
angles  of  a  prosthetic  hand  when  a  grasp  is  applied  and  append  them  to  the  end  of  the  162 -dimensional  tactile 
feedback  vector.  This  makes  the  final  feature  vector  169 -dimensional. 
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Fig.  5.  False  negative:  A  good  robotic  grasp  which  is  classified  incorrectly  as  a  bad  one.  Figure  5(b)  to  5(e)  show  the 
tactile  sensor  outputs  in  each  of  the  seven  sensor  pads.  The  problem  here  is  that  the  contacts  on  the  edges  of  the 
fingers  are  not  fully  captured. 

D.  Scaling 

A  feature  vector  contains  both  the  162 -dimensional  tactile  feedback  and  the  7-dimensional  joint  values.  They  are 
from  two  totally  different  domains  and  of  two  different  dimensions.  Instead  of  feeding  them  directly  into  a  training 
algorithm  which  will  treat  each  dimension  in  both  the  tactile  feedback  and  the  joint  angle  equally,  we  scale  each 
dimension  of  the  tactile  data  and  the  joint  data  differently  so  that  these  two  major  parts  can  be  weighted  equally  on 
the  whole. 

For  each  tactile  feedback  we  first  normalize  the  162-  dimensional  tactile  feedback  such  that  they  sum  up  to  one. 
Specifically  we  write  it  down  as  follows, 


Ti  = 


(6) 


Then,  for  a  feature  vector,  the  scaling  approach  we  used  is  to  scale  the  dimensions  of  the  tactile  part  such  that  the 
standard  deviation  across  all  the  samples  is  one  while  to  scale  the  dimensions  of  the  joint  angle  part  such  that  the 
standard  deviation  is  where  is  considered  as  a  weight  factor  that  balances  the  weights  between  the  tactile 
feedback  and  the  joint  angle  values.  More  specifically,  a  feature  vector  x  =  [7  /],7  E  J  E  is  scaled  as 
follows: 


{  if  l<i<  162 
if  163<e<169 


(7) 


where  denotes  the  e ‘■^dimension  of  the  feature  vector,  std  ''  denotes  the  standard  deviation  in  the  e'^^  dimension.  In 
our  scaling  process,  we  used  the  same  std  '■  computed  from  the  training  set  to  scale  the  test  data. 
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Fig.  6.  False  positive:  A  bad  robotic  grasp  which  is  classified  incorrectly  as  a  good  one.  Figure  6(b)  to  6(e)  show  the 
tactile  sensor  outputs  in  each  of  the  seven  sensor  pads.  All  of  those  contacts  are  captured  by  the  seven  tactile  sensor 
pads.  However,  they  are  on  the  edges  of  the  fingers  and  the  dramatic  surface  normal  differences  between  the  object 
and  the  robotic  hand  at  the  contact  location  may  confuse  the  classifier. 


6.4.  Simulation  and  Results 
A.  Training  and  Testing  Dataset 

Tactile  feedback  is  a  core  component  in  our  feature  vector.  Inside  Graspltl,  the  physical  simulation  system  is  able  to 
capture  all  the  possible  contacts  between  a  robotic  hand  and  the  object.  Although  the  current  PPS  tactile  sensor 
system  captures  many  possible  hand-object  contacts,  there  are  still  locations  the  system  does  not  cover.  For  example. 
Figure  3  shows  a  grasp  when  a  prosthetic  hand  is  grasping  a  wrench.  The  contacts  on  the  edges  of  the  fingertips,  FI 
and  F2,  cannot  be  captured  by  the  current  tactile  sensor  system.  However,  it  is  detected  and  considered  in  the 
physical  simulation  system  inside  Graspit!  for  the  computation  of  the  epsilon  quality.  For  such  kind  of  grasps  which 
involve  contacts  in  uncovered  regions,  they  cannot  be  fully  represented  by  the  tactile  sensor  system,  either  the 
simulated  or  the  real  one.  Therefore,  there  is  an  inconsistency  in  these  grasps  between  the  physical  simulation  and 
the  real  world  and  this  inconsistency  may  influence  the  performance  of  the  classification. 

Since  grasps  with  fewer  number  of  non-zero  tactile  responses  have  more  potential  to  contain  un-captured  contacts, 
we  first  filter  out  grasps  from  the  grasp  dataset,  D,  obtained  in  Section  IV-A  based  on  the  number  of  sensor  pads  that 
have  non-zero  responses.  Since  each  sensor  pad  is  a  flat  plane,  a  stable  grasp  must  have  at  least  two  sensor  pads  in 
contact  with  the  object  being  grasped,  resulting  in  at  least  two  sensor  pads  with  non-zero  responses.  In  our 
experiment,  we  first  divide  the  grasp  dataset  D  into  two  subsets,  D1  and  D2.  D1  contains  all  the  grasps  that  have 
only  one  tactile  sensor  pad  with  non-zero  responses,  while  D2  contains  all  the  grasps  with  at  least  two  tactile  sensor 
pads  having  nonzero  responses. 

We  then  choose  2/3  grasps  from  D2  that  evenly  distributed  among  all  the  objects  to  generate  our  training  set.  We  put 
the  remaining  1/3  of  the  grasps  from  D2  into  the  test  set.  Although  contacts  of  grasps  in  D1  are  not  fully  captured  by 
the  simulated  tactile  system,  their  tactile  feedback  would  be  realistic  considering  a  real  prosthetic  hand  with  a  real 
tactile  system.  In  order  to  keep  this  potential  considered  as  in  a  real  working  environment,  we  do  not  want  to  rule 
them  out  for  testing.  Thus,  we  put  all  the  grasps  from  D1  in  the  testing  set,  and  the  test  set  is  a  union  of  D1  and  1/3 
ofD2. 
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B.  Results 


During  scaling,  we  tried  different  ^^’s.  worked  best  in  our  experiment.  To  train  an  SVM  classifier,  we 


used  libsvm  [2].  We  used  a  RBF  kernel  with  5 -fold  cross  validation  to  determine  the  best  cost  parameter  C  and  RBF 
parameter  y. 

After  we  trained  our  SVM  classifier,  we  fed  the  grasps  in  the  testing  set  to  the  classifier.  Experiment  results  are 

l'l62 

shown  in  Table  II.  In  total,  the  best  overall  accuracy  we  get  is  70.38%  with  =  •  In  this  experiment,  only  10.2% 


grasps  are  incorrectly  classified  as  positive.  This  means  that  a  grasp  will  be  classified  incorrectly  as  a  good  one  with 
only  a  small  probability.  It  also  indicates  the  conservativeness  of  this  classifier  which  is  very  necessary  in  a  blind 
grasping  context.  Because  usually  we  can  just  keep  searching  for  another  grasp  if  we  mis-classify  a  good  grasp  to  be 
a  bad  one,  but  the  cost  or  risk  is  usually  too  high  to  tolerate  if  we  execute  a  grasp  that  is  actually  bad  but  mis- 
classified  as  a  good  one. 

In  Table  III,  we  show  more  detailed  statistics  on  the  accuracy  in  each  object  class  based  on  our  best  result.  In  the 
context  of  blind  grasping,  the  false  positive  predictions  are  more  important  in  our  consideration  because  of  the  high 
cost  we  have  to  pay  for  a  false  positive  prediction.  We  summarized  the  percentages  of  false  positive  predictions  of 
each  object  class. 

In  Figure  4,  5,  and  6,  we  show  some  example  test  grasps.  Based  on  these  test  results,  we  find  some  interesting 
points. 


For  grasps  whose  contacts  are  fully  captured,  they  have  more  potential  to  be  classified  correctly.  Figure  4 
shows  an  example  grasp  whose  contacts  are  fully  captured  by  the  tactile  sensor  system.  This  is  an  example  grasp 
that  is  classified  correctly.  In  contrast.  Figure  5  is  a  false  negative  prediction.  As  is  shown  in  the  tactile  sensor 
response,  the  contacts  on  the  fingers  are  not  fully  captured  by  the  current  tactile  sensor  system.  This  makes  the 
tactile  feedback  incapable  to  carry  enough  information  to  represent  the  grasp.Thus,  losing  tactile  information 
increases  the  potential  of  a  false  prediction. 

Contacts  on  the  edges  of  the  finger  may  confuse  the  classifier  and  result  in  more  false  predictions.  Figure  6 
shows  a  false  positive  example.  Although  all  the  tactile  pads  have  non-zero  responses,  many  of  the  contacts  are  on 
the  edges  of  the  fingers.  In  this  situation,  the  contact  normals  on  the  object  surface  differ  dramatically  from  that  of 
the  surface  of  the  finger.  But  a  tactile  sensor  can  only  record  the  normal  forces  leaving  the  tangential  forces  un- 
captured.  The  tactile  sensor  representation  does  not  fully  capture  the  grasp  feature. 

When  contacts  are  not  fully  captured,  hand  kinematics  may  confuse  the  classifier.  As  we  can  see  in  Figure  6, 
two  of  the  three  fingers  of  the  Prosthetic  hand  are  shaped  towards  the  other  one.  In  general,  a  grasp  with  a  set  of 
contacts  that  are  facing  each  other  is  more  likely  to  be  a  good  one  and  having  fingers  facing  towards  each  other 
increases  the  potential  of  such  contacts.  In  this  sense,  without  further  distinction  obtained  from  the  tactile  sensor 
feedback,  the  hand  kinematics  may  confuse  the  classifier  to  make  it  consider  this  grasp  as  a  good  one. 


7.  Conclusion  and  future  works 

In  this  repot,  power  grasping  control  for  fully  actuated  hand  based  on  virtual  spring  damper  hypothesis  is 
investigated.  This  method  is  applicable  in  real  time  and  does  not  rely  on  information  about  object  shape  to  be 
grasped.  Besides  it  can  follow  command  line  from  EMG  model. 

Using  the  virtual  spring  damper  precision  grasping  of  fully  actuated  hand  is  covered  in  section  3.  Similarly  the 
method  is  applicable  for  real-time  implementation  and  independent  of  information  about  object  shape. 

Section  4  discussed  the  underactuated  hand  design  and  optimization.  Furthermore,  position  and  force  control  method 
are  presented  and  the  results  are  compared  with  power  grasping  technique  of  fully  actuated  hand. 

Section  5  covered  robust  control  method  to  follow  accurately  angle  command  signal  from  EMG  signal  analysis  in 
presence  of  plant  uncertainty.  In  this  part  the  EMG  model  is  mixed  with  control  technique  and  overall  performance 
of  the  hand  is  analyzed. 


Future  works  will  be  focused  on  other  control  strategies  to  follow  command  signal  from  EMG  for  both  force  and 
position  models  and  mixing  EMG  model  and  control  strategies.  The  fuzzy  control  is  a  powerful  technique  which 
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will  be  studied  to  this  aim.  Sliding  mode  control  is  another  option  which  is  robust  and  also  appropriate  for  nonlinear 
plants.  This  technique  can  be  used  for  both  force  and  position  control  of  the  prosthetic  hand.  Any  other  control 
technique  which  fits  to  this  problem  might  be  considered  too. 

Moreover,  the  precision  grasping  and  power  grasping  techniques  based  on  virtual  spring  damper,  requires 
improvement  to  follow  more  precisely  command  signal  from  EMG  signal.  Current  method  is  based  on  impedance 
control  and  it  should  be  relate  to  force  and  position  reference  signal  more  accurately. 

For  underactuated  hand,  simple  PID  controller  were  studied  which  can  be  improved  by  more  powerful  control 
techniques  like  fuzzy  control,  neural  networks,  nonlinear  control  and  any  other  applicable  technique. 
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Goal  2B:  Embedded  Hierarchical  Real-Time  Systems 

INTRODUCTION:  The  annual  work  under  this  Goal  involved  the  following  key  tasks:  (1)  the  construction  of  a 
test  bed  that  integrates  the  software  tool  chain  and  prototype  hardware  (test  bed);  (2)  the  study  on  design  and 
Implementation  of  the  real-time  control  strategies  on  the  embedded  test  bed,  and  the  study  and  experimental  set  up 
of  a  real-time  operating  system  on  the  embedded  processor  used  in  (1);  (3)  the  study  of  integrating  sEMG 
acquisition,  filtering  techniques  and  models  on  the  embedded  test  bed  for  real-time  control,  signal  processing  and 
acquisition.  The  primary  purpose  of  this  work  is  to  develop  an  embedded  control  system  by  researching,  designing, 
testing,  and  prototyping  the  hardware  and  software  for  the  system. 

System  Design 

Test  Bed  for  Embedded  Systems  Prototyping 

A  test  bed  based  on  a  32-bit  embedded  processor  (a.k.a.  programmable  intelligent  controller,  or  PIC)  was  built. 
Figure  3  depicts  the  test  bed,  where  Stage  1  represents  the  (micro-level)  signal  processing  circuitry  composed  of  the 
processor,  its  I/O  expansion  board,  and  the  wiring  needed  to  receive  input  sEMG  signals  and  produce  output 
actuation  signals  for  the  plant  (the  controlled  one-finger  device).  Stage  2  consists  of  circuit  elements  and  wiring  for 
motor  powering,  actuation,  and  isolation  of  the  motor  circuit  from  the  Stage  1  circuit  for  protection  of  the  embedded 
processor  against  power  surge. 


Figure  3.  Overview  of  the  test  bed  (omitting  the  software  tool  chain  computer) 


For  Stage  1,  a  Microchip  PIC32-I  was  used  to  implement  our  system.  Based  on  this  processor,  we  selected  the  dsPIC 
block  set  to  generate  the  C  code  for  PIC32-I  from  Simulink.  The  intent  of  this  approach  for  the  tool  chain  is  due  to 
the  fact  that  our  controller  designs  are  being  specified  in  Matlab  models;  and  Simulink,  along  with  its  Real-Time 
Workshop  toolbox,  provides  a  logical  and  efficient  path  from  model  to  prototype  implementation  and  testing,  for  a 
given  controller  design.  The  processing  flow  of  the  various  elements  of  the  tool  chain  is  shown  in  Figure  4,  which 
builds  and  releases  the  executable  of  the  controller  to  the  PIC. 
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Figure  4.  Processing  flow  for  generating  code  to  the  processor 

Several  hardware  modules  within  the  PIC32-I  were  also  used,  including  the  Analog  Input  module,  the  Digital 
Output  module,  the  Output  Compare  module,  and  the  UART  module.  The  Analog  Input  module  was  used  for 
reading  the  input  sEMG  as  well  as  sensory  feedback  data  from  the  prototype  hand.  PIC32-I  has  an  internal  analog  to 
digital  converter.  A  real-time  control  strategy  uses  the  data  from  the  Analog  Input  module  as  a  reference  signal  or 
the  set  point.  Based  on  the  control  strategy,  the  Digital  Output  module  generates  digital  control  signals.  The  Output 
Compare  module  then  generates  a  pulse  width  modulated  (PWM)  waveform  with  a  specific  duty  cycle,  based  on  the 
input  analog  signal  (i.e.  the  sEMG).  The  UART  module  is  used  to  transmit  the  signals  from  PIC32-I  to  a  personal 
computer  via  the  serial  (i.e.  RS-232)  communication.  This  interface  enabled  us  to  debug  and  evaluate  the 
performance  of  control  strategies. 

For  Stage  2,  we  used  the  SN754410  quadruple  half-H  driver  to  actuate  the  motor  with  the  control  signal.  The  pin 
configuration  for  the  H-driver  is  shown  in  Figure  5.  The  PWM  signal  from  the  Output  Compare  module  is  connected 
to  pinl  (labeled  “1,2EN”)  of  the  H-driver.  The  digital  outputs  of  the  PIC32-I  are  connected  to  the  direction  pins  of 
the  H-driver  (pins  2  and  7).  By  switching  the  digital  outputs  to  0  and  1  between  the  direction  pins,  the  motor  will 
rotate  clockwise  or  counter-clock  wise.  Vcci  and  Vcc2  are  connected  to  the  5 -volt  DC  supply  of  the  PIC32-I  I/O 
expansion  board. 
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Figure  5.  Pin  configuration  of  the  quadruple  half-H  driver. 

The  test  bed  and  its  operation  was  demonstrated,  in  the  form  of  recorded  video,  to  the  researchers  at  the  Applied 
Physics  Laboratory  of  Johns  Hopkins  University,  a  major  collaborator  on  the  TATRC  project  with  which  ISU  is  a 
part  of.  The  JHU  APL  researchers  expressed  their  interest  in  further  collaboration  with  ISU  in  several  areas 
including  this  and  the  validation/verification  of  sEMG  signal  processing  algorithms. 

Design  and  Implementation  of  Real-Time  Control  Strategies: 

In  this  work  [1],  the  threshold  values  establish  a  correlation  between  the  sEMG  and  the  corresponding  force  required 
for  the  power  grasp  of  an  object.  C.Potluri  et.  al  [2]  explained  the  correlation  between  sEMG  entropy  threshold 
values  and  skeletal  muscle  forces.  These  threshold  values  are  fed  as  the  reference  or  a  set  point  to  the  controller.  The 
signal  flow  is  depicted  as  a  block  diagram  in  Figure  6. 


Microcontroller 


Figure  6.  Block  diagram  of  the  real-time  control  signal  flow. 

The  force  feedback  signal  is  acquired  by  a  force  sensitive  resistor  (FSR).  The  FSR  is  mounted  on  the  fingertip  of  the 
prosthetic  hand  prototype  as  shown  in  Figure  8.  The  error  is  computed  as  the  difference  between  the  reference 
value  and  the  actual  force  from  the  FSR.  A  proportion-integral  (PI)  controller  is  employed  to  generate  the  actual 
force  from  the  FSR,  and  make  it  equal  to  the  reference  force  in  order  to  reduce  the  error  e(t')  to  zero.  The  PI  control 
action  is  given  below  in  Equation  (1). 

*  p(t)  -h  e(j}dr,  (1) 

In  Equation  (1),  u(t)  is  the  control  signal,  is  the  proportional  gain,  and  is  the  integral  gain,  p(t)is  the  error, 
and  T  is  the  dummy  integration  variable.  Gain  parameters  and  Ky  are  tuned  using  the  Ziegler-Nichols  method  in 
MATLAB®. 

Our  proposed  design  was  implemented  on  a  PIC32-I  microcontroller  in  two  stages:  “Signal  Processing”  and  “Motor 
Actuation.”  The  Signal  Processing  stage  facilitates  the  implementation  of  real-time  control  strategies.  A  dsPIC 
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blockset  was  used  to  generate  the  C  code  for  the  PIC32  from  Simulink®.  The  dsPIC  blockset  generates  a  .hex  file, 
and  this  file  is  imported  by  MPLAB®  to  program  the  PIC. 

Sisnal  Processing  Stase 

We  used  the  following  modules  of  the  PIC32  as  a  part  of  implementing  our  control  strategies:  the  Analog  Input 
module,  the  Digital  Output  module,  the  Output  Compare  module,  and  the  UART  module.  The  Analog  Input  module 
was  used  for  reading  the  sEMG  and  sensory  feedback  data.  The  PIC32  has  an  internal  analog  to  digital  converter 
(ADC)  which  has  a  10-bit  resolution  so  that  it  can  distinguish  up  to  1024  different  voltages,  usually  in  the  range  of  0 
to  3.3  volts,  and  it  yields  3mV  resolution.  A  real-time  control  strategy  was  developed  using  the  threshold  value  of 
the  entropy  of  sEMG  data  as  a  reference  or  set  point.  The  difference  between  the  threshold  of  the  sEMG  entropy  and 
the  ESR  feedback  was  fed  in  to  the  PI  control  loop  to  reduce  the  error  to  zero.  The  Digital  Output  module  of  the 
PIC32  was  used  to  generate  digital  control  signals.  Depending  on  the  error,  a  pulse  width  modulated  (PWM)  wave 
with  a  specific  duty  cycle  was  generated  in  the  Output  Compare  module.  The  UART  module  in  the  PIC32  was  used 
to  transmit  the  signals  from  the  microcontroller  to  the  PC  via  serial  communication.  In  this  design,  a  virtual  com  port 
was  created  to  feed  the  data  via  USB  cable  to  the  computer.  MATLAB®  was  used  to  read  the  signals  from  the  ports. 
This  enables  the  user  to  troubleshoot  and  see  the  performance  of  the  designed  control  strategy.  The  design  is 
consistent  with  our  initial  system  design  and  the  embedded  test  bed. 

Motor  Actuation  Stase 

A  SN754410  quadruple  half-H  driver  is  used  to  actuate  the  motor  with  the  corresponding  control  signal.  Pig.  3 
shows  the  schematic  of  the  pin  configuration  of  the  half-H  driver.  The  PWM  signal  from  the  Output  Compare 
module  was  connected  to  pint  (1,  2EN)  of  the  H  driver.  The  PWM  wave  enables  this  H  driver.  The  speed  of  the 
motor  depends  on  the  duty  cycle  of  the  PWM  wave  from  the  Output  Compare  module,  which  is  a  function  of 
The  digital  outputs  of  the  PIC32  microcontroller  are  connected  to  the  direction  pins  of  the  Hdriver  (pins  2  and  7). 
Switching  the  digital  outputs  to  0  and  1  between  the  pins  will  makes  the  motor  rotate  in  clockwise  and  counter¬ 
clockwise  directions.  Vcd  and  Vcc2  are  connected  to  the  5V  supply  of  the  PIC32  I/O  board.  This  proposed  design  was 
tested  on  an  index  finger  of  a  prosthetic  hand  prototype.  This  part  of  the  work  made  use  of  the  embedded  test  bed  as 
previously  described. 

Mechanical  Structure  of  Hand  Prototype 

The  robotic  hand  prototype  finger  has  three  degrees  of  freedom,  and  is  actuated  by  two  Pololu  35:1  mini  metal  gear 
motors  and  a  bevel  gear  transmission  system.  The  main  characteristic  of  this  prototype  is  its  biologically-inspired 
parallel  actuation  system  based  on  the  behavior/strength  space  of  the  ’’Flexor  Digitorum  Profundus  (FDP)”  and  the 
’’Flexor  Digitorum  Superficialis  (FDS)”  muscles  as  explained  in  Figure  7.  However  this  research  work  focuses  on 
the  “Region  1”  actuation  system  and  it  is  interfacing  with  a  microcontroller.  Region  1  is  populated  by  the  more 
frequent  dexterous  tasks. 


Figure  7.  Strength  space  of  FDS  and  FDP  muscles 

In  our  design,  the  movements  associated  with  Region  1  are  achieved  by  2  DC  motors.  The  motor  in  the  metacarpal 
phalange  of  the  finger  actuates  the  PIP  (Proximal  Inter  Phalangeal)  joint  and  the  motor  at  the  base  of  the  finger 
actuates  the  MCP  (Meta  Carpo  Phalangeal)  joint,  as  shown  in  Figure  8.  As  the  main  objective  of  this  work  is  to 
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interface  and  control  the  two  motors  with  a  microcontroller,  we  have  not  considered  the  belt  transmission  system 
which  is  designed  to  drive  the  DIP  (Distal  Inter  Phalangeal)  joint  as  well. 


Figure  8.  Region  1  actuation  scheme  for  the  finger 


Reportable  Outcomes 

Results  are  acquired  from  the  microcontroller  through  UART  channel  2  of  the  PIC32  by  a  virtual  com  port  via  USB 
at  57600  baud  rate.  The  data  from  the  microcontroller  is  converted  into  unitl6  data  before  it  is  transmitted  through 
the  UART.  The  PIC32  microcontroller  is  running  80  million  instructions  per  second  (MIPS)  with  its  phase  lock  loop 
(PLL)  activated.  It  is  running  at  an  external  clock  frequency  of  8MHz  with  internal  scaling  enabled. 
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Figure  9.  Feedback  force  and  error  before  grasp 
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Figure  9  depicts  the  feedback  force  from  the  FSR  and  the  error  before  the  grasp.  As  there  is  no  contact 
between  the  object  and  the  hand,  the  force  is  low  and  ideally  should  be  zero.  However,  because  the  PIC32’s  ADC 
module  has  a  high  resolution,  it  shows  some  values  even  when  the  object  is  not  in  contact. 
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Figure  10.  Feedback  force  and  error  after  grasp 

Figure  10  depicts  the  feedback  force  from  the  FSR  plotted  against  the  error  after  the  grasp.  The  error  i.e. 
the  difference  between  the  reference  force  from  the  sEMG  threshold  value  and  the  actual  force  feedback  from  the 
FSR,  is  almost  zero.  From  Figure  10,  it  is  also  evident  that  the  actual  force  from  the  FSR  is  almost  equal  to  the 
reference  force  value  that  is  established  from  the  sEMG  threshold  value,  as  the  error  approaches  zero.  Figure  1 1 
shows  the  computational  load  on  the  PIC32  while  performing  this  grasp.  It  indicates  that  the  microcontroller 
completed  the  computation  in  approximately  12ms.  The  rest  is  handed  over  to  the  I/O  blocks  of  the  microcontroller 
and  to  the  motor  actuation  stage. 


Figure  11.  Computational  load  on  the  PIC32  during  the  grasp. 

These  results  suggest  an  extensible  design  for  increased  load  on  the  processing  by  the  embedded  system. 

Real-Time  Operating  System  for  Embedded  Control 

For  our  work  FreeRTOS  is  used  to  schedule  several  tasks  that  the  microcontroller  needs  to  do,  based  on  their 
priority  levels.  These  tasks  include  sEMG  analysis,  high-level  control  (i.e.  the  control  strategy),  low-level  control 
(i.e.  the  motor  control),  receive  data  from  contact  sensors,  receive  data  from  force  sensors,  and  receive  data  from 
encoders,  among  others.  All  these  tasks  need  not  be  done  at  the  same  frequency.  Some  of  them  might  happen  only 
occasionally.  In  case  of  contact  an  interrupt  might  happen  and  the  controller  algorithm  might  change,  based  on  the 
event  driven  structure.  Control  load  for  each  situation  might  be  different.  A  task  is  an  independent  thread  of 
execution  that  contains  a  sequence  of  independently  schedulable  instructions.  Multitasking  is  the  ability  of  the 
operating  system  to  handle  multiple  activities  within  set  deadlines.  The  Free  RTOS  multitasks  in  such  a  way  that 
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many  threads  of  execution  appear  to  be  running  concurrently;  however,  the  OS  is  actually  interleaving  executions 
sequentially,  based  on  a  preset  scheduling  algorithm.  The  scheduler  ensures  that  the  appropriate  task  runs  at  the  right 
time.  FreeRTOS  supports  up  to  256  priority  levels,  in  which  0  is  the  highest  and  255  the  lowest.  With  a  preemptive 
priority-based  scheduler,  each  task  has  a  priority,  and  the  highest-priority  task  runs  first.  If  a  task  with  a  priority 
higher  than  the  current  task  becomes  ready  to  run,  the  kernel  immediately  saves  the  current  task’s  context  and 
switches  to  the  higher-priority  task.  When  that  is  done,  the  control  is  returned  to  the  original  task. 

An  experimental  setup  similar  to  the  one  shown  in  Figure  3,  but  with  Free  RTOS  installed  on  the  PIC32-I,  was  built. 
For  proof  of  concept,  the  embedded  processor  running  a  Free  RTOS  kernel  was  connected  to  two  different  sets  of 
components:  a  DC  motor  and  a  group  of  LED’s.  An  application  program  was  built  and  released  onto  the  PIC32-I, 
which  drove  the  DC  motor  and  flashed  the  LED’s  by  way  of  interleaving  the  two  separate  tasks,  with  equal  priority 
levels  assigned  to  both  tasks.  The  application  performed  as  designed  without  any  noticeable  delay.  While  the 
computational  loads  of  these  tasks  are  insignificant,  this  experiment  demonstrated  the  value  of  Free  RTOS  and  its 
potential  use  at  least  in  the  low-level  control,  where  multiple  motors  or  sensing  devices  will  likely  be  employed. 


I.  Proposed  Design  using  Model  reference  adaptive  controller  (MRAC) 

The  objective  of  the  embedded  system  design  is  for  the  prosthetic  hand  fingers  to  track  a  force  signal  as  closely  as 
possible.  Here,  the  force  signal  is  inferred  from  surface  EMG  (sEMG)  signals  obtained  from  the  array  of  the  three 
sEMG  sensors  located  at  the  arm.  The  sEMG  data  is  processed  by  filtering  and  using  a  sensor  fusion  algorithm  to 
facilitate  the  extraction  of  the  best  finger  force  estimates.  Sensor  fusion  is  done  in  the  frequency  domain  for  the 
sEMG  data  using  a  simple  elitism  based  Genetic  Algorithm  (GA).  The  data  from  the  three  sensors  is  collected 
around  the  corresponding  individual  motor  unit  location  at  the  transradial  arm  location  (flexor  digitorum 
superficialis)  and  before  fusing  are  rectified  and  filtered  using  a  Half  -Gaussian  filter,  as  given  by  (1). 

piMMG  \x)  =  2  X  — V=-,  (1) 

where  piEMG  \x)  is  a  conditional  probability  density  function,  x  is  3.  latent  driving  signal. 

System  identification  (SI)  is  used  to  identify  the  dynamical  relationship  between  the  sEMG  data  from  the  three 
sensors  and  Wg  and  the  corresponding  finger  force  of  a  healthy  male  subject.  In  this  fusion  algorithm.  Output 

Error  (OE)  models  are  used  and  are  constructed  for  each  individual  data  set.  The  OE  model  is  given  as  follows. 


-h  (2) 

Where  B,  and  Fare  the  polynomials,  q  is  shift  operator,  is  output  error,  is  system  output,  u  is  input,  nk  is 
the  system  delay  and  t  is  time  index. 

Using  the  three  resulting  OE  models  and  the  fusion  algorithm  given  by  [12]  a  corresponding  continuous -time  model 
is  constructed  as  given  by  the  transfer  function  as 

r  W  -  —  -  ^ b -  jg ^ + Pi 

Similar  to  the  discrete-time  case  nib  and  nf  determine  the  orders  of  the  numerator  and  denominator.  For  multi -input 
systems,  nb  and  nf  are  row  vectors,  b,  f  are  the  coefficients  of  the  numerator  and  denominator  polynomials 
respectively. 

A  MISO  transfer  function  is  constructed  based  on  the  poles  of  three  individual  OE  models  corresponding  to  each 
sensor.  GA  is  used  to  find  the  corresponding  zeros.  The  search  area  is  limited  to  the  unit  circle,  because  a  discrete 
time  model  is  used  (and  the  resulting  MISO  model  is  decreased  to  minimum  phase).  The  number  of  zeros  is  at  most 
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the  number  of  poles.  The  number  of  potential  zeros  is  set  to  the  order  of  the  corresponding  denominator.  The  error 
squared  of  the  resulting  MISO  system  H  (see  Appendix) 

and  the  recorded  force  signal  was  set  as  an  objective  function.  The  objective  function  /  is  constructed  as  follows, 

f  =  (4) 


where  to  and  tjf  are  the  initial  and  final  time  values, 

is  the  fusion  model  estimated  force  and  is  the  actual  force  from  the  FSR. 
The  MISO  system  H  (s)  is  constructed  as  follows, 


Pi,  1^’'  +^’1,2®’'  ■  ‘  1,1C+ 1  1 

^2, 1^^ +^2,2^^  — ^2,17—1 

P2,lf’'+P2,2S’''‘+-P2,,7+l 

™  _1C  .  ™  _TC-1  .  ™  I 

.TC-1  j 


■^3, - 


'■P3_l^!^  +^3_2S^"^+  -  .P3.TC-I 


(5) 


where  Z's  and  P's  are  the  zeros  and  poles  respectively  of  the  individual  transfer  function  and  n  is  the  order  of  the 
system. 

Feeding  the  new  data  sets  to  the  MISO  transfer  function  (H  (sj)  results  in  an  estimated  fusion  based  force  Y. 


Fig.  1.  Block  Diagram  of  Model  Reference  Adaptive  Control  (MRAC). 


The  controller  utilized  for  compensating  the  dynamics  of  the  prosthetic  hand  is  based  on  a  simple  MRAC  scheme. 
During  the  development  of  the  artificial  hand,  changes  are  being  undertaken  to  the  mechanical  design  and  drive 
trains  of  the  hand  that  affect  the  dynamics  of  the  finger  motion  of  the  prosthesis.  In  addition,  the  uncertain 
characteristics  of  the  kinematic  and  actuator  interaction  may  lead  to  different  performance  than  expected.  Hence,  a 
simple  MRAC  controller  is  devised  in  order  to  maintain  some  performance  stability.  The  controller  is  given  by  Fig. 
1  where  the  MIT  rule  is  used  for  updating  the  controller  parameter  3  , 

f  •  (6) 


The  gain  y  is  chosen  to  be  3.0  and  the  error  e  =  T  -  is  computed  by  the  difference  of  the  model  reference 
output  and  the  true  output  (force  generated  by  the  prosthetic  hand).  The  model  reference  is  chosen  to  be  of  first 
order  to  suppress  overshoot  and  facilitate  fast  response  time,  given  by 


=  At 

■■  28  + 1. 


(7) 
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II.  Proposed  Design  using  LQG  Controiler 


The  same  reference  force  [2,  3]input  in  equations  (1-5)  is  fed  to  the  LQG  controller.  The  controller  design  is  tested 
and  validated  theoretically  and  implemented  on  the  embedded  test  bed.  The  prosthetic  hand  dynamics  for  the 
theritical  verification  of  the  proposed  controller  is  given  as  follows. 


DYNAMICS  OF  PROSTHETIC  HAND 

The  dynamic  equations  of  motion  for  the  hand  are  obtained  from  the  Lagrangian  approach  as 


A  ^ 

dt  V54/ 


(5) 


where  g  and  q  represent  the  angular  velocity  and  angle  vectors  of  joints  respectively;  L  is  the  Lagrangian;  t  is  the 
given  torque  vector  at  joints.  The  Lagrangian  L  is  given  as 


L  =  T-  ¥, 


(6) 


where  T  and  F  are  denoted  as  kinetic  and  potential  energies  respectively.  Substituting  (6)  into  (5),  we  get  the 
following  dynamic  equations 


-h  Ctq,  g)  -h  Giq)  =  t,  (7) 

where  M  (g]  describes  the  inertia  matrix;  C(g,  g)  is  the  coriolis/centripetal  vector  and  Cg)  is  the  gravity  vector.  (7) 
can  be  written  as 


MCg)g  -h  x¥(g,  g]  =  t  ,  (8) 

where  Niq,  g3  =  CCg,  gj  -h  Giq)  represents  nonlinear  terms. 

Feedback  linearization  technique  is  used  to  convert  the  nonlinear  dynamics  represented  by  (8)  into  a  linear  state - 
variable  system  [8].  In  order  to  obtain  the  alternative  state-space  equations  of  the  dynamics,  the  position/velocity 
state  of  the  joint  is  defined  as 

x(t}  =  [g"(0  Vtt)]  '  ,  (9) 


and  rewriting  (8)  as, 

^gCO  =  -M"^(g(ri)[iV(g(0.  g(0)  -t(0]  (10) 

Therefore,  from  (9)  and  (10),  a  linear  system  in  Brunovsky  canonical  form  is  obtained  and  represented  as 

~[o 

The  control  input  vector  u(t)  given  by 

uit)  =  -x^f^tgCO  Jlx¥(g(0.g(0  )  -tCOJ.  (12) 

As  the  prosthetic  hand  is  required  to  track  the  desired  force  profile  q^(t^  described  under  the  reference  force 
model,  the  tracking  error  e(t}  is  defined  as 

=  (jjiCO  -  (13) 
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Here,  q^(t}  is  the  desired  angle  vector  of  the  joints  and  can  be  obtained  by  the  reference  force  model  [6];  is 
the  actual  angle  vector  of  the  joints.  Differentiating  (13)  twice,  we  get, 

,  e(t}  =  -  gCO-  (14) 

Substituting  (10)  into  (14)  gives 

eCO  =  -h  M"^(_gC0  J[iV(gCtL  gCO )  -t(0].  (15) 

From  (15)  the  control  function  can  be  defined  as 

icCt]  =  g^(t]  F  Af^tgCOjliVCgCO.  gWj  -  tCOJ.  (16) 

This  is  often  called  the  feedback  linearization  control  law,  rewriting  (16)  as, 

tW  =  M^gCOJlg^iCt)  - -uCt)  F  .¥(g(0.  g(0)J-  (17) 

Using  (14)  and  (16),  the  state  vector  x(0  =  the  state-space  model  can  be  represented  as 

^  [q  q] 

Now,  (18)  is  in  the  form  of  a  linear  system  such  as 

3cC0  =  +  BwCO  •  (19) 


LOG  CONTROLLER  DESIGN 


Given  the  prosthetic  hand  model  as 


/fc+i 


(20) 


The  observation  of  the  state  as 


yk=H,x,+v, 


(21) 


The  conditions  as 


1^*  }=  Gi’*  =  ^  >  and  0,i^k 
^{v^v^}=  R^,i  =  k  ,and  0,i  ^  k, 
s{w^.  I  =  OVt  and  k 


The  performance  index  is  given  by 
JiXi,Q,kQ)  =  sl—XkfFkfXkf  + 


“  To  find  the  best  estimator 


Step  1 :  Enter  the  prior  estimate  and  its  error  covariance  . 

Step  2:  Compute  Kalman  estimator  (filter)  gain 

k.,  =  p;A[h,p;A  +«.]■'  =p,A(pr' 


216  of  329 


Where 


P,u  =[I-K^H,]P,, 

Step  3:  Update  estimates  with  measurement  y^. 

(23) 
(24) 


=K  -H^xl] 

Step  4:  Project  ahead  the  state  and  the  error  covariance  as 

+GkUk 


^e(k+l) 


(25) 


Step  6:  goto  step  2  and  repeat 
To  find  the  best  optimal  control 


Step  7 :  Solve  the  matrix  difference  Riccati  equation 


P  =  F 


k+i 


(27) 


With  the  final  condition  P{k  =  kj^)  =  Fj^ 

Step  8:  Using  the  solution  of  from  step  7,  obtain  the  optimal  Kalman  controller  gain  as 

^k  ~\f^k^k+l^k  ^k^k+l^k  (^^) 

Step  9:  then  the  optimal  control  is  given  by 

^k  =-Kk^k+h  (29) 


Implementation: 

The  force  feedback  signal  is  acquired  by  a  Force  Sensitive  Resistor  (FSR).  The  FSR  is  mounted  on  the  fingertip 
of  the  prosthetic  hand  prototype  as  shown  in  Fig.  3.  A  simple  MRAC  is  employed  to  generate  the  actual  force  from 
the  FSR,  and  make  it  equal  to  the  model  reference  output  in  order  to  impose  a  desired  dynamical  response.  The 
proposed  control  design  is  implemented  on  a  PIC  32MX360F512L  microcontroller  in  two  stages:  “Signal 
Processing”  and  “Motor  Actuation”.  The  Signal  Processing  stage  facilitates  the  execution  and  implementation  of 
real-time  control  strategies.  A  dsPIC  block  set  is  used  to  generate  the  C  code  for  the  PIC  32  from  Simulink®.  The 
dsPIC  block  set  generates  a  .hex  file,  and  this  file  is  imported  in  MPLAB®  to  program  the  PIC  32. 

Signal  Processing  Stage: 

The  following  modules  of  the  PIC  32  are  used  for  the  implementation  of  the  signal  processing  stage. 

a.  The  Analog  Input  module 

b.  The  Digital  Output  module 

c.  The  Output  Compare  module 

d.  The  UART  module 
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The  Analog  Input  module  is  used  for  acquiring  the  sensory  feedback  force  data  from  the  FSR.  The  PIC  32  has  an 
internal  analog  to  digital  converter  (ADC)  which  has  a  10-bit  resolution  so  that  it  can  distinguish  up  to  1024 
different  voltage  values,  usually  in  the  range  of  0  to  3.3  volts,  and  it  yields  3mV  resolution.  The  Digital  Output 
module  of  the  PIC  32  is  used  to  generate  digital  control  signals  based  on  the  selected  control  strategy  to  the  motor 
actuation  stage.  This  module  detects  the  changes  in  the  reference/command  signal  and  flips  the  direction  bits 
between  0  and  1 .  The  motors  switch  direction  accordingly.  Depending  on  the  error,  a  pulse  width  modulated  (PWM) 
wave  with  a  specific  duty  cycle  is  generated  by  the  Output  Compare  module.  The  UART  module  in  the  PIC  32  is 
used  to  transmit  the  force  data  from  the  microcontroller  to  the  PC  via  serial  communication.  In  this  design,  a  virtual 
com  port  was  created  to  feed  the  data  via  USB  cable  to  the  computer.  MATLAB®  is  used  to  read  the  signals  from  the 
ports.  This  enables  the  user  to  troubleshoot  and  see  the  performance  and  accuracy  of  the  designed  control  strategy. 

Motor  Actuation  Stage: 

In  this  stage,  a  SN754410  quadruple  half-H  driver  [14]  is  used  to  actuate  the  motor  with  the  corresponding  control 
signal.  The  PWM  wave  from  the  Output  Compare  module  is  connected  to  the  pinl  (1,  2EN)  of  the  H  driver.  The 
PWM  wave  enables  this  H  driver.  The  speed  of  the  motor  depends  on  the  duty  cycle  of  the  PWM  wave  from  the 
Output  Compare  module  which  is  a  function  of  error  Therefore  the  speed  of  the  motor  is  adjusted  based  on  the 
error  to  achieve  desired  performance  and  accuracy.  The  digital  outputs  of  the  PIC  32  microcontroller  are  connected 
to  the  direction  pins  of  the  H  driver  (pins  2  and  7).  Switching  the  digital  outputs  to  0  and  1  between  the  pins  makes 
the  motor  rotate  in  clockwise  and  counter-clockwise  directions.  This  controls  the  finger  to  maintain  the  force  levels 
based  on  the  control  strategy.  Vcd  and  Vcc2  are  connected  to  the  5V  supply  of  the  PIC  32  I/O  board.  This  proposed 
design  was  tested  on  an  index  finger  of  a  prosthetic  hand  prototype.  Fig.  2  shows  the  test  bed  for  the  proposed 
design.  The  Mechanical  design  of  the  robotic  hand  prototype  is  explained  in  the  following  section. 


Fig.  2.  Embedded  Test  bed  for  the  proposed  design 

Results  and  Discussion 


Results  for  MRAC 

Data  is  acquired  from  the  microcontroller  through  UART  channel2  of  the  PIC  32  micro  controller  by  a  virtual 
com  port  via  USB  at  57600  baud  rate.  The  data  from  the  microcontroller  is  converted  into  unit  16  data  type  before  it 
is  transmitted  through  the  UART.  The  PIC  32  microcontroller  is  running  at  80  million  instructions  per  second 
(MIPS)  with  its  phase  lock  loop  (PLL)  activated.  It  is  running  at  an  external  clock  frequency  of  8MHz  with  internal 
scaling  enabled.  Fig.  3  depicts  the  experimental  results  of  the  proposed  design.  The  prosthetic  hand  prototype 
mathematical  model  is  used  instead  of  the  actual  hand  to  obtain  the  simulation  based  force  output  to  validate  the 
controller  performance.  The  simulation  based  force  output  converges  to  the  fusion  model  estimate  Y  in 
approximately  0.9  ms.  The  simulation  based  force  output  exactly  matches  the  fusion  model  estimated  force  Y  after 
the  convergence.  The  actual  force  output  from  the  FSR  (i.e.  Y)  closely  follows  the  fusion  model  estimated  force  Y. 
In  Fig.  3  there  are  some  instances  where  the  FSR  lost  contact  with  the  object,  as  indicated  by  a  sharp  drop  in  the 
force  curve. 
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Fig.  3.  Fusion  based  force  estimate,  simulation  based  force  and  actual  force  from  FSR  during  the  grasp. 
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Fig.  4.  Fusion  based  force  estimate  and  actual  force  from  FSR  during  the  grasp  (separate  experiment). 
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Fig.  5.  Fusion  based  force  estimate  and  actual  force  from  FSR  during  the  grasp  (for  a  repeated  experiment). 


Fig.  4  shows  the  fusion  model  estimated  force  Y  and  actual  force  from  the  FSR  (Y)  plotted  for  a  separate 
experiment.  In  this  case,  the  prosthetic  hand  prototype  is  made  to  maintain  a  minimum  constant  force  so  that  the 
contact  between  the  FSR  and  the  object  will  not  be  lost.  The  same  experiment  is  repeated  to  test  the  consistency,  and 
to  make  sure  that  the  object  is  in  contact  with  the  FSR  throughout  the  experiment. 
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Fig.  5  shows  the  repeated  experimental  results.  The  proposed  control  strategy  is  tracking  the  force  profile  and 
matching  the  actual  force  with  the  model  estimated  force  (  Y).  While  conducting  the  experiments,  the  following 
observations  were  made.  The  DC  motors  currently  employed  have  the  primary  task  of  moving  the  prosthetic  fingers. 
As  the  project  is  ongoing  research,  the  SMA  actuation  scheme  is  not  yet  implemented  because  of  the  slow  response 
of  the  SMA’s,  and  also  SMA’s  have  high  relaxation  time.  Therefore  it  is  difficult  to  track  a  randomly  changing  force 
profile  with  a  slowly  responding  actuation  system.  However,  as  the  hand  is  designed  to  use  the  parallel  actuation  of 
these  DC  motors  and  SMA’s,  the  DC  motors  alone  cannot  produce  fusion  model  estimated  force.  In  this  work,  the 
DC  motors  are  solely  responsible  for  the  motion  and  force  actuation.  Since  the  DC  motors  have  small  gear  heads, 
the  usual  characteristic  of  gear  driver  actuation  cores  occurs:  gear  backlash.  In  addition,  the  DC  motors  employed 
were  slow  in  responding  to  the  changes  in  the  force  profile.  Hence  some  gaps  were  observed  in  the  measured  force 
signal.  This  indicates  that  there  are  instances  in  which  the  fingertip  looses  contact  due  to  backlash  and  vibration 
problems.  However,  the  profile  of  the  measured  force  from  the  FSR  has  a  similar  pattern  as  the  fusion  model 
estimated  force  ( Y).  Thus  we  can  conclude  that  apart  from  those  mechanical  transmission  problems  the 
implemented  control  scheme  produced  promising  results.  These  problems  will  be  considered  in  a  new  prototype 
design  that  we  are  currently  developing.  It  is  also  evident  from  Figs.  4  and  5  that  the  minimum  constant  force  is 
needed  to  obtain  better  contact  with  the  object  and  to  accomplish  accuracy  in  tracking  the  reference  force  profile.  In 
order  to  test  the  precision  of  the  proposed  control  strategy,  15  different  experiments  were  conducted.  The  mean  of 
the  Pearson's  correlation  coefficient  (see  Appendix)  for  fusion  model  estimated  force  (  Y)  and  the  actual  force  from 
the  FSR  (Y)  in  all  the  15  experiments  is  0.86.  Because  of  the  above  mentioned  transmission  problems  and  the  slow 
response  of  the  gears,  slight  variability  is  observed  in  the  correlation  coefficients  for  the  15  experiments.  Hence  the 
difference  in  tracking  the  force  profile  is  observed  in  Figs.  4  and  5  Fig.  6  depicts  the  validation  plot  with  a  different 
fusion  based  force  estimate  Y  obtained  by  feeding  a  different  sEMG  signal  to  the  MISO  transfer  function 
The  fusion  based  force  estimate,  simulation  based  force  and  the  actual  force  from  the  FSR  are  all  shown  in  Fig.  9. 
The  same  mechanical  transmission  problems  and  the  slow  response  of  gears  are  observed  in  this  experiment  as  well. 
However,  the  controller  is  tracking  the  force  profile  and  the  Pearson's  correlation  coefficients  for  fusion  model 
estimated  force  (  Y)  and  the  actual  force  from  the  FSR  (Y)  is  0.84,  which  is  close  to  other  experiments. 


Results  for  LQG  Controller 
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Fig.  7.  States  corrupted  with  white  noise. 
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Fig.  8.  Fusion  based  force  estimate,  simulation  based  force  (force  output  from  the  LQG  controller) 
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Fig.  9.  Fusion  based  force  estimate  and  actual  force  from  FSR  during  the  grasp 

Figs  7  and  8  are  useful  to  validate  the  controller  performance.  The  plat  states  are  manually  corrupted  with  white 
noise.  It  is  evident  from  the  two  figures  that  the  controller  is  able  to  clean  out  all  the  white  noise  and  estimate  the 
states.  A  correlation  of  89%  is  achieved  between  the  reference  and  the  actual  force,  using  the  theoretical  controller 
design.  Fig.  9  shows  the  performance  of  the  controller  on  the  real  prosthetic  hand  after  prototyping  it  on  embedded 
test  bed.  In  the  real  time  implementation  a  correlation  of  82%  is  achieved  due  to  the  above  mention  mechanical 
design  problems. 

Position  Control 

EXPERIMENTAL  SETUP 


Fig.l:  Experimental  set-up. 


Fig.l.  illustrates  the  experimental  design  used  in  this  for  capturing  the  sEMG  signal  and  the 
corresponding  joint  angle  of  the  PIP  joint  of  the  index  finger.  Prior  to  placing  the  sEMG  sensors  on  the 
skin  surface,  the  test  subject  was  prepared  according  to  the  ISEK  standards.  The  motor  point  is  identified 
by  using  a  wet  probe  muscle  point  stimulator  (Richmar  HV-1000).  Nine  DE-3.1  sEMG  sensors  of  the 
DELSYS  Bagnoli-16  EMG  system  are  arranged  on  the  skin  surface  in  a  three -by-three  array.  The  middle 
rows  of  sensors  are  placed  on  the  motor  point  of  the  index  finger.  An  angle  measurement  device  is 
designed  using  a  lOk-Ohm  wheel  potentiometer  shown  in  Eig.I.  It  is  used  to  measure  the  PIP  joint  angle. 
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Force  Sensitive  Resistor  (FSR)  is  mounted  on  the  stress  ball  and  it  is  used  to  measure  the  force.  All  the 
data  is  acquired  at  a  sampling  rate  of  2000  samples/sec. 

PROPOSED  DESIGN 

The  objective  of  the  proposed  design  is  to  track  a  joint  angle  of  the  prosthetic  hand  as  closely  as  possible. 
Here,  the  joint  angle  signal  is  inferred  from  the  sEMG  signals  obtained  from  the  array  of  the  sEMG 
sensors  located  at  the  arm. 

Sensor  fusion  is  done  in  the  time  domain  for  the  sEMG  data  using  a  probability  based  Kullback 
information  criterion  (KIC)  fusion  algorithm.  The  data  from  the  nine  sensors  are  collected  around  the 
corresponding  individual  motor  unit  location  at  the  transradial  arm  location  (flexor  digitorum 
superficialis)  and  before  fusing  the  SEMG  are  rectified  and  filtered  using  a  Half  -Gaussian  filter,  as 
given  by  (1). 

p{EMG\x)  =  2  X  {  (1) 

-v27TX^ 

where  pCEMff  lx)  is  a  conditional  probability  density  function,  x  is  a  latent  driving  signal. 

System  Identification  (SI)  tool  is  used  to  determine  the  dynamic  relationship  between  the  input-output 
data.  The  sEMG  signal  is  used  as  input  and  the  corresponding  PIP  joint  angle  as  output.  In  particular, 
nonlinear  Wiener  Hammerstein  one-dimensional  polynomial  models  are  obtained  for  sEMG/joint  angle 
data. 

The  mathematical  representation  of  the  modeling  is  given  by, 

W(0  =  /-X 


B  (q) 

x(t)  =  — - w(t  -  nk) -\- e(t) ,  (3) 

y{t)  =  h{x{t)),  (4) 

where  u(t)  is  the  sEMG  signal  and  y(t)  is  the  PIP  joint  angle.  /  and  h  are  nonlinear  functions,  w{t} 
and  x(t)  are  internal  variables,  and  are  polynomials,  q  is  the  back  shift  operator,  and  e{t} 

is  the  output  error.  Prom  (3),  the  WH  model  structure  utilizes  a  linear  OE  model,  which  is  given  by, 

B(q) 

yit)  =  nk)  +  eit) 

F{q)  (5) 

where  nk  is  the  system  delay  and  t  is  time  index 

The  resulting  nine  WH  models  are  fused  together  by  using  a  probabilistic  the  KIC  algorithm  .It  assigns  a 
particular  probability  to  each  model.The  overall  estimated  model  output  and  the  individual  models 
outputs  are  compared  by  using  the  Pearson’s  correlation  coefficient. 


Prom  the  previous  research,  it  was  shown  that  the  KIC  algorithm  performs  better  than  the  other  criterions 
[12,  14].  KIC  is  a  asymmetric  measure  of  the  models  dissimilarity  which  can  be  obtained  by  the  sum  of 
the  two  directed  divergences  known  as  J-divergence  or  kullback’ s  symmetric  [15].  It  is  given  by 


KlC(pi) 


-logR,  + 


(Pj  +i)n 

n-pi  -2 


-ny/ 


^n-pi^ 


+  g(n) 


(7) 


Where  g(n)  =  n^ iog(n / 2) ,  y/  -  digamma  function. 

The  probability  based  fusion  algorithm  given  is  applied  to  the  nonlinear  models  obtained  by  using  SI 
technique  with  the  following  steps: 

1:  The  WH  models  are  obtained  by  considering  the  sEMG  data  ii(t)  as  input  and  joint  angle  Y  as  output. 
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2;  Calculate  the  residual  square  norm  i.e.,  R.  =¥-0.3.  =  \\Y -y\ 
where  3.  Oj  ^  0]Y  ,and 


3:  Compute  the  model  criteria  coefficients  using  (7). 

4:  The  model  probability  can  be  computed  using 

-h 

p(M^{t)\Z)  =  -f - 

7=1 

5:  The  fused  model  output  can  be  calculated  using 

Yf  =  Xp(Mi(t)\Z)Yi. 


Fig. 2:  Block  diagram  representation  of  Model  Reference  Adaptive  Controller  (MRAC) 

A  simple  MRAC  based  scheme  (Fig.  2)  is  utilized  for  compensating  the  dynamics  of  the  prosthetic. 
During  the  development  of  the  artificial  hand,  changes  are  being  undertaken  to  the  mechanical  design  and 
drive  trains  of  the  hand  that  affect  the  dynamics  of  the  finger  motion  of  the  prosthesis.  In  addition,  the 
uncertain  characteristics  of  the  kinematic  and  actuator  interaction  may  lead  to  a  different  performance 
than  expected.  Therefore,  a  simple  MRAC  controller  is  developed  in  order  to  maintain  some  performance 
stability.  For  updating  the  controller  parameter  0,  the  MIT  rule  is  used. 

—  =  -yeV^  .  (8) 

According  to  the  MIT  rule  [16]  the  gain  parameter  y  is  selected  to  achieve  the  desired  performance.  In 
this  Y  is  taken  as  3.0  and  the  error  e  =  Y  —  Y.^is  calculated  by  the  difference  of  the  model  reference 
output  Yj^  and  the  actual  output  (joint  angle  generated  by  the  prosthetic  hand). 

Reference  Model  Derivation 

The  dynamic  equations  of  motion  for  the  hand  are  obtained  from  the  Lagrangian  approach  as 


xCt)  = 


0 

0 


^]xW  +  [°]u(t), 


(15) 


The  control  input  vector  it  (f) given  by 

ii(t)  =  (?(t))  -  tCO].  (16) 


As  the  prosthetic  hand  is  required  to  track  the  desired  angle  profile  q^{t)  described  under  the  reference 
angle  model,  the  tracking  error  e{t)  is  defined  as 
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s(t)  =  £?d(t)  -  q(t). 


(17) 


Here,  is  the  desired  angle  vector  of  the  joints  and  can  be  obtained  by  the  reference  angle  model 

[20];  q{t}  is  the  actual  angle  vector  of  the  joints.  Differentiating  (17)  twice,  we  get, 

eCf)  =  -  4(0  .  s(t}  =  Qait}  -  qit).  (18) 

Substituting  (14)  into  (17)  gives 

e(t)  =  qi(t}+  M~^{q(t})[N{q(tX  qCO)  -tCO]  (19) 


From  (19)  the  control  function  ii(0can  be  defined  as 

u(0  =  qd(f)+  M“^(q(0)[jV(q(tX4C0} -t(0].  (20) 


This  is  often  called  the  feedback  linearization  control  law,  rewriting  (20)  as, 

t(0  =  M(ij(t))[i?dC0  -  -uCO  +  N{q(ty,  4(0)]  (21) 

Using  (17)  and  (20),  the  state  vector  jcCt)  =  [e'(0e'(f)]',  the  state-space  model  can  be  represented  as 


x(t)  = 


•0 

.0 


(22) 


Now,  (22)  is  in  the  form  of  a  linear  system  such  as 

x(t}  =  Ajt:(0  +  Bu(t)  .  (23) 

Implementation: 

The  proposed  control  design  is  implemented  on  a  PIC  32MX360F512L  microcontroller  in  two  stages: 
“Signal  Processing”  and  “Motor  Actuation”.  The  Signal  Processing  stage  enables  the  execution  and 
implementation  of  real-time  control  strategies.  A  dsPIC  block  set  is  used  to  generate  the  C  code  for  the 
PIC  32  from  Simulink®.  The  dsPIC  block  set  generates  a  .hex  file,  and  this  file  is  imported  in  MPLAB®  to 
program  the  PIC  32. 

Signal  Processing  Stage: 

In  spite  of  many  modules  available  on  PIC  32,  the  following  four  modules  are  utilized  for  the 
implementation  of  the  signal  processing  stage:  Analog  Input  Module,  Digital  Output  module.  Output 
Compare  module,  URAT  module. 

The  sensory  feedback  position  data  from  the  wheel  potentiometer  is  acquired  through  the  Analog  Input 
module.  Based  on  the  selected  control  strategy  to  the  motor  actuation  stage,  the  digital  control  signals  are 
generated  by  Digital  Output  module  of  the  PIC  32.  The  changes  in  the  reference/command  signal  are 
detected  by  this  module.  A  pulse  width  modulated  (PWM)  wave  with  a  specific  duty  cycle  is  generated  by 
the  Output  Compare  module  based  on  the  error.  The  position  data  from  the  microcontroller  to  the  PC  is 
transmitted  by  the  UART  module  via  serial  communication.  In  this  particular  design,  the  data  was  fed  to 
the  computer  by  a  virtual  com  port  via  USB  cable.  The  signals  from  the  ports  are  read  by  MATLAB®. 
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Motor  Actuation  Stage: 


In  this  stage,  the  motor  is  actuated  with  a  SN754410  quadruple  half-H  driver  [21]  with  the 
corresponding  control  signal.  This  proposed  design  was  tested  on  an  index  finger  of  a  prosthetic  hand 
prototype.  Fig.  3  shows  the  test  bed  for  the  proposed  design. 


Fig.  3.  Embedded  Test  bed  for  the  proposed  design 


/.  Mechanical  structure  of  the  robotic  hand  prototype: 

The  prosthetic  hand  prototype  finger  has  three  degrees  of  freedom  stimulated  by  two  Pololu  35:1  mini 
metal  gear  motors.  Biologically  inspired  parallel  actuation  is  the  main  characteristic  of  this  robotic  hand 
prototype.  It  is  based  on  the  behaviour/strength  space  of  the  Flexor  Digitorum  Profundus  (FDP)  and  the 
Flexor  Digitorum  Superficialis  (FDS)  muscles  [22].  Based  on  the  belt  transmission  system,  the  DC  motor 
in  the  metacarpal  phalange  of  the  finger  triggers  the  Proximal  Inter  Phalangeal  (PIP)  joint.  It  also  drives 
the  DIP  (Distal  Inter  Phalangeal)  joint.  The  Meta  Carpo  Phalangeal  (MCP)  joint  is  actuated  by  the  DC 
motor  located  at  the  base  of  the  finger  as  shown  in  Fig.  4. 

Joint 

Joint 


MCP  Joint 

MCP 

DC  Motor 

Fig.  4.  Actuation  scheme  for  the  finger 


RESULTS  AND  DISCUSSION 

Data  is  acquired  from  the  microcontroller  through  UART  channel2  of  the  PIC  32  micro  controller  by  a 
virtual  com  port  via  USB  at  57600  baud  rate.  The  data  from  the  microcontroller  is  converted  into  unitl6 
data  type  before  it  is  transmitted  through  the  UART.  It  is  running  at  an  external  clock  frequency  of  8MHz 
with  internal  scaling  enabled.  Fig.  5  depicts  the  experimental  results  of  the  proposed  design.  The  actual 
position  output  from  the  position  sensor  (i.e.F)  closely  follows  the  fusion  algorithm  estimated  position  F. 
Fig.  7  shows  the  fusion  estimated  position  profile  Y  and  actual  position  from  the  position  sensor  (T) 
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plotted  for  a  separate  experiment.  Fig.  7  shows  the  repeated  experimental  results.  The  proposed  control 
strategy  is  tracking  the  position  profile  and  matching  the  actual  position  profile  with  the  model  estimated 
position  ( F). 


Fig.  6.  Fusion  based  position  estimate  and  actual  position  from  position  sensor  during  the  grasp  action. 
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Fig.  7.  Fusion  based  position  estimate  and  actual  position  from  position  sensor  during  the  grasp  action 

(for  experiment-2). 


(for  experiment-3). 


Fig.  9.  Validation  Plot. 

While  conducting  the  experiments,  the  following  observations  were  made.  The  DC  motors  currently 
employed  have  the  primary  task  of  moving  the  prosthetic  fingers.  As  the  project  is  an  on-going  research, 
the  SMA  actuation  scheme  is  not  yet  implemented  because  of  the  slow  response  of  the  SMA’s,  and  also 
SMA’s  have  high  relaxation  time.  Therefore  it  is  difficult  to  track  a  randomly  changing  position  profile 
with  a  slowly  responding  actuation  system.  However,  as  the  prosthetic  hand  prototype  is  designed  to  use 
the  parallel  actuation  of  these  DC  motors  and  SMA’s,  the  DC  motors  alone  cannot  produce  fusion 
algorithm  estimated  position  profile. 

In  this  ,  the  DC  motors  are  solely  responsible  for  the  motion  actuation.  Since  the  DC  motors  have  small 
gear  heads,  the  usual  characteristic  of  gear  driver  actuation  cores  occurs:  gear  backlash.  In  addition,  the 
DC  motors  employed  were  slow  in  responding  to  the  changes  in  the  force  profile.  Hence  some  gaps  and 
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delay  were  observed  in  the  measured  position  signal.  However,  the  profile  of  the  measured  position  from 
the  position  sensor  has  a  similar  pattern  as  the  fusion  algorithm  estimated  position  (  K).  Thus  we  can 
conclude  that  apart  from  those  mechanical  transmission  problems,  the  implemented  control  scheme 
produced  promising  results.  These  problems  will  be  considered  in  a  new  prototype  design  that  we  are 
currently  developing.  It  is  also  evident  from  Figs.  6,  7  and  8  that  the  controller  is  tracking  very  well  the 
slow  changes  in  the  position  profile  where  as  a  small  delay  was  observed  while  tracking  the  position 
profile.  In  order  to  test  the  precision  of  the  proposed  control  strategy,  15  different  experiments 
wereconducted.  The  mean  of  the  Pearson's  correlation  coefficient  for  fusion  algorithm  estimated 
position(  F)  and  the  actual  position  from  the  position  sensor  (F)  in  all  the  15  experiments  is  0.86.  Because 
of  the  above  mentioned  transmission  problems  and  the  slow  response  of  the  gears,  slight  variability  is 
observed  in  the  correlation  coefficients  for  the  15  experiments.  Hence  the  difference  in  tracking  the 
position  profile  is  observed  in  Figs.  7  and  8.  Fig.  9  depicts  the  validation  plot  with  a  different  fusion 
algorithm  position  estimate  V  obtained  by  feeding  a  different  sEMG. 


CONCLUSION  AND  FUTURE 

In  this  work,  based  on  sEMG  signals,  we  proposed  a  two-stage  real-time  embedded  MRAC  strategy  for  a 
prosthetic  hand  prototype.  The  proposed  design  was  tested  on  a  prosthetic  hand  prototype,  based  on 
tracking  a  reference  position  profile  and  it  gives  good  performance.  This  design  enables  the  transmission 
of  the  data  from  the  microcontroller  to  the  computer.  This  design  facilitates  the  control  engineer  to 
increase  the  accuracy  and  performance  of  the  design  by  implementing  various  novel  control  strategies  and 
also  enables  fast  trouble  shooting. 

Eor  the  future  ,  we  are  planning  to  use  the  above  mentioned  embedded  platform  to  implement  online 
model-based  skeletal  muscle  angle  estimation  along  with  controller  designs  that  address  the  above  listed 
mechanical  shortcomings.  It  will  be  stimulating  to  acquire  the  sEMG  signal  directly  from  the  arm  of  a 
healthy  subject  and  transmit  to  our  embedded  system  rather  than  using  pre-recorded  sEMG  signals,  which 
will  be  investigated  as  well  in  the  future. 

PIC  32  MICROCONTROLLER  BASED  sEMG  ACQUISITION  SYSTEM  AND  PROCESSING  USING 

WAVELET  TRANSFORMS 

II.  EXPERIMENTAL  SET-UP 


Using  a  muscle  stimulator  (Richmar  HV  1100)  the  motor  point  for  the  ring  finger  of  the  dominant  hand  of  a 
healthy  male  subject  is  identified.  Prior  to  affixing  the  sEMG  sensors,  the  skin  surface  of  the  subject  was  prepared 
according  to  International  Society  of  Electrophysiology  and  Kinesiology  (ISEK)  protocols.  Different  sets  of 
experiments  were  conducted  with  DE  2.1  and  DE  3.1  DELSYS®  Bagnoli  sEMG  sensors.  One  sensor  was  placed  on 
top  of  the  motor  point  location  and  two  sensors  were  placed  next  to  the  motor  point.  The  subject  was  asked  to 
squeeze  the  stress  ball  with  the  ring  finger  which  has  a  0.5  inch  force  sensing  resistor  from  Interlink™  Electronics 
mounted  on  it.  The  sEMG  and  skeletal  muscle  force  signals  were  acquired  using  the  16-channel  DELSYS®  Bagnoli 
sEMG  and  NI  ELVIS™  respectively.  Using  a  PIC  32  embedded  platform.  A  similar  experimental  set-up  was 
designed  where  the  sEMG  and  the  force  data  was  acquired.  In  both  the  cases,  data  was  captured  at  a  sampling 
frequency  of  2000Hz.  Eig.  1  and  2  show  the  two  experimental  set-ups. 
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Fig.  1.  Experimental  Set-Up  with  NI  ELVIS  and  DELSYS®  EMG  System. 


III.  SIGNAL  PRE-PROCESSING 

From  the  authors’  previous  researeh  shows  that  the  Bayesian  based  filtering  method  yields  the  most 
suitable  sEMG  signals.  These  nonlinear  filters  extract  a  signal  by  significantly  reduces  the  noise.  The 
latent  driving  signal  x  results  in  the  EMG  which  can  be  computed  using  an  instantaneous  conditional 
probabilityP  (EMt7 1  x).  Research  describes  the  EMG  signal  as  an  amplitude-modulated  zero  mean 
Gaussian  noise  sequence.  This  estimation  algorithm  uses  the  model  of  the  conditional  probability  of  the 
rectified  EMG  signal  emg  =  |FMf7|, 

Equation  (1)  gives  an  “Exponential  Measurement  Model”  for  the  rectified  EMG  signal 


CKpt- 


(1) 


Equation  (2)  gives  a  “Poisson  Measurement  Model”  for  the  rectified  EMG  signal  [15]. 


F(^s\x) 

(2) 

In  equation  (2)  n  is  the  number  of  events.  Equation  (3)  presents  the  “Half-Gaussian  measurement  model” 
for  the  rectified  EMG  signal  [17]. 


(3) 


The  model  for  the  conditional  probability  of  the  rectified  EMG  is  a  filtered  random  process  with  a 
random  rate.  The  likelihood  function  for  the  rate  evolves  in  time  according  to  a  Eokker-Planck  partial 
differential  equation.  The  discrete  time  Eokker-Planck  Equation  is  given  by  Equation  (4). 

p(x,  t-}  sf  a  ^  p(x  -  5,  t  -  15  F  (1  -  2  ^  s)  *  jj(x  t  -  1]  F  ra  =*  p(x  F  t  -  1)  F  .0  F  (1  -  ^  t  -  1] 

(4) 

In  Equation  (4)  a  and  B  are  two  free  parameters,  where  k  is  the  expected  rate  of  gradual  drift  and  S  is  the 
expected  rate  of  sudden  shift  in  the  signal .  The  latent  driving  signal  x  is  discretized  into  bins  of  £■.  These 
free  parameters  of  the  nonlinear  Half-Gaussian  filter  model  are  optimized  by  a  simple  elitism  based 
Genetic  Algorithm  (GA).  GA  is  an  optimization  algorithm  which  is  based  on  observing  nature  and  its 
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corresponding  processes  to  imitate  solving  complex  problems,  most  often  optimization  or  estimation 
problems.  A  wavelet  transform  is  used  with  a  Daubechies  mother  wavelet  (filter).  The  order  of  the 
wavelet  is  chosen  as  44  at  8  levels  of  decomposition  [21].  Continuous  wavelet  transform  of  a  signal  is 
computed  by 

CWnt,cD)  = 


I  s{t  -t)dt 


The  inner  product  of  the  signal  and  xp  is  the  mother  wavelet  function.  It  must  satisfy  the 

following  condition: 

0  -<  C^.  =  2n  g  -<  +C0  (5) 

Skeletal  muscle  force  signal  from  FSR  is  filtered  utilizing  a  Chebyshev  type  II  low  pass  filter  with  a 
550  Hz  pass  band  frequency. 


IV.  METHODOLGY 


The  acquisition  and  transmission  of  the  sEMG  signals  are  done  by  using  Analog  Input  (ADC  Module)  and  the 
UART  module  of  the  PIC  32.  The  outputs  from  the  DELSYS®  Bagnoli  system  are  connected  to  the  analog  input 
channels  of  the  PIC  32  micro  controller.  In  this  the  signal  from  the  motor  unit  (middle  sensor)  is  acquired  and  pre- 
processed.  A  C  code  is  generated  by  a  dsPIC  block  set  for  the  PIC32  from  SIMULINK®.  The  dsPIC  block  set 
generates  a  ‘.hex’  file,  and  this  file  is  imported  by  MPLAB®  to  program  the  PIC32.  The  sEMG  and  the 
corresponding  skeletal  muscle  force  data  is  read  by  using  analog  Input  module.  There  is  an  internal  analog  to  digital 
converter  (ADC)  in  the  PIC  32.  It  has  a  10-bit  resolution  so  that  it  can  differentiate  up  to  1024  different  voltages, 
usually  in  the  range  of  0  to  3.3  volts,  and  it  gives  3mV  resolution.  The  signals  from  the  microcontroller  are 
transmitted  to  the  PC  through  the  UART  module  in  the  PIC32  using  serial  communication.  In  this  design,  a  virtual 
‘com  port’  is  created  to  feed  the  data  via  USB  cable  to  the  computer.  The  signals  from  the  ports  are  read  by 
MATLAB®  .Pig  2  depicts  the  acquisition  system  using  the  PIC  32  micro  controller 


DELSYS  sEMG 
S}-stem 


CPU  &  Mottitor 


PIC  32  and 
Embedded 
Platform 


Fig.  2.  Experimental  Set-Up  with  PIC  32  Embedded  Platforms  and 

DELSYS®  EMC  System. 

V.  RESULTS  AND  DISCUSSION 

Surface  Elecromyography  (sEMG)  and  the  corresponding  skeletal  muscle  force  data  was  acquired 
from  the  microcontroller  through  UART  channel  2  of  the  PIC32MX360F512L  by  a  virtual  com  port  via 
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USB  at  57600  baud  rate.  The  data  from  the  microcontroller  was  converted  into  uintl6  data  before  it  was 
transmitted  through  the  UART.  The  PIC32  microcontroller  is  running  at  80  million  instructions  per 
second  (MIPS)  with  its  phase  lock  loop  (PLL)  activated.  It  was  running  at  an  external  clock  frequency  of 
8  MHz  with  internal  scaling  enabled.  Fig.  3a  shows  the  sEMG  signal  acquired  by  the  proposed 
acquisition  system  using  DE  2.1  electrodes.  Eig3b.  shows  the  filtered  sEMG  signal  using  a  wavelet 
transform  Daubechies  44  filter.  Eig.  4a  and  4b  shows  the  raw  EMG  and  wavelet  transform  based 
Daubechies  44  filtered  sEMG  signals  at  5  levels  of  decomposition  acquired  by  the  proposed  acquisition 
system  using  DE  3.1  electrodes. 


3a.  Unfiltered  sEMG  Signal 


Time  (30  Secs)  ^  jq'* 

Eig.  3.  3a.  Unfiltered  sEMG  Signal  from  the  Proposed  Acquisition  System  Using  DE  2.1  Electrodes, 
3b.  Entered  sEMG  signal  with  Wavelet  Daubechies  44  Eilter. 


4a.  Unfiltered  sEMG  Signal 


Time  (30  Secs)  ^  jq‘‘ 

Eig.  4.  4a.  Unfiltered  sEMG  Signal  from  the  Proposed  Acquisition  System  Using  DE  3.1  Electrodes, 
4b.  Entered  sEMG  signal  with  Wavelet  Daubechies  44  Eilter 

The  following  experiment  was  repeated  several  times  to  check  the  consistency  and  the  accuracy  of  the 
proposed  acquisition  system.  Eig.  5  and  6  show  the  validation  for  the  proposed  acquisition  system  for 
repeated  experiments  using  DE  2.1  and  DE  3.1  electrodes. 
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5a.  Unfiltered  sEMG  Signal 


1 
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Fig.  5.  5a.  Unfiltered  sEMG  Signal  from  the  Proposed  Acquisition 
System  Using  DE  2.1  Electrodes^  4b.  Eiltered  sEMG  signal  with  Wavelet 

Daubechies  44  Eilter. 


6a.  Unfiltered  sEMG  Signal 


Time  (30  Secs) 


Eig.  6.  6a.  Unfiltered  sEMG  Signal  from  the  Proposed  Acquisition 
System  Using  DE  3.1  Electrodes^  6b.  Eiltered  sEMG  signal  with  Wavelet 

Daubechies  44  Eilter. 


7a.  Unfiltered  sEMG  Siganl 


7c.  Eiltered  Skeletal  Mnscle  Eorce 


Time  (30  Secs)  x  lo"* 

Fig.  7.  7a.  Unfiltered  sEMG  Signal  from  the  Standard  Acquisition  System,  7b.  Filtered  sEMG  signal  with 
Wavelet  Daubechies  44  Filter,  7c.  Filtered  Skeletal  Muscle  Signal  from  Chebyshev  Type  II  Filter. 

The  sEMG  signals  and  the  corresponding  skeletal  muscle  force  acquired  from  the  standard  acquisition 
system  are  given  in  Fig.  7a,  7b  and  7c.  Since  the  sEMG  is  a  random  signal  corrupted  with  noise  it  is  hard 
to  achieve  the  same  correlation  every  time.  This  proposed  acquisition  and  filtering  system  is  ing  better 
than  the  Half-Gaussian  filtering  that  was  previously  developed  by  the  authors  [22]. 


VL  CONCLUSION  AND  FUTURE 

In  this  work,  a  real-time  sEMG  acquisition  and  processing  system  was  designed  for  the  control  of  a 
prosthetic  hand  prototype.  The  proposed  design  shows  the  same  performance  when  compared  with  the 
standard  EMG  acquisition  system.  The  DE  2.1  electrodes  are  giving  good  results  when  compared  to  the 
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DE  3.1  electrodes  of  the  Delsys®  Bangnoli  16  system.  This  proposed  acquisition  system  miniaturizes  the 
size  and  helps  the  transmission  of  the  data  from  the  microcontroller  to  the  computer.  This  helps  the  user 
to  compare  the  accuracy,  precision  and  real-time  performance  of  the  acquisition  system. 

For  future,  we  are  planning  to  implement  a  real-time  online  model-based  force  estimation  along  with 
controller  design  for  position  and  force  control,  based  on  this  embedded  platform  [22].  It  will  also  be 
interesting  to  do  the  wavelet  Daubechies  44  filtration  online  instead  of  post  processing.  Finally,  we 
expand  this  sEMG  acquisition  to  all  the  five  fingers  of  the  prosthetic  hand  prototype. 


III.  Intelligent  Classification  of  Surface  Electromyographic  (EMG)  Signals  Based  on  Entropy  for  the 

Control  of  a  Robotic  Hand 


sEMG  Electrode  Placement 

For  the  purpose  of  this  research  [4]  the  forearm  can  be  broken  into  2  zones.  Zone  1  is  in  the  area  closest  to  the  wrist. 
Zone  1  contains  mostly  the  tendons  that  are  connected  to  the  fingers  and  the  muscles  in  the  adjacent  zone.  Zone  2 
where  the  sensors  are  placed  in  Figure  1  is  the  proximal  part  of  the  forearm  or  the  zone  closest  to  the  elbow.  Zone  2 
has  the  majority  of  the  muscle  bellies  which  contain  the  main  motor  units  that  drive  the  function  of  the  hand. 


Motor  units,  such  as  those  in  zone  2,  are  made  up  of  motor  neurons  and  all  the  connected  muscle  fibers.  Motor  units 
use  motor  neurons  to  carry  impulses  from  the  spinal  cord  or  central  nervous  system  to  the  muscles  fibers.  When  the 
electrical  signals  for  the  motor  neurons  reach  the  muscles  it  innervates,  the  muscles  contract. 

Actions  that  require  fine  motor  skills  have  smaller  motor  units  than  gross  or  rough  motor  actions.  For  example, 
surgeons  need  fine  motor  skills  to  make  precise  incisions  with  their  hands  whereas  walking  does  not  require  as 
precise  movements.  The  motor  units  for  people’s  hands  are  much  smaller  than  motor  units  for  their  thighs. 

Motor  units  are  not  isolated  in  one  specific  area.  Each  unit  is  spread  throughout  the  muscle.  External  stimulation 
can  be  used  to  activate  the  motor  unit  of  a  muscle,  but  this  generally  causes  weak  contractions.  In  a  past 
experiments  [5]  and  [10]  a  muscle  stimulator,  the  Rich-Mar  HV  1000,  was  used  to  find  motor  points  and  then  the 
sEMG  signal  was  taken  from  those  points.  The  points  where  the  motor  units  are  located  are  difficult  to  isolate  and 
only  contain  part  of  the  entire  motor  unit.  Finding  the  best  spot  for  muscle  contraction  is  difficult  due  to  variations 
in  individuals.  This  method  can  be  used  to  find  motor  units  of  all  fingers  for  some  people  to  no  motor  units  for 
others.  This  variation  depends  on  the  subject’s  muscle  mass,  sex  and  other  anatomical  factors. 

On  a  subject  with  an  amputation,  finding  motor  units  is  difficult  because  the  only  indication  of  muscle  stimulation  of 
a  motor  unit  is  movement  or  twitching  of  the  muscle  from  the  skin’s  surface  since  the  contraction  of  the  muscle  no 
longer  results  in  finger  movement.  The  severity  and  type  of  amputation  can  also  play  a  factor  in  finding  the  correct 
locations  of  motor  units.  If  an  amputation  was  planned,  it  allows  the  physician  to  leave  more  of  the  motor  units.  If 
an  accident  occurred,  the  amputation  could  destroy  or  damage  the  motor  units  for  the  hand.  As  time  goes  on  the 
motor  units  can  weaken  in  an  amputation. 

The  electrodes  were  placed  parallel  with  the  muscles  of  the  forearm.  Zone  1  contains  the  tendons  of  the  muscles, 
and  past  experiments  verified  that  this  area  contained  significantly  fewer  sEMG  signals  than  zone  2.  Zone  2  was 
over  the  general  muscle  bellies,  where  higher  concentrations  of  motor  units  are  located.  An  array  of  6  electrodes  was 
placed  over  the  muscles  in  zone  2.  The  electrodes  were  used  to  measure  the  sEMG  signals  while  conducting  the 
experiments.  Surface  electrodes  are  less  evasive  and  do  not  have  to  be  implanted.  For  these  reasons  surface 
electrodes  were  used  for  the  experiments. 
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Experimental  Setup 

Experiments  were  conducted  on  the  forearm  of  healthy  subjects.  All  subjects  volunteered  for  the  experiments.  The 
sEMG  electrodes  used  were  dual  GS27  EGG  &  EMG  disposable  silver/silver  chloride  pre-gelled  surface  electrodes. 
The  electrodes  measure  the  voltage  on  the  skins  surface  created  by  the  actuation  of  the  motor  units  which  cause 
muscle  to  contract.  The  gel  helps  the  sensors  attach  to  the  skin.  The  gel  also  is  conductive  which  allows  for  a  better 
connection  to  the  skin.  Before  sensors  were  placed  the  subject’s  skin  was  prepared  according  to  International 
Society  of  Electrophysiology  and  Kinesiology  (ISEK)  protocols  [11].  The  arm  was  also  shaven  prior  to  electrode 
placement  to  allow  for  better  contact  with  the  skin  surface. 

The  sEMG  data  acquisition  device  used  was  a  NORAXON  MyoSystem  2000.  The  data  was  acquired  at  a  1,000  Hz 
frequency  (or  1,000  samples  a  second).  The  system  outputs  that  information  into  an  output  file  with  3  signal 
columns. 

The  electrodes  were  placed  in  an  array  of  2  by  3.  See  Eigure  2  for  the  sensor  array  setup.  The  six  sensors  were 
placed  in  the  back  portion  of  the  forearm,  towards  the  elbow.  The  array  was  centered  between  the  elbow  and  1 1  cm 
from  the  wrist.  The  2  sensors  were  placed  perpendicular  to  the  muscle  fibers  and  centered  at  the  halfway  mark. 

Then  two  sensors  were  placed  towards  the  wrist  and  two  towards  the  elbow.  They  were  all  evenly  spaced  with 
enough  space  so  that  the  sensors  didn’t  overlap  each  other.  A  reference  electrode  was  placed  on  the  elbow  where  no 
significant  sEMG  signal  can  be  measured.  See  Eigure  1  for  the  electrode  placement  on  forearm.  The  sensor  closest 
to  the  wrist  is  the  1st  electrode,  the  middle  one  is  the  2”^  and  the  3^^  is  the  electrode  closest  to  the  elbow. 


Figure  2:  Electrode  Array 


Experiment 

The  experiments  that  were  ran  with  the  subjects  were:  a  baseline  test,  power  grasp  of  a  ball,  pad  to  pad  pincer  grasp 
of  the  middle  fingers,  and  key  grip.  These  experiments  were  chosen  because  there  would  be  common  task  that  a 
person  does  thought  there  day. 

The  baseline  was  used  for  the  remainder  of  the  signals  to  be  compared  to.  The  baseline  consisted  of  the  test  subjects 
holding  their  hands  in  a  still,  relaxed  position  for  approximately  30  seconds.  The  rest  of  the  experiments  were 
conducted  in  about  5  seconds  allow  time  for  the  patient  to  preform  one  motion.  The  power  grasps  the  ball;  a  stress 
ball  was  used  to  provide  resistance  to  the  patient.  The  next  test  was  a  pad  to  pad  pincer  grip.  This  grip  was  done  by 
touching  the  thumb  and  the  middle  finger  pad  to  pad,  not  fingertip  to  fingertip.  The  subjects  would  start  with  their 
hand  open  and  then  close  their  finger  pad  to  pad  tightly  against  the  thumb  and  then  release  the  grip.  The  final  test  is 
a  key  grip  test.  This  test  simulated  the  common  task  of  a  person  grasping  a  key.  Patients  would  start  with  their 
hands  open  and  then  close  their  thumbs  on  the  key  tightly  and  then  release  the  key. 

Data  Processing 

Eor  the  experiment  of  test  results  for:  baseline  tests,  power  grasp  of  a  ball,  pad  to  pad  pincer  grasp  middle  finger, 
and  key  grip  the  overall  results  can  be  seen  in  Table  1.  Spectral  entropy  of  unfiltered  sEMG  signals  yielded  the  best 
results.  Normal  entropy  and  wavelet  entropy  were  both  tested  but  did  not  give  as  consistent  and  accurate  results. 
Also  pre-filtering  the  data  by  rectifying  the  signals  actually  made  the  entropy  calculation  more  inconsistent. 


Table  1:  Entropy  Results 
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Baseline 


Average  z2^2 


Ball  Close  &  Open 

Average 

z2^2 


Average 

0.7159 

Average 

0.2682 

Range 

0.494  to 

Range 

0.1863  to 

0.9378 

0.35 

Pad  to  Pad  Middle  Finger 
Close  &  Open 


Key  Grip 


Average  z2^2 


Average 

z2^2 


Average 

0.4645 

Average 

0.4172 

Range 

0.397  to 
0.532 

Range 

0.3518  to 
0.4825 

From  Table  1  the  baseline  has  a  much  higher  average  than  the  rest  of  the  experiments.  This  tells  us  that  the  sEMG 
signals  of  people  arms  in  a  relaxed  position  are  more  random  than  when  they  are  going  a  task.  This  true  since  most 
of  the  signal  in  a  relaxed  position  is  random  noise  which  has  a  high  entropy  value  and  helps  support  that  these 
results  have  meaningful  information.  The  ball  grasp  was  around  0.26.  The  pad  to  pad  pincer  grip  of  middle  finger 
entropy  was  about  0.46.  The  key  grip  was  around  0.42  which  close  to  the  pad  to  pad  test.  This  will  test  the  classifier 
to  see  if  it  can  differentiate  the  difference  between  these  motions. 

Intelligent  Controller 

With  the  ranges  of  entropy  determined  from  the  experiments  an  intelligent  controller  can  be  created.  The  controller 
developed  using  a  fuzzy  controller  with  parameters  based  on  the  information  in  Table  1. 

sEMG  signals  of  know  hand  motions  were  then  input  into  the  controller.  This  was  done  to  test  the  controller  to  see 
how  well  it  can  distinguish  between  different  hand  gestures.  Table  2  is  the  summary  of  the  results.  This  table  shows 
that  the  controller  is  able  to  distinguish  between  a  when  a  person’s  hand  is  held  still  and  when  they  are  doing  they 
are  power  grasping  a  ball.  Hand  motions  such  as  pad  to  pad  and  key  grip  are  close  enough  to  each  other  that  the 
controller  has  more  difficulty  determining  the  motion.  Some  of  the  time  the  controller  would  mix  up  the  two 
motions. 
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Table  2:  Experiments  Classification  of  Hand  Motions 

Correctly 

Electrode  Characterized 


Table  3:  Summary  of  Controller  Classification  of  Signals 

Electrode 

ist 

2nd 

3rd 

Total  Electrode 
Accuracy 

In  Table  3  the  results  are  show  of  the  different  electrodes.  The  electrode  has  the  lowest  accuracy  of 
characterization  a  signal  with  50%.  The  3^^  electrode  has  the  highest  accuracy  with  75%.  The  overall  successful 
characterization  of  the  gestures  was  61.1%.  Some  of  this  variation  can  be  from  having  male  and  female  subject.  It 
states  that  sex  causes  variability  in  electromyographic  amplitudes.  Entropy  calculation  may  also  be  affected  by 
gender.  With  these  promising  result  of  this  controller  could  be  used  to  control  a  robotic  or  prosthetic  hand.  This 
controller  could  be  loaded  onto  an  embedded  platform  and  use  the  output  to  control  the  prosthetic  hand  that  had 
sEMG  sensor  connected  to  a  patients  arm. 


Correctly 

Characterized 
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Goal  3:  Robotic  Hand 


The  main  goal  for  Phase  II  regarding  the  prosthetic  device  is  to  have  a  final  prototype  that  fulfills  the 
requirements,  one  that  can  be  tested  with  the  developed  EMG  control  signals  and  control  strategy,  and 
that  can  be  used  as  a  base  for  the  embedded  system. 

In  order  to  do  so,  two  deliverables  were  proposed  within  Goal  3  for  Phase  II,  which  were  divided  in  three 
objectives. 

The  first  objective  was  the  implementation  and  testing  of  the  hand  prototype  developed  in  Phase  I  (Hand 
1  Prototype  I).  It  had  as  main  characteristic  its  parallel  actuation  system,  which  followed  the  force  / 
motion  division  of  EMG  signals.  However  this  turned  out  to  be  difficult  to  implement.  The  main 
disadvantages  were  the  discontinuity  of  affordable  commercial  SMA  actuators,  and  the  time  delay  and 
hysteresis  in  the  SMA  actuation.  In  Prototype  II  and  Prototype  III,  the  parallel  SMA  actuation  was 
disabled  in  order  to  obtain  a  functional  hand,  while  keeping  a  very  similar  hand  structure. 

The  second  objective  is  the  design  of  the  new  hand  prototype  (Hand  2  prototype  I),  combining  the 
experiences  of  Hand  1  with  the  results  of  the  testing,  newly  developed  kinematic  synthesis  results,  and 
with  the  results  from  the  EMG  signal  identification.  For  Hand  2,  we  introduce  a  very  different  design, 
with  remote  actuation,  which  is  explained  below.  In  addition,  the  theoretical  developments  in  kinematic 
synthesis  have  allowed  us  to  apply  the  same  strategy  for  the  design  of  exoskeletons. 

The  third  objective  is  to  explore  the  manipulation  of  grasped  objects  from  a  theoretical  point  of  view;  this 
benefits  both  the  design  and  the  implementation  of  path  planning  algorithms.  In  order  to  do  so,  we 
continued  with  the  research  activity  on  human  hand  motion  identification,  including  the  design  of  new 
motion  sensors. 

Find  in  the  Body  section  the  detailed  report  of  work  and  findings  for  each  of  these  objectives. 

Goal  3,  Objective  1:  Implementation  and  testing  of  Hand  1,  Prototype  II-III. 

Hand  1  Prototypes  II  and  III  are  similar  in  structure,  having  5  fingers  each  with  independent  actuation  and 
motors  embedded  within  the  fingers-palm.  It  is  a  good  hand  for  experimentation  but  it  does  not  meet  the 
requirements  regarding  size  and  force  output,  if  a  reasonable  price  is  set  for  it.  The  main  limitation  is  the 
size/torque  of  the  small  electric  actuators  that  power  each  degree  of  freedom.  Previous  testing  gave  an 
average  force  of  about  15N.  Currently,  no  reasonably-priced  actuators  exist  that  can  power  this  hand  for 
a  force  comparable  to  the  human  hand.  In  addition,  no  realistic-motion  actuation  was  accomplished  for 
the  thumb.  See  CAD  model  for  Hand  1  in  Figure  1. 


Figure  1:  Hand  CAD  model 
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Because  of  this,  limited  new  effort  has  been  devoted  to  keep  refining  Hand  1.  However,  it  is  a  good  test 
bed  for  the  EMG  and  control  testing.  Rapid-prototypes  of  this  hand  are  available  for  the  team  to  test  their 
different  algorithms  and  results,  and  individual  fingers  and  combination  of  fingers  are  being  tested  in  this 
way.  See  Prototype  II  in  Figure  2. 


Figure  2:  Prototype  II 


The  testing  performed  using  this  prototype  includes  some  rough  EMG  controllers  using  threshold  signal 
and  the  experimental  setup  for  checking  the  grasping  ability  of  the  hand. 

EMG  signal  capturing  capability  was  added  to  control  the  DC  motors.  The  raw  signals  were  processed  by 
taking  the  maximum  absolute  value  over  a  100  sample  interval  and  generating  a  new  data  set.  In  order  to 
get  the  full  flex  and  extend  ability  of  the  finger  from  this  new  data  set  two  threshold  levels  where 
introduced.  Above  one  threshold  the  motor  would  spin  in  one  direction  (flex)  and  below  another  the 
motor  would  spin  in  the  opposite  direction  (extend).  The  deadzone  was  implemented  as  a  buffer  area  to 
transition  between  the  flexion  and  extension  zones. 

The  EMG  signal  was  acquired  from  the  digit  III  FDP  muscle  and  supplied  as  an  analog  voltage  from  a 
separate  PC  incorporating  a  Delsys  Bagnoli  EMG  system.  The  analog  voltage  was  sampled  through  a 
National  Instruments  data  acquisition  card  installed  in  the  motor  control  PC.  The  analog  signal  was  then 
filtered  and  scaled  using  Lab  VIEW  to  a  value  representing  the  amplitude  of  the  EMG  signal,  which  was 
then  used  to  control  the  direction  of  the  motors.  A  sample  of  the  filtered  and  scaled  signal  with  thresholds 
is  shown  in  Figure  3. 
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The  controller  was  applied  to  the  DC  motors  of  finger  and  thumb  only,  in  their  close  grip  configurations. 
The  objective  of  these  tests  is  to  obtain  some  preliminary  data  in  order  to  setup  the  EMG-testing 
platform. 

The  EMG  voltage  and  current  outputs  for  both  the  finger  and  thumb  were  consistent  with  that  of  the  direct 
power  supply  inputs.  The  EMG  thumb  test  resulted  in  a  DC  motor  force  of  0.95N  which  agreed  with  the 
1.24N  +  0.35N  generated  by  the  direct  power  supply  tests  presented  in  the  Einal  Report  of  Phase  I. 

The  grasping  ability  and  the  reaching  of  each  finger  have  been  analyzed  in  the  real  prototype.  There  are 
two  main  patterns  in  prehensile  grasping,  the  precision  grip  (or  grasp),  between  the  terminal  digital  pad  of 
the  opposed  thumb  and  the  pads  of  the  fingertips,  and  the  power  grip  (or  grasp).  Holding  large  objects 
involve  all  the  digits,  while  small  objects  require  only  the  thumb,  the  index,  and  the  middle  digits.  Smaller 
objects  may  be  pinched  specifically  between  the  thumb  and  index  (or  middle)  finger,  which  should  be 
adapted  to  perform  fine  control.  The  power  grip  is  executed  between  the  surface  of  the  fingers  and  the 
palm,  which  acts  as  a  buttressing  and  reinforcing  agent.  All  these  grasping  actions  have  been  visually 
checked  in  the  prototype,  see  Eigure  4. 


Figure  4:  Hand  1  holding  a  spherical  object 


Goal  3,  Objective  2:  Design  of  Hand  2,  Prototype  I 

In  Hand  2,  the  design  strategy  has  been  radically  changed  in  order  to  fulfill  the  force,  weight,  size  and 
function  requirements.  The  main  requirement  for  the  prosthetic  hand  is  the  matching  between  the 
kinematic  and  mechanical  design  and  the  driving  signals  and  control  laws.  These  last  ones  need  to  be 
flexible  in  order  to  adapt  to  individuals  and  environmental  changes  in  signal  acquisition,  identification 
and  transmission,  while  this  flexibility  is  hard  to  implement  in  a  mechanical  system  without 
compromising  some  of  the  capabilities  of  the  hand,  usually  the  full  actuation.  Another  important  problem 
when  designing  fully  actuated  hands  is  the  placement  and  weight  of  actuators.  With  this  hand,  we  aim  to 
create  a  prosthetic  design  with  the  advantages  of  both  under  actuated  and  fully  actuated  robotic  hands, 
using  a  simple  method  to  switch  from  one  configuration  to  the  other  and  placing  most  of  the  actuators 
outside  of  the  hand.  Given  the  complexity  associated  with  the  human  hand,  with  its  many  actuators  and 
sensors,  which  makes  use  of  forearm  muscles,  nervous  system,  and  body’s  energy  generation  systems, 
fitting  all  needed  components  within  the  physical  size  of  the  hand  requires  a  degree  of  miniaturization  that 
is  still  to  be  achieved  at  a  reasonable  price. 

In  this  hand,  all  actuators  are  remotely  located  (it  can  be  in  the  arm  or  in  the  back  of  the  user)  and  the 
actuation  is  performed  via  cables.  Given  the  variability  of  amputees,  for  this  hand  we  are  interested  in  a 
design  that  is  a  hybrid  fully-actuated  /  underactuated  [Dollar  2010;  Birglen  2008;  Hirose  1978]  hand. 

The  human  hand  has  an  average  weight  of  400  grams  [Balasubramanian  2011]  (distal  to  the  wrist  and  not 
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including  the  forearm  extrinsic  muscles).  However,  prosthetic  terminal  devices  of  similar  weight  have 
been  described  as  being  too  heavy  by  users  [Chandler  1975].  This  is  primarily  because  the  attachment 
methods  between  the  prosthesis  and  the  user  compound  the  effects  of  the  weight  in  the  terminal  device. 
Although  researchers  are  currently  working  to  alleviate  attachment  problems  through  the  use  of  integrated 
attachment  mechanisms,  the  weight  of  the  prosthesis  is  a  key  contributor  to  interface  discomforts  and  user 
fatigue  [Pylatiuk  2007]. 

A  key  performance  of  this  hybrid  design  is  to  produce  power  grasps  that  passively  make  contact  at 
multiple  points,  thereby  providing  the  user  the  ability  to  apply  the  desired  force  on  the  object  from 
multiple  contact  points.  Due  to  the  limited  number  of  actuators  and  the  uncertainty  in  object  location  and 
shape,  the  coupled  actuation  must  be  designed  to  minimize  situations  in  witch  not  all  links  make  contact 
with  the  object.  It  is  expected  that  the  flexibility  associated  with  this  design  will  allow  for  a  better 
adaptation  to  the  many  different  types  of  amputees. 


Hand  Structure 

The  overall  shape  and  size  of  the  hand  is  based  on  the  average  human  hand.  This  includes  five  fingers 
and  a  thumb  that  are  attached  to  a  fixed  palm.  Revolute  joints  make  up  the  10  degrees  of  freedom  for  the 
interphalangeal  (IP)  joints  of  the  fingers  and  IP  and  MCP  joints  of  the  thumb.  Universal  joints  are  used  in 
the  Metacarpals  of  each  finger  (MCP  joints)  and  the  CMC  joint  of  the  thumb,  as  well  as  the  combination 
of  flexion-extension  and  abduction-adduction  of  the  wrist.  These  joint  make  up  the  other  12  degrees  of 
freedom  in  this  design.  Joint  actuation  is  created  by  a  cable  system  that  converts  actuator  rotational 
motion  to  linear  motion  and  that  back  to  rotational  motion  in  the  joint. 

To  achieve  the  desired  motion  in  a  lightweight,  durable  construction,  the  hand  components  are  made 
from  thin  gauge  stainless  steel.  Individual  links  that  makeup  each  finger  and  the  thumb  are  created  by 
bending  thin  gauge  sheet  metal  into  a  tube  like  section  that  allow  the  finger  pulleys,  cables,  and  cable 
conduit  to  be  discreetly  hidden  inside. 

The  palm  of  the  hand  is  constructed  in  a  similar  fashion  using  shaped  sheet  metal  as  an  external  shell. 
Consecutive  links  are  connected  with  3  mm  axle  shafts  that  pass  through  ball  bearings  creating  the 
revolute  and  universal  joints.  To  drive  the  joint  motion,  0.039  diameter  Teflon-coated  cables  pass  through 
0.100  diameter  cable  conduit  as  it  is  roughed  through  each  finger  to  the  palm  and  then  out  to  actuators 
located  away  from  the  hand.  Figure  5  shows  the  joint  arrangement. 

Joint  Actuation 

The  linear  actuation  design  for  Hand  2  operates  with  the  use  of  a  pull -pull  cable  system.  Each  joint  is 
controlled  by  two  cables  that  pass  through  cable  conduits,  from  the  actuator  to  the  joint  pulley.  The 
actuator’s  rotational  motion  causes  the  pulley  on  the  actuator  to  release  cable  on  one  side  and  draw  cable 
in  on  the  other.  This  results  in  a  rotation  of  the  joint  pull  and  ultimately  a  rotation  of  the  joint.  In  reverse 
fashion  when  the  actuator  rotates  in  the  reverse  direction  the  opposite  cable  is  drawn  or  pulled  in  causing 
a  tension  in  the  cable  and  a  reverse  rotation  of  the  joint  pulley  and  the  joint. 
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Figure  5:  Finger  Pulleys 


This  simple  design  is  repeated  for  the  Distal,  Proximal,  and  Metacarpal  joints  of  each  finger  and  the 
thumb.  However  the  metacarpal  joints  on  each  finger  and  the  thumb  are  universal  joints  and  add  a  second 
degree  of  freedom  and  a  second  pull-pull  actuation  cable  system  to  the  joint,  see  Figure  6. 


Figure  6:  Metacarpal  Universal  Joint 

The  2-dof  wrist  joint  is  also  a  universal  joint,  but  a  third  rotational  degree  is  added  to  allow  hand 
pronation/supination.  This  results  in  23  degrees  of  freedom.  Because  of  the  fact  that  the  distal  IP  joints  of 
a  human  hand  on  average  are  70%  coupled  to  the  Proximal  IP  joints,  the  distal  joint  and  the  proximal 
joint  of  this  design  are  actuated  with  one  actuator  resulting  in  a  coupled  motion  for  each  finger.  This 
coupling  reduces  the  total  independent  degrees  of  freedom  down  to  19. 
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Actuation 


To  minimize  the  overall  weight  seen  by  the  user,  the  actuators  that  control  the  hand  motion  are  to  be 
placed  remotely,  in  an  operational  backpack.  This  allows  actuators  to  be  sized  based  on  output  power 
instead  of  overall  dimensions.  The  power  unit  that  is  used  to  power  both  the  control  system  and  the 
actuators  can  also  benefit  from  this  design. 
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Figure  7:  Faulhaber  Gearmotor  and  Encoder 

For  each  degree  of  freedom  a  Faulhaber  Gear  Motor  and  Encoder  (Figure  7)  will  be  used  to  drive  the  19 
active  degrees  of  freedom.  The  windings  have  an  overall  resistance  of  1 1  ohm,  which  means  the  motor 
will  draw  0.55  amps  at  6V  if  stalled.  The  motor  has  a  peak  efficiency  of  74%.  The  no-load  motor  speed  is 
13,400  RPM  at  6V  but  will  be  slower  with  a  gearhead  attached. 

The  dual-channel  encoder  is  similar  to  an  HEM  encoder  that  accepts  a  4.5v  to  15v.  To  measure  only  RPM 
or  distance,  the  encoder  has  two  channels,  one  of  them  providing  one  high  pulse  per  revolution  of  the 
motor.  There  will  be  141  high  pulses  per  revolution  of  the  gearshift,  or  about  2.55  degrees  of  final  output 
rotation  per  pulse.  To  increase  resolution  or  to  measure  rotation  direction,  the  microcontroller  can  watch 
both  channels  A  and  B.  The  output  of  the  encoder  is  very  clean,  see  Figure  8. 


2V  2V  1ms  2V  5us 


Figure  8:  Oscilloscope  trace  of  two  channel  encoder 

To  connect  the  gear  motors  to  the  individual  finger  pulleys,  the  pull -pull  system  described  above  is  to  be 
utilized.  The  routing  of  the  individual  cable  conduits  is  yet  to  be  developed. 


Pressure  Sensing 

To  provide  tough/strength  of  grasp  sensing  in  the  hand,  the  actuator  utilizes  a  variable  resistance  sensor. 
This  sensor  provides  feedback  to  the  controller  of  the  toque  being  applied  by  the  actuator  to  the  finger.  In 
simple  control  layouts  the  input  voltage  for  the  motor  would  pass  through  the  variable  resistor  controlling 
the  speed  and  stopping  signal  based  on  the  spring  constant.  In  more  complicated  controls  this  resistive 
signal  would  provide  the  force  input  that  will  allow  one  finger  to  provide  more  force  then  another  and 
possibly  create  motion  of  object  that  have  already  been  grasp. 
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This  sensor  is  constructed  by  connecting  a  variable  resistor  to  the  dive  hub  and  the  motor  pulley.  A 
torsion  spring  connects  the  motor  pulley  to  the  drive  hum.  When  force  increased  due  to  object  contact, 
this  force  is  carried  through  the  actuation  cables  to  the  motor  pulley  and  then  into  the  torsion  spring.  As 
the  spring  stores  this  energy  it  allows  the  motor  pulley  to  rotate  on  the  drive  hub  and  change  the  resistance 
in  the  variable  resistor.  This  change  in  resistance  provides  feedback  to  the  motor  controller  on  the  strength 
of  grasp  that  the  robot  is  producing.  This  sensor  also  provides  a  buffer  to  jerk  that  would  otherwise  be 
produced  in  the  actuation  system  during  grasp  contact.  A  diagram  of  this  sensor  is  shown  in  Figure  6. 

One  of  the  main  benefits  of  using  this  type  of  tough/strength  sensing  is  it  allows  for  contact  to  be  sensed 
no  matter  where  it  occurs  on  the  robotic  hand.  Pressure  sensors  located  at  the  tips  of  each  finger  have 
been  used  to  provide  similar  sensing  however  if  object  contact  does  not  happen  in  the  unit  normal 
direction  this  force  can  be  misinterpreted  by  the  sensor. 


Torsion  Spring 


FaulhaberGear 

motor 


/ 
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Motor  Pulley 


Cables 


Figure  9:  Pressure  Sensor 


Prototype 

The  prototype  is  to  be  created  using  a  sheet  metal  laser.  Thin  gauge  stainless  and  sheet  metal  flat  patterns 
created  in  Solidworks®  CAD  software  (Figure  10)  will  allow  each  link  in  the  hand  to  be  created  with  an 
interlocking  design  that  minimizes  weight  and  maintains  strength.  This  design  also  allows  for  simple 
maintains  on  the  joint  pulleys,  cables,  and  cable  conduits  by  allowing  access  to  these  areas  without  major 
disassembly. 
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Figure  10:  Sheet  Metal  Construction 

The  remaining  palm  and  wrist  of  the  hand  will  be  constructed  in  similar  fashion.  Formed  sheet 
metal  stainless  steel  plates  are  joined  together  to  form  the  bearing  carrier  for  each  metacarpal  universal 
joint.  The  thumb  of  the  hand  is  constructed  the  like  each  finger  and  connected  to  the  palm  plates  with 
internal  sheet  metal  bearing  carriers.  Structural  strange  of  the  system  is  achieved  after  all  components  are 
connected.  This  included  the  access  plates  that  are  used  to  maintain  the  actuation  cables.  Actuators  for 
each  degree  of  motion  are  mounted  to  a  common  mounting  plate  that  is  located  in  an  operational 
backpack.  A  general  layout  of  the  actuators  can  be  found  in  Figure  11. 


Figure  11:  Remote  Actuation 
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Figure  12:  Conduit  Layout 

Cable  conduit  runs  connect  the  robotic  hand  to  the  remote  actuators  that  are  located  in  the  operational 
backpack.  These  conduit  runs  will  attach  the  outside  of  the  operators  arm  and  follow  the  arm  down  to  the 
hand  similar  to  the  sleeve  on  a  shirt.  That  gives  much  more  flexibility  for  the  design  of  the  hand. 


Figure  13:  General  Layout 


Because  of  its  flexible  design,  several  actuation  schemes  are  being  considered.  In  this  first  prototype 
(Prototype  1),  we  are  not  planning  to  implement  parallel  actuation.  We  will  compare  its  performance  with 
Hand  1  regarding  the  EMG  control  and  will  decide  whether  to  add  the  parallel  actuation  for  a  final 
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prototype  of  this  hand  model.  Another  actuation  scheme  is  the  possibility  of  combining  the  actuation  from 
several  motors  in  order  to  create  an  underactuated  hand.  This  may  be  needed  depending  on  the 
limitations  of  the  amputee. 

Implementation 

Fabrication  of  the  MS-3  hand  has  been  completed  for  all  fingers  and  joints  during  construction  of  the 
hand,  according  to  the  final  model  of  Figure  14. 


Figure  14:  Final  design  of  Hand  2 


The  hand  is  being  assembled  and  then  tested  for  compliance  to  functionality.  The  hand  is  based  on  the 
overall  size  constraints  of  a  woman  or  large  child,  this  was  chosen  due  to  scalability.  Figure  15  shows  the 
comparison  with  a  human  finger. 


Figure  15:  Finger  dimensions  for  Hand  2 
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In  the  final  design,  distal  and  intermediate  phalanges  are  coupled,  resulting  in  a  single  degree  of  freedom 
for  the  each  finger  and  thumb.  Proximal  to  metacarpal  joint  add  a  second  degree  of  freedom  to  each  finger 
and  thumb.  The  thumb  adds  a  second  degree  of  freedom  in  the  carpal  to  metacarpal  joint,  this  results  in  1 1 
degrees  of  freedom.  Servo  motors  provide  the  toque  and  rotation  motion  required  for  each  degree  of 
freedom.  This  is  transferred  from  the  servo  motor  to  the  desired  joint  with  the  use  of  Bowden  cables.  For 
each  servo  motor  two  cables  are  required  and  act  as  a  pull-pull  configuration.  All  servos  are  controlled  by 
a  mini  maestro  12-channel  USB  servo  controller.  Figure  16  shows  some  of  the  expected  actions  of  the 
hand,  and  the  table  below  shows  some  of  the  final  dimensions. 


Figure  16:  Grasping  actions  of  Hand  2 


HAND  DIMENSIONS 


Distal  Phalanges 

Intermediate 

Phalanges 

Proximal 

Phalanges 

Metacarpal 

Finger  Width 

1.0” 

1.125” 

1.375” 

3.25” 

0.5” 

Goal  3,  Objective  3:  Theoretical  hand  grasping  and  manipulation  results 

Within  this  goal  we  have  been  exploring  the  theoretical  relation  between  the  hand  structure  and  the  hand 
motion  and  force  transmission.  This  relations  are  key  in  design  decisions,  which  are  limited  by  this  lack 
of  knowledge.  In  order  to  explore  these  issues,  we  have  created  a  design  methodology,  which  uses  visual 
hand  trajectories  as  an  input  and  returns  mechanical  structures  able  to  follow  those  trajectories.  We  apply 
this  to  each  finger  in  order  to  design  optimal  structures,  while  the  human  aspect  of  the  hand  can  be 
imposed  as  additional  constraints  (for  standard  prostheses)  or  just  not  considered,  for  innovative 
prostheses  and  exoskeletons.  For  capturing  the  hand  motion  we  use  video  cameras  together  with  some 
image  processing  techniques  and  3D  pose  recovering  techniques,  as  well  as  newly-developed  exoskeleton 
sensors. 


247  of  329 


We  have  applied  this  methodology  to  other  problems  related  to  human  hand  motion,  such  as  design  of 
exoskeletons  for  rehabilitation.  We  have  also  created  mechanical  sensors  for  the  finger  joints  that  are  to 
be  used  in  the  EMG  signal  identification  techniques.  The  idea  of  these  ones  is  that,  while  we  cannot 
exactly  measure  the  finger  joint  angle,  we  can  follow  its  motion  with  precision  using  a  mechanical  device, 
and  then  we  can  relate  the  angular  position  of  the  device  to  the  angle  of  the  finger  joint.  For  the  prosthetic 
hand,  the  most  interesting  design  is  that  of  the  thumb  with  its  complex  motion. 

General  kinematic  synthesis  solver  for  tree-like  articulated  system 

A  theoretical  framework  has  been  developed  to  allow  the  kinematic  synthesis  of  tree-like  articulated 
systems  with  variable  number  and  type  of  joints.  This  is  the  outcome  of  the  job  being  developed  in 
(Simo-Serra,  Moreno-Noguer  and  Perez-Gracia  2011  ).  The  kinematic  synthesis  problem  is  again 
expressed  equating  the  forward  kinematics  in  Clifford  algebra  form  to  a  set  of  finite  positions.  Using  a 
mixed  solver,  based  on  genetic  algorithms  and  paired  with  a  local  Levenberg-Marquardt  algorithm, 
multiple  solutions  can  be  found.  This  has  been  applied  to  recover  an  anthropomorphic  skeleton,  as  well  as 
to  create  new  designs..  However,  the  huge  number  of  solutions  of  the  problem  poses  an  additional 
difficulty  if  we  want  to  select  something  for  prosthetic  applications.  Future  research  includes  adding 
additional  constraints  for  anthropomorphism  for  this  application. 

The  raw  application  of  the  solver  to  fingertip  trajectories  from  human  hands  leads  to  a  big  number  of 
articulated  structures,  which  could  be  highly  non-anthropomorphic.  Figure  17  shows  one  of  these  results. 
In  order  to  get  anthropomorphic  solutions,  we  are  working  on  adding  additional  geometric  constraints  to 
the  model.  One  important  theoretical  result  out  of  this  research  is  the  proof  that,  despite  common  belief, 
the  hand/wrist  complex  is  not  a  redundant  kinematic  structure  when  the  tasks  of  more  than  one  fingertip 
are  considered  simultaneously. 


Figure  17:  One  hand  design  from  the  kinematic  solver 

The  actual  model  of  the  hand  that  the  solver  is  working  with  has  26  degrees  of  freedom  and  handles  27 
discrete  poses  of  the  hand  for  finding  a  solution  set  of  dimension  zero  (that  is,  discrete  number  of 
solutions).  This  implies  a  system  with  more  than  800  variables  and  more  than  1000  equations,  all  highly 
nonlinear.  The  solution  time  for  this  model  is  about  60  hours  on  a  single  computer;  the  algorithm  can  be 
parallelize  and  is  able  to  work  on  a  computer  cluster. 

This  solver  is  an  important  tool  to  test  different  chain  topologies  in  order  to  find  new  designs  for  some  of 
the  components  of  the  hand.  It  has  been  implemented  so  that  it  can  be  applied  to  the  design  of  any 
articulated  system. 
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Kinematic  Synthesis:  Application  to  Thumb  Exoskeleton  for  Pinching  and  Grasping  motion 

A  single-degree-of  freedom  mechanisms  has  been  selected  for  following  the  trajectories  of  the  thumb 
during  simple  pinch  and  grasping  movements.  The  linkage  to  perform  the  thumb  motion  was  selected 
among  several  single-degree-of-freedom  spatial  closed  linkages  with  four  to  six  links,  with  a  single  end- 
effector  for  controlling  the  orientation  and  position  of  the  proximal  phalanx  of  the  thumb.  In  this 
approach,  the  mechanism  will  be  actuated  by  a  single  actuator,  and  so  the  design  of  the  mechanism  is 
responsible  for  appropriately  shaping  the  thumb  motion.  In  addition,  the  designed  mechanism  is  confined 
to  the  back  of  the  hand,  so  as  to  minimize  sensory  feedback  interference,  and  to  allow  the  mechanism  to 
be  manufactured  with  minimal  size.  This  combined  with  the  intended  location  of  the  actuators  will  allow 
the  device  to  be  constructed  with  low  apparent  inertia.  This  application  was  done  in  collaboration  with 
University  of  Idaho  and  University  of  California,  Irvine.  Figure  18  shows  the  process  of  the  design,  from 
the  data  capture  to  the  prototyping. 


Figure  18:  Design  framework  for  exoskeletons 
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The  thumb  data  were  acquired  using  a  Vicon  motion  tracking  system  at  the  University  of  Idaho.  The  set 
up  we  used  had  eight  infrared  cameras  set  around  the  room,  primarily  for  larger  applications.  The  markers 
that  are  used  in  the  system  are  small  white  balls  that  reflect  the  infrared  light.  Arrays  with  the  markers 
placed  1.25  inches  apart  were  used,  making  it  easy  to  collect  data  in  the  three  dimensions,  see  Figure  19. 


Figure  19:  Markers  placed  in  the  thumb  and  data  capture  setup 


Figure  20  shows  one  typical  point  trajectory.  For  the  design  of  spatial  motion,  it  is  sometimes 
advantageous  to  work  with  relative  displacements.  Each  relative  displacement  expresses  a  motion  of  the 
thumb  from  a  reference  configuration,  taken  as  the  thumb  position  at  the  first  frame.  Each  displacement 
can  be  modeled  as  an  axis,  plus  a  rotation  about  and  a  translation  along  the  axis.  We  encode  this 
information  as  a  screw,  where  the  screw  axis  is  the  axis  of  the  displacement  and  the  pitch  is  the  ratio  of 
translation  to  rotation  for  that  displacement. 


Figure  20:  Thumb's  proximal  phalanx  point  trajectory 


In  order  to  accomplish  simplicity  together  with  spatial  motion  under  a  one-degree-of-freedom  system,  the 
first  step  is  to  select  the  closed  linkage  that  better  adjusts  to  this  trajectory.  Among  the  properties  of  these 
linkages  that  are  useful  for  our  application  we  can  cite  the  1-dof  motion,  requiring  only  one  actuator,  and 
topological  simplicity  while  creating  a  complex  motion.  In  addition,  overconstrained  linkages  have  other 
advantages,  such  as  inherent  structural  rigidity.As  an  example,  Eigure  21  shows  the  topology  of  the 
spatial  CCCC  and  CCC-CCC  linkage;  candidate  linkages  with  four  and  six  links  are  particular  cases  of 
this  one,  obtained  by  making  some  of  the  joint  variables  {9i,  r )  constant. 
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Out  of  the  several  candidate  linkages  selected,  and  after  examining  their  workspaces  (see  Figure  22),  the 
CRR-RRR  linkage  has  been  selected. 


5* 


Figure  21:  A  spatial  4-bar  CCCC  and  6-bar  CCCCCC  linkage 


linkage 


Figure  22:  Some  of  the  approximate  screw  systems  for  the  motion 


of  the  CCCR 


Let  us  consider  the  closed  CRR-RRR  linkage  as  two  serial  chains,  CRR  and  RRR,  joined  at  their  end- 
effectors.  The  axes  are  labeled  as  shown  in  Figure  5,  starting  at  the  fixed  C  joint  and  going  around  up  to 
the  final  fixed  R  joint.  For  every  joint  /,  let  S/  =  S/  -i-  be  the  joint  axis,  with  rotation  Ot,  and  slide  (for  the 
C  joint  only)  df.  We  express  the  forward  kinematics  equations  of  the  CRR  and  RRR  chains  using  dual 
quaternions  [3], 
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Qcrr{A0i  ,  A6I2,  Affs)  =  ^(cos  +  sin  — ^Sj) 

«  =  1 

A/9'  A/9- 

Qrrr{ABq,  A05,  A04,)  =  JJ  (cos  +  sin 

iG{6,5,4} 

whereA"^/  =  Adi  +  6^AJ/  is  the  dual  angle,  and  all  di  =  0  except  dl  corresponding  to  the  cylindrical  joint. 
The  forward  kinematics  so  expressed  represent  the  set  of  relative  displacements  of  the  chain  with  respect 
to  a  reference  configuration. 

In  order  to  create  the  design  equations,  we  minimize  the  distance  between  the  displacements  captured  and 
the  displacements  of  the  candidate  chain.  We  perform  dimensional  synthesis,  that  is,  the  goal  is  to  find  the 
location  and  dimensions  of  the  mechanism  performs  approximately  the  task.  The  design  equations  are 
created  by  equating  the  forward  kinematics  of  the  mechanism  to  each  of  the  discrete  positions  obtained 
—  1,  to  yield  design  equations 


QcRR{Ae\,AelAOi)  =  P^\ 

QRRRiAel  Aei)  =  P^\  i  =  2,...,m. 

In  these  equations,  the  variables  we  are  interested  in  are  what  we  call  the  structural  variables,  which  are 
the  Plucker  coordinates  of  the  joint  axes  S/  =  si  +  csO/  at  the  reference  configuration.  In  addition,  the 
optimization  process  outputs  the  angles  of  the  chains  in  order  to  reach  the  thumb  displacements. 

Seventeen  positions  were  selected  from  the  thumb  trajectory,  and  the  first  frame  was  taken  as  the 
reference  configuration,  which  yield  a  high  number  of  nonlinear  equations.  The  equations  were  solved 
using  a  Levenberg-Marquardt  nonlinear,  unconstrained  solver  implemented  in  Java.  This  is  based  on 
public  domain  MINPACK  routines,  translated  from  FORTRAN  to  Java  by  Steve  Verrill  [Verill  2000]. 

One  of  the  sets  of  positions  can  be  seen  in  Figure  24.  The  equations  were  run  14  times  for  three  different 
sets  of  positions  chosen  from  the  thumb  frames.  The  overall  error  of  the  function  was  smaller  than  0.04, 
and  it  took  a  variable  amount  of  time,  from  a  few  minutes  to  a  few  hours,  to  find  solutions.  For  these  14 
runs,  14  considerably  different  solutions  were  found.  Out  of  these  14  solutions,  3  linkages  were  selected 
because  of  their  overall  dimensions  and  placement  on  the  hand.  Figure  23  shows  the  SolidWorks  model 
of  those  solutions,  named  candidate  I,  II  and  III.  As  overall  solution,  we  selected  the  mechanism  with  the 
best  combination  of  fit  to  the  trajectory  and  smoothness  of  motion.  Figure  24  presents  some  of  the  early 
prototypes  of  the  exoskeleton;  rapid  prototypes  have  been  built  in  order  to  assess  the  manufacturing  and 
to  better  design  the  hand  attachment  and  compatibility  with  the  finger  exoskeleton. 


Figure  23:  The  three  solutions  selected  for  prototyping 


The  main  advantage  of  this  method  with  respect  to  previous  exoskeleton  designs  is  that  it  does  not  need 
any  assumption  about  the  location  and  type  of  joints  in  the  subject;  the  exoskeleton  is  going  to  follow  the 


252  of  329 


trajectory  that  is  selected  as  task  regardless  of  the  skeletal  structure  that  generates  it.  This  allows  for  the 
creation  of  new  and  innovative  exoskeleton  designs. 


Figure  24:  One  of  the  thumb  trajectories  (thin  frames)  with  superimposed  linkage  trajectory  (thick 
lines) 

The  high  number  of  solutions  obtained  mean  more  choices  for  the  designer  regarding  placement,  size,  and 
inertia  of  the  exoskeleton  for  the  desired  trajectory  and  the  results  seem  to  be  acceptable.  The  placement 
of  the  mechanism  on  the  lower  arm  and  close  to  the  wrist  is  also  according  to  specifications. 


Figure  25:  Two  different  prototypes,  attached  to  the  thumb 


The  mechanism  obtained  by  joining  the  common  normal  of  these  axes  is  then  optimized  in  terms  of  size 
and  interference  with  a  constrained  region. 

The  design  solution  of  Error!  Reference  source  not  found,  -where  the  cylinder  represents  the  hand  with 
which  the  mechanism  should  not  interfere-  shows  interference  and  large  and  uneven  link  sizes.  Both  of 
them  are  not  acceptable  in  terms  of  compactness,  manufacturability  and  assembly  point  of  view. 

A  CAD  model  for  manual  adjustment  has  been  created  as  shown  in  Error!  Reference  source  not 
found.,  in  which  the  links  can  be  changed  by  sliding  along  the  joints.  This  procedure  can  give  a 
mechanism  that  is  out  of  the  constrained  region;  however,  the  manual  procedure  is  time  consuming  and 
does  not  give  the  optimized  solution  in  general. 

The  optimization  problem  is  solved  using  genetic  hybrid  optimization  algorithm.  The  procedure  and  the 
technique  implemented  here  can  also  be  applied  to  other  problems  too. 
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Figure  26:  Raw  mechanism  from  synthesis  Figure  27  :  CAD  model  for  manual  optimization 


The  design  objective  considered  is  the  minimization  of  the  total  link  length  needed  for  the  mechanism.  In 
this  stage,  the  link  dimensions  were  optimized  by  converting  them  into  a  single  combined  objective.  The 
problem  has  a  number  of  geometrical  constraints: 

Minimizing  the  overall  length  of  the  mechanism:  the  mechanism  is  required  to  be  compact  while 
preserving  its  function.  To  formulate  the  objective  function,  the  parameters  as  shown  in  Figure  28  ,are 
used. 
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The  objective  function  was  then  formulated  to  minimize  the  distance  between  points  in  the  same  axis  as 
well  as  the  links  between  each  axis  using  the  formula  below,  together  with  inequalities  on  maximum  and 
minimum  length. 


^ 

(^,-a+n  -tik)  ^  20 


^  i{k+\) 


UPa 


(^i+V)k 


i(k+l) 


)] 


As  an  additional  requirement,  the  mechanism  should  not  interfere  with  the  hand.  For  the  convenience  of 
analysis,  the  hand  has  been  represented  or  modeled  as  a  cylindrical  region  with  radius  Rc  and  the  axis  of 

P  P 

the  cylinder  through  points  and  as  shown  in  the  Figure  29.  The  constraint  functions  are  defined 
in  such  a  way  that  the  3D  points  of  the  mechanism  joint  should  stay  out  of  the  cylinder  .  The  unit  vector 
along  the  cylinder  axis  is  defined  as  follows 

Vc  =  (Pc2  -  Pc,yV[(Pc2-Pc,)  <Pc2-Pc,)l 


If  any  of  the  mechanism  joint  points  represented  by  “  ”  ,  the  distance  of  “  ”  with  respect  to  the  point 

P  V  fP  -P  )  V 

along  ^  is  the  dot  product  of  ^  and  ^ 


L..=(P™-Pci)V 


Figure  29:  The  cylindrical  surface  to  represent  the  constrained  region  of  the  hand 

Since  the  CRR_RRR  mechanism  has  six  axes  and  twelve  points  (joints)  we  have  a  total  of  twelve 
nonlinear  constraint  functions  for  this  space  constraint,  each  of  them  defined  as  follow: 

(P™-Pci)-(P™-Pci)-Lj>/?e^ 

This  gives  a  total  of  twelve  nonlinear  constraints. 

Considering  all  the  constraints  and  the  objective  function  ,  the  optimization  problem  involves  twelve 
decision  variables,  one  nonlinear  objective  functions,  six  linear  inequality  constraints  and  twenty  four 
nonlinear  constraints.  Each  variable  also  bounded  within  a  lower  and  an  upper  limit.  The  nonlinearity  in 
the  objective  function  over  the  constraints  provide  the  main  difficulty  in  solving  the  problem.  A  set  of 
randomly  generated  solutions  over  the  above  mentioned  variable  bounds  indicate  that  about  only  one  in 
105  solutions  is  feasible.  Such  a  severity  of  the  feasible  region  makes  the  problem  even  more  difficult  to 
solve.  In  the  following  section  the  optimization  method  and  simulation  results  are  presented  . 
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For  instance  ,  let  us  consider  one  of  the  solution  obtained  through  the  synthesis  of  CRR_RRR,  Figure  31. 
The  Black  colors  are  the  links  of  the  mechanism,  whereas  the  colored  lines  represent  the  screw  axes  i.e 
red=Sl,  blue=S2  etc. 


Figure  30:  The  optimized  mechanism  using  genetic  algorithm 

The  result  obtained  was  refined  further  by  using  hybrid  genetic  algorithm.  Here  the  above  solution  was 
used  as  an  input  to  the  gradient  nonlinear  optimization  algorithm  and  the  result  found  more  optimized  as 
shown  in  Figure  32.  Here  all  the  constraints  are  met  and  a  more  compact  mechanism  is  obtained. 


Figure  31:  The  optimized  mechanism  using  a  hybrid  genetic  algorithm 

Based  on  the  data  ,  the  exoskeleton  has  been  redesigned  and  prototyped 
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Figure  33.  In  the  testing  of  the  mechanism  we  also  observed  a  little  resistance  at  the  joints  which  are 
caused  by  the  rough  surface  resulted  from  the  prototyping  machine  .  To  overcome  this  problem  ,  smooth 
and  light  weighted  mechanical  bushes  are  used,  and  future  optimizations  will  include  transmission  angles 
for  all  joints. 


Figure  32:  The  CAD  and  the  prototyped  model  of  the  exoskeleton 


Figure  33  :  Joint  connections 


Kinematic  Synthesis:  Application  to  the  design  of  a  Finger-joint  angular  sensor 

Estimation  of  joint  angles  for  human  joints  is  important  for  many  applications  in  Bioengineering.  Most  of 
the  existing  angular  joint  sensors  rely  on  the  approximate  assumption  of  the  knowledge  of  the  type  of 
motion  and  location  of  the  joint.  Using  the  kinematic  synthesis  methodology,  a  new  design  for  the 
measurement  of  finger  joint  angular  motion  has  been  developed.  The  design  presented  here  consists  of  an 
exoskeleton,  designed  to  fit  the  finger  motion,  in  which  we  can  relate  the  angular  displacement  of  its  links 
to  the  change  in  orientation  of  the  phalanx  under  consideration.  Unlike  other  designs,  the  exoskeleton 
does  not  need  any  information  about  the  actual  anatomy  and  the  dimensions  of  the  hand  in  order  to 
provide  with  the  angular  information.  The  design  is  to  be  used  in  myoelectrical  signal  identification. 

For  this  application,  the  desired  mechanism  is  required  to  do  two  things:  firstly,  it  should  follow  the 
trajectories  described  by  the  collected  data;  and  secondly,  there  should  be  a  one-to-one  correspondence 
between  the  orientation  of  the  MIP  joint  of  the  finger  to  one  of  the  joints  of  the  mechanism.  It  seemed  that 
a  six-bar  linkage  was  the  simplest  closed,  planar  linkage  able  to  follow  the  collected  trajectories 
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accurately.  On  the  other  hand,  being  a  simple,  one-dof  linkage,  the  relationships  between  all  its  angles  are 
well  known  and  can  be  related  to  the  angle  of  the  coupler  and  the  MIP  joint.  The  topology  to  be  used  is 
shown  in  Figure  34. 


A  set  of  equations  are  created  to  determine  the  trajectory  that  point  P  would  follow  through  the  operation 
of  the  mechanism.  In  this  case  we  have  a  total  of  63  nonlinear  equations  and  61  unknowns.  The  equations 
were  solved  using  a  Levenberg-Marquardt  nonlinear,  unconstrained  solver  implemented  in  Java. 

From  the  design  of  the  mechanism  it  is  shown  that  the  angle  0  corresponds  to  the  orientation  of  the  MIP 
joint  of  the  finger.  Thus,  we  can  get  the  value  of  0  for  every  finite  displacement  of  the  finger  in  terms  of 
1.  Since  the  objectives  is  to  come  up  with  a  cost  effective  sensing  device,  a  resistive  potentiometer  is 
1  ratio  or  the  rate  is  less  by  which  we  can  reduce  noise  and  sensitivity  issue  for  the  sensor  and  the  other 
reason  is  the  accessibility  or  the  orientation  of  the  linkage  is  also  suitable  to  mount  the  sensor. 
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Figure  35  lAngular  positions  as  a  function  of  time 


The  candidate  designs  were  ranked  considering  size,  mechanism  placement  and  overall  structure.  The 
selected  design,  optimized  to  fit  the  user’s  hand,  is  shown  in  Figure  36.  Figure  37  shows  an  earlier  version 
at  two  different  configurations. 


Figure  36:  CAD  model  of  the  exoskeleton  and  the  sensor  on  the  hand. 
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The  sensor  has  been  prototyped  and  tested.  Figure  38  shows  the  experimental  setup  and  the  prototyped  sensor.  In 
order  to  increase  the  sensitivity  of  the  sensor  a  Wheatstone  bridge  has  been  built  ;  the  potentiometer  on  the 
exoskeleton  is  used  as  the  variable  resistor  in  the  bridge.  And  for  the  convenience  of  recording  and  monitoring  the 
sensor  value,  the  microcontroller  and  Lab  view  have  been  used.  Using  this  lab  view  model  we  can  monitor  the 
analog  signal  change  due  to  the  position  change  of  the  potentiometer  on  the  sensor.  Once  we  have  recorded  the  data, 
the  angle  relation  obtained  from  the  kinematic  analysis  will  be  applied  to  relate  the  real  change  of  the  MCP  joint 
angle. 


Figure  38:  Experimental  setup 

In  order  to  assess  the  effect  of  the  sensor  on  the  EMG  signal,  an  experiment  with  and  without  the  sensor 
have  been  performed.  The  result  shown  in  Figure  39  (left)  indicates  the  EMG  signal  without  having  the 
sensor  whereas  the  right  plot  shows  the  EMG  signal  of  the  same  subject  taken  with  the  sensor  on  the  hand 
.  Observing  these  two  figures  it  can  be  said  that  the  sensor  doesn’t  have  a  significant  effect  on  the  EMG 
signal. 
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Figure  39:  EMG  signal,  without  and  with  finger  sensor 


These  results  also  confirm  that  this  simple  and  cost-effective  mechanism  for  the  estimation  of  the  angles 
of  the  Metacarpal  interphalangeal  (MIP)  joint  is  more  attractive  in  many  ways  .  The  design  strategy 
includes  vision  system  and  image  processing  coupled  with  kinematic  synthesis  techniques. The  main 
advantage  of  this  method  is  that  it  does  not  need  any  assumption  about  location  and  type  of  joints  in  the 
subject;  the  exoskeleton  is  going  to  follow  the  trajectory  that  is  selected  as  task  regardless  of  the  skeletal 
structure  that  generates  it.  This  allows  for  the  creation  of  new  and  innovative  exoskeleton-based  position 
sensors  which  can  help  for  EMG  and  position  modeling  in  the  grasp  and  control  study.  The  application  of 
image-processing  techniques  and  use  of  a  six-bar  mechanism  and  a  simple  potentiometer  grants  a  less- 
cost,  effective  sensing  device. 


Kinematic  data  acquisition  system 

The  experimental  approach  to  get  the  data  is  based  on  the  principle  that  the  pose  of  a  calibrated  camera 
can  be  uniquely  determined  from  a  minimum  of  four  coplanar  but  noncollinear  points.  Thus,  two  squares 
attached  to  the  proximal  phalanges  and  to  the  dorsal  part  of  the  carpel  are  used.  Then  the  index  finger  is 
moved  to  its  different  positions/reaches.  While  moving  the  index  finger,  different  frames  are  captured 
using  a  Dragonfly  2  camera  from  GreyPoint,  with  a  Fujinon  l:1.4/9mm  lens,  interfaced  with  a  computer 
using  Lab  VIEW.  The  LabVIEW  program  captures  and  saves  multiple  images  into  the  hard  disk  [Ahsan 
2008].  Once  the  frames  are  saved,  sample  frames  from  different  orientation  of  the  index  finger  are 
selected  for  processing.  See  schematic  diagram  of  the  process. 


Image 

Acquisition 

- 

Image 

Segmentation 

- 

Corner  detection  of 
the  square  blobs 


3D  pose  recoveiy  of  the 
finger  joints  movement 


Figure  40:  Image  acquisition  and  processing 


In  order  to  compute  pose  for  3D  to  2D  correspondences  of  a  planar  target,  the  algorithm  used  is  based  on 
Hager  and  Schweighofer  [Schweighofer  2006].  The  algorithm  is  customized  to  obtain  a  set  of  task 
positions  from  a  video  stream  of  a  hand  moving  with  markers. 
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Some  squares  are  used  as  a  reference  position,  as  the  relative  position  between  this  square  and  the  fixed 
joint  of  the  mechanism  is  always  constant  while  the  hand  is  moving.  The  markers  are  used  to  estimate  the 
pose,  which  consists  of  the  position  and  orientation  of  each  finger.  An  important  aspect  of  this  setup  is  the 
geometry  of  the  markers.  The  geometry  of  a  marker  affects  directly  its  performance  and  usability  in 
computer  vision  applications.  The  design  used  by  this  project  is  a  simple  white  square  with  a  smaller 
black  square  inside  as  shown  in  Figure  41.  In  order  to  segment  the  squares  properly,  three  different  square 
sizes  are  used.  This  provides  four  sharp  visible  corners  which  form  a  perfect  square  that  can  be  used  to 
find  the  3D  pose  of  the  marker. 


Figure  41:  Images  of  the  hand  with  the  squares 


It  is  important  for  these  markers  to  be  completely  rigid  for  accurate  pose  estimation.  For  detection  of  the 
candidate  points  the  Harris  corner  and  edge  detector  algorithm  is  used.  To  get  a  better  result  both  in  the 
detection  and  pose  recovery  image  segmentation  is  also  performed  so  that  the  square  corners  are  visible 
enough  to  be  detected  . 


The  images  showing  in  Figure  42  are  two  of  the  images  we  acquire  for  the  image  processing  of  the  finger 
joints  movements.  After  the  image  segmentation,  based  on  blob  size,  we  get  some  images  with  only  blobs 
of  attached  with  the  finger  joints. 


Figure  42:  The  detected  blobs  for  the  squares 


The  image  segmentation  algorithm  for  detecting  the  square  blobs,  separates  the  square  blobs  from  the  images. 
The  rgb  images  were  made  as  binary  images  then  the  allowable  area  of  the  image  and  red  channel  pixels  were 
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changing  for  the  detecting  and  separation  of  the  square  blobs.  We  used  the  red  channel  thresholds  as  less  than  70x70 
pixels  and  the  allowable  area  as  430x430  pixels. 

The  square  blob  separation  algorithm  worked  perfectly  for  all  the  sample  images  we  used  and  it  was  easier  to  run  the 
Harris  corner  detection  algorithm  on  these  images  to  get  the  perfect  corners  of  the  squares.. 

After  the  separation  of  the  square  blobs  we  compute  the  corners  of  the  squares.  The  2D  position  of  the  corners  is  to 
be  converted  in  a  3D  pose,  which  will  be  the  position  of  the  squares  for  the  design  of  the  finger  movement.  We  got 
the  position  of  the  12  corners  after  running  this  algorithm.  See  Figure  43. 


Figure  43:  Corners  detected  from  the  square  blobs 


After  detecting  the  corners  of  the  squares  we  got  the  2D  position  of  the  squares,  which  is  given  below: 
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Next  step  is  to  use  a  clustering  algorithm  on  the  12  points  to  separate  the  three  squares.  Figure  44 
shows  the  results  of  the  clustering,  separating  all  three  squares.  It  is  easy  then  to  identify  the  square 
belonging  to  each  limb  by  computing  its  size  using  the  points. 
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Figure  44:  Results  of  the  clustering  algorithm 


The  3D  pose  recovery  algorithm  (Hager  and  Schweihofer)  can  map  3D  reference  points  from  the  2D 
t,  □  =  >  3. 

These  points  can  be  expressed  in  an  object-centered  reference  frame.  The  corresponding  camera  space 

□  .  These  points  are  related  by  rigid  transformation  as, 

□  +  □ 

□). 

□□  for  each  position  of  the  target  point  (the  point  from  the  square  at  the 

□  □  (the  point  from  the  square  at  the  carpal)  with  respect  to  the  camera.  In 
order  to  refer  all  the  moviments  of  the  target  point  locally  we  use 

□  the  transformation  from  the  reference  frame  at  the  carpal  to  the  proximal  phalange  ,  the  design 
equations  are  formulated  based  on  the  candidate  mechanism. 

This  methodology  in  theory  provides  results  for  an  arbitrary  motion  of  the  fingertips,  which  it  is  used  both 
as  an  input  for  the  design  and  as  a  way  to  collect  hand  motion  information  and  synergies.  However,  it  is 
difficult  to  apply  successfully  this  methodology  to  motion  that  is  highly  non-planar,  especially  the 
segmentation  and  clustering  parts.  As  a  conclusion,  other  methods  for  data  capture,  such  as  combining 
vision  with  infrarred  detection,  are  going  to  be  studied.  The  vision  system  may  be  used  in  the  future  to 
capture  information  about  velocity  using  a  direct  method.  Current  method,  which  calculates  the  finite 
differences,  is  prone  to  having  high  error  from  noise. 
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Goal  4:  Biocompatibility  and  Signaling 

Abstract  of  this  section: 


A  major  unresolved  biocompatibility  issue  pertains  to  how  tissue  and  cellular  inflammatory  responses  are 
elicited  by  artificial  implant  material(s).  We  are  developing  a  “Sensor  on  Cells  on  Skin  Model”  to  facilitate  the 
investigation  of  this  biocompatibility  issue.  We  have  made  significant  progress  in  cell  model  development.  We 
have  developed  new  cell  models  of  peripheral  nervous  system  consisting  of  dorsal  root  ganglion  neurons  and 
Schwann  cells.  The  new  models  are  suitable  for  elucidating  nerve  degeneration  and  regeneration.  We  are 
characterizing  these  new  models  further.  We  have  developed  several  “smart”  biosensors  for  tissue  engineering 
and  biocompatibility  studies  and  related  biomedical  engineering  applications.  In  parallel  with  cell  model  and 
sensor  development,  we  have  investigated  the  molecular  mechanisms  underlying  the  cytotoxicity  of  silicon 
dioxide  and  magnesium  oxide  nanoparticles  in  neural  cells.  Our  extensive  literature  survey  indicates  that  our 
studies  are  truly  novel  and  will  lead  to  further  ground-breaking  discoveries  because  the  whole  important  issue  of 
how  tissue  and  cellular  inflammatory  responses  are  elicited  by  implant  material(s)  have  not  been  resolved  and  is 
poorly  understood. 

INTRODUCTION: 

Current  artificial  organ  and  tissue  engineering  research  (e.g.,  artificial  bone  and  joint  implants)  reveals  that  over  time 
the  artificial  implants  fail  to  function  even  though  over  a  short  initial  period  after  they  were  implanted,  such  devices 
appear  to  function  as  the  biomedical  engineers,  who  had  designed  them,  expected.  The  findings  of  numerous  studies 
indicate  that  the  failure  of  the  implants  (despite  their  initial  success)  were  attributed  to  the  fact  that,  over  time,  the 
cells/tissues  immediately  surrounding  and/or  in  contact  with  the  implants  appear  to  develop  “inflammatory 
reactions”  to  the  implants  thereby  compromising  the  implants’  performance  (see  Lai  et  al.,  2007a  &  ref  therein). 
Furthermore,  if  the  implants  act  as  sensors,  the  “inflammatory  reactions”  exhibited  by  the  cells/tissues  surrounding 
the  implanted  sensors  induce  interference  of  the  signal  transmission  of  the  implants.  However,  “inflammatory 
reactions”  exhibited  by  the  cells/tissues  surrounding  the  implanted  sensors  are  poorly  understood  and  remain  to  be 
major  challenges  for  tissue  engineers  and  other  biomedical  engineers  who  design  such  implant  devices.  Moreover, 
our  extensive  searching  in  the  literature  reveals  that  there  is  a  paucity  of  literature  on  robotic  implants  and  tissue 
inflammatory  responses  (Lai  et  al.,  2007a).  Nevertheless,  nanoparticles  and  other  nanomaterials  have  been 
increasing  employed  to  manufacture  implants  and  biosensors.  There  is  emerging  concerns  that  some  nanomaterials 
may  post  health  hazards  to  humans  because  of  recent  findings  of  nanotoxicology  (Lai  et  al.,  2007a,b).  Consequently, 
in  order  to  circumvent  such  biocompatibility  issues  in  the  design  of  robotic  implants,  it  is  imperative  to  elucidate  the 
mechanisms  by  which  such  “inflammatory  reactions”  exhibited  by  the  cells/tissues  surrounding  the  implants  arise 
and  elucidate  the  putative  nanotoxicity  of  nanomaterials  employed  to  fabricate  implants  and  biosensors.  Thus,  our  in 
vitro  model  (see  Fig.  1  below)  allows  us  to  address  these  physiologically  and  pathophysiologically  important 
mechanistic  issues.  For  phase  II  of  our  projects,  the  goals  are  to:  (1)  Continue  to  develop  the  “sensor  on  cells  on  skin 
model,”  especially  stages  two  and  three  of  the  model  development  (see  Addenda  of  Full  Proposal);  (2)  Further 
characterize  the  putative  nanotoxicity  of  nanoparticles  and  other  nanomaterials  commonly  employed  to  fabricate 
biosensors  and  implants;  (3)  Detect  signal  mechanisms  that  influence  cell  growth  and  suppression  such  as  apoptosis; 
(4)  Couple  enzymes  on  sensors  for  signal  identifications  and  amplifications;  and  (5)  Detect  signals  for  biological 
growth  and  interferences  with  quantifiable  parameters  such  as  current,  voltage,  pH,  etc.  between  various  cell  types 
of  different  organs  of  origin. 

The  following  are  the  deliverables: 

1)  Continue  to  develop  the  “sensor  on  cells  on  skin  model,”  especially  stages  two 
and  three  of  the  model  development  (see  Addenda  of  Full  Proposal); 

2)  Further  characterize  the  putative  nanotoxicity  of  nanoparticles  and  other 
nanomaterials  commonly  employed  to  fabricate  biosensors  and  implants; 

3)  Detect  signal  mechanisms  that  influence  cell  growth  and  suppression  such  as  apoptosis; 

4)  Couple  enzymes  on  sensors  for  signal  identifications  and  amplifications;  and 

5)  Detect  signals  for  biological  growth  and  interferences  with  quantifiable  parameters  such  as  current,  voltage, 
pH,  etc.  between  various  cell  types  of  different  organs  of  origin. 
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We  have  continued  to  make  progress  in  studies  outlined  in  Goal  4  of  our  proposal  and  have  summarized  the  results 
obtained  during  this  period  in  the  following  sections.  We  have  been  productive  despite  the  gap  in  funding  between 
the  ending  of  Phase  I  and  initiation  of  funding  of  Phase  II:  we  have  presented  40  papers  at  national  and  international 
meetings  and  have  9  journal  articles,  3  reviews,  20  conference  proceedings  papers  and  40  abstracts  published  or 
in  press  (see  Publications  below). 

A.  Set  up  of  the  ^‘Sensor  on  Cells  on  Skin  Model”: 

Based  on  our  extensive  experience  in  working  with  mammalian  (including  human)  cells  in  culture  (Dukhande  et  al., 
2006;  Hertz  et  al.,  1998;  Isaac  et  al.,  2006;  Isaac  et  al.,  2007;  Lai  et  al.,  2008,  2010;  Malthankar  et  al.,  2004;  Puli  et 
al.,  2006),  we  envisaged  that  we  will  undergo  three  stages  to  develop  our  “sensor  on  cells  on  skin  model:”  (i)  stage 
one  involves  the  development  of  different  human  and  other  mammalian  cells  (including  nerve,  muscle,  and  skin 
cells)  in  co-culture;  (ii)  stage  two  requires  the  juxtaposition  of  cells  in  relation  to  the  membrane  as  illustrated  in 
Figure  1.  below  (this  figure  was  included  in  our  proposal);  and  (hi)  stage  three  involves  designing  the  sensor(s)  and 
fitting  them  into  the  “sensor  on  cells  on  skin  model”  (as  shown  in  Fig.  1). 


Fig.  1  “Sensor  on  Cells  on  Skin  Model.”  The  sensor  (or  implant:  blue  rectangle)  is  in  contract  with  a  monolayer 
of  muscle  or  nerve  cells  (gray  ovals),  which  are  in  contact  with  the  artificial  skin  (an  artificial  membrane  with 
specified  pores:  brown  rectangle),  (a)  stimulating  electrode;  (b)  sensor  signal  pick-up;  (c)  alternative  position  of 
sensor. 

We  successfully  competed  (i)  stage  one  of  setting  up  the  model  as  depicted  above.  More  recently,  we  have 
begun  developing  new  cell  models  employing  dorsal  root  ganglion  neurons  and  Schwann  cells,  both  are  neural  cells 
from  the  peripheral  nervous  system  (see  Appendices  2  &  6).  Both  dorsal  root  ganglion  neurons  and  Schwann  cells 
are  important  and  relevant  cell  types  for  investigating  biocompatibility  of  biomaterials.  We  have  therefore 
characterized  these  cell  types  and  test  their  ability  to  respond  to  inflammatory  assaults. 

As  shown  in  Figure  2,  the  population  of  dorsal  root  ganglion  neurons  showed  exponential  growth  in  vitro  as  a 
function  of  initial  seeding  density.  Similarly,  as  shown  in  Figure  3,  the  S 16  Schwann  cells  also  showed  exponential 
growth  in  vitro  as  a  function  of  initial  seeding  density.  Once  we  have  established  their  growth  patterns  in  culture,  we 
are  now  in  a  position  to  further  characterize  them  in  terms  of  other  physiological  and  cell  biological  functions. 
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Absorbance 


Growth  of  Dorsal  Root  Ganglion  Neurons 


Figure  2.  Growth  of  Dorsal  Root  Ganglion  Neurons  in  Culture. 


S16  Schwann  Cell  Calibration  Curve 


Figure  3.  Growth  of  S16  Schwann  Cells  in  Culture. 
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Various  biocompatible  materials  in  tissue  engineering  have  been  employed  to  construct  artificial  skin.  One  such 
material  is  chitosan,  a  polysaccharide  biopolymer  derived  from  chitin.  We  have  employed  chitosan  as  a  tissue- 
engineered  model  of  skin  and  investigated  how  this  artificial  skin  can  interact  with  other  mammalian  neural  and 
non-neural  cell  types.  Because  the  amount  of  acetylated  monomer  (i.e.,  N-acetyl-D-glucosamine)  in  chitosan 
influences  the  surface  and  other  properties  of  chitosan,  the  “artificial  skin,”  we  considered  it  important  to 
characterize  and  compare  the  degree  of  deacetylation  of  chitosan  prepared  and/or  purified  by  several  methods. 

Purification  of  Chitosan 

Chitosan  was  further  purified  by  dissolving  it  in  1%  acetic  acid,  followed  by  filtration  and  precipitation 
with  5%  (w/v)  NaOH.  The  alkaline  precipitate  was  then  washed  with  deionized  water  until  the  water  pH  was  ~  7.0. 
The  resultant  material  was  then  freeze-dried  or  oven-dried  at  60  °C. 

Preparation  Chitosan  from  Chitin 

Chitin  (~1.5g)  was  immersed  in  75  ml  of  45%  aqueous  NaOH,  and  the  mixture  was  heated  at  130  °C  for 
0.5,  1,  2,  or  5  hours  (h).  The  deacetylated  material  was  washed  with  deionized  water  until  the  water  pH  was  --  7.0. 
The  residue  was  then  dried  at  60  °C  for  24  hours. 

Determination  of  the  Degree  of  Deacetylation  (DD)  of  Different  Preparations  of  Chitosan 

The  DD  of  chitosan,  purified  chitosan,  and  chitosan  from  chitin  prepared  with  different  duration  of  heating 
was  assessed  by  determining  the  amount  of  acetylated  monomer  (N-acetyl-D-glucosamine)  in  the  sample  using  first 
derivative  UV- spectroscopy  with  maximum  at  201  nm.  Samples  (0.1  mg/ml  in  0.0 IM  acetic  acid)  prepared  by  the 
methods  depicted  above  were  analyzed.  Standards  of  N-acetyl-D-glucosamine  at  concentration  between  5  and  50 
pg/ml  in  0.0 IM  acetic  acid  were  used  to  construct  the  standard  curve  used  to  determine  the  amount  of  N-acetyl-D- 
glucosamine  in  the  samples.  The  degree  of  deacetylation  (DD)  of  the  chitosan  in  the  samples  was  calculated  using 
the  following  equation: 

DD=  (1 -ratio  of  acetylation)  *  100 

=  (1 -concentration  of  N-acetyl-D-glucosamine  in  sample/ 100) *100. 

Calibration  Curve 

As  shown  in  Fig.  4,  in  the  range  from  5  to  50  pg/ml,  there  was  a  linear  relationship  between  N-acetyl-D- 
glucosamine  concentration  and  its  first  derivative  absorbance.  Its  first  derivative  UV-spectra  are  shown  in  Fig.  5. 


Figure  4.  Calibration  curve  for  N-acetyl-D-glucosamine. 
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Figure  6.  First  derivative  UV-Spectra  of  Various  chitosan/chitin  samples. 
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Figure  7.  Degree  of  deacetylation  of  purified  chitosan,  chitosan,  and  chitin  boiled  for  different  times. 
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Figure  8.  Effect  of  heating  on  the  degree  of  deacetylation  of  chitin. 


The  first  derivative  UV-spectra  for  chitosan,  purified  chitosan,  and  chitin  boiled  for  different  times  are 
shown  in  Fig.  6.  As  shown  in  Fig.  7,  the  DD  of  chitosan  without  purification  was  75.08%  while  that  for  the  purified 
chitosan  was  70.18%.  After  being  oven-dried,  the  DD  of  purified  chitosan  was  73.81%.  These  results  strongly 
suggested  that  purification  of  chitosan  led  to  decreases  in  its  DD  because  the  concentration  of  N-acetyl-D- 
glucosamine  in  purified  chitosan  is  higher  than  that  in  non-purified  chitosan. 
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Heating  at  130  °C  only  exerted  a  modest  effect  on  the  DD  of  chitosan  (Fig.  8):  the  DD  only  increased  to  a 
small  extent  with  increases  in  heating  time  up  to  5  hours  (Fig.  8).  Thus,  the  results  of  our  ongoing  studies  indicate 
that  the  deacetylation  of  chitosan  can  be  modified  by  physico-chemical  modification(s)  during  the  purification 
process.  This  property  of  chitosan  can  be  exploited  further  in  the  tissue  engineering  of  “artificial  skin.”  Additionally, 
we  are  continuing  to  investigate  the  properties  of  chitosan  membrane  in  combinations  with  nanoparticles. 


We  have  continued  the  studies  to  address  (ii)  stage  two  of  setting  up  the  model  and  (iii)  stage  three  of 
designing  and  characterizing  the  biosensors.  We  have  summarized  below  our  progress  in  developing  and 
characterizing  the  biosensors. 

Sensor  Development: 

During  Phase  I  of  this  project,  we  studied  the  development  of  biosensor  platform  that  are  capable  of 
measuring  biometabolites  and  environmental  sensitive  species,  such  as  peroxide  and  nitrate/nitrate,  to  concentration 
in  the  order  of  ppb  (parts  per  billion)  or  lower. 

In  our  more  recent  development,  we  modified  our  platform  with  dendrimers  to  enhance  its  performance. 
Zero  and  second  generation  of  dendrimers  were  coated  on  the  surface  of  a  carbon  glassy  platform  electrode  modified 
with  GDH  (glutamate  dehydrogenase)  and  it  was  used  to  measured  ammonium,  a  common  biometabolite,  at  near 
neutral  pH  that  is  common  for  normal  bioactivities.  The  resulting  electrode  was  tested  with  ammonium 
concentrations  ranged  from  0.002  to  0.3  pM  with  satisfactory  results.  Figure  9  shows  the  cyclic  voltammograms  of 
various  ammonium  concentrations  measured  by  the  modified  glassy  carbon  electrode,  the  lowest  concentration  was 
2  nM.  As  indicated  in  the  voltammogram  in  the  reductive  curves  (upper  lines),  there  was  a  big  gap  (current 
difference)  between  the  blank  (of  buffer  solution)  and  the  first  reductive  curve  (2  nM).  Therefore,  it  is  possible  that 
the  modified  electrode  can  measure  ammonium  concentrations  down  to  subnanomolar  levels. 


Figure  9.  Cyclic  voltammograms  (i/v)  of  gold  colloid-cysteamine/PAMAM_2^^-modified  glassy  carbon 
electrode  measured  from-0.2  to  0.4  V  for  the  measurement  of  NH4'^,  the  lowest  concentration  was  2  nM. 
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Figure  10.  Performance  differences  of  the  glassy  carbon  electrode  modified  by  different  materials:  1.  Modified  with 
cysteamine-Au-GDH/NADH;  2.  Cysteamine  /PAMAM_0-Au-GDH/NADH;  3.  PAMAM_0-Au-GDH/NADH;  4. 
Cysteamine  /PAMAM_2"‘‘-Au-GDH/NADH;  5.  PAMAMJ""  -Au-GDH/NADH. 


Figure  10  shows  that  there  were  distinctive  current  differences  for  the  reaction  of  ammonium  and  a- 
ketoglutarate  when  the  electrode  was  modified  by  different  materials.  From  the  stand  point  of  detection,  within  the 
five  modifications,  sensor  coated  with  second  generation  of  PAMAM  would  have  the  highest  sensitivity  (current  vs. 
concentration).  The  results  were  conceivably  due  to  the  higher  branching  property  of  PAMAM_2”^. 

As  shown  in  Figure  1 1 ,  PAMAMs  can  be  attached  to  cysteamine  to  enhance  the  available  sites  for  the 
electrons  transfer  between  reactions,  in  this  case,  ammonium  and  a-ketoglutarate,  therefore  increase  the  detection 
lower  limit. 


Figure  11.  Cysteamine-PAMAM-Au-GDH  coated  on  plastic  UV-VIS  cell  with  permanent  absorption  peak  at  278 
nm.  Various  lines  indicated  concentration  differences. 


real  cone. of  ketoglutarate/|aM 


Figure  13.  Cyclic  voltammograms  of  GDH/NADH  modified  glassy  carbon  electrode  (at  low  and  high  voltage  range) 
for  current  vs.  real  concentration  of  a-ketoglutarate  at  low  and  high  voltage  for  GDH  and  NADH  modified 
electrodes.  1.  Glassy  carbon  electrodes  modified  with  cysteamine  -Au-GDH.  2.  Glassy  carbon  electrodes  modified 
with  cysteamine  /PAMAM_0  -Au-GDH.  3.  Glassy  carbon  electrodes  modified  with  cysteamine  /PAMAM_2“^  -Au- 
GDH.  4.  Glassy  carbon  electrodes  modified  with  PAMAM_2”^  -Au-GDH.  5.  Glassy  carbon  electrodes  modified 
with  AMAM_0  -Au-GDH. 
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Figures  12  and  13  show  that  there  were  distinctive  current  differences  for  the  reaction  of  ammonium  and  a- 
ketoglutarate  when  the  electrode  was  modified  by  different  materials.  Because  a-ketoglutarate  is  an  important 
tricarboxylic  acid  cycle  intermediate  and  a  common  metabolite,  the  modifications  as  indicated  in  the  two  figures 
suggested  that  the  biosensor  has  good  capacity  for  detecting  a  range  of  concentrations  of  this  metabolite.  However, 
the  current- voltage  relationship  is  nearly  linear  after  the  initial  extreme  low  concentrations.  Thus,  one  should  be 
cautious  in  selecting  for  the  i/v  ratio  depending  on  the  applications  (for  detection  of  extreme  low  and  higher 
concentrations). 

In  our  more  recent  development,  we  modified  our  platform  to  include  the  parallel  development  of 
biosensors  and  fuel  cells.  As  in  most  biosensors,  the  detection  principles  are  based  on  redox  reactions  of  enzymatic 
reactions,  which  is  the  same  principle  used  in  most  biofuel  cell  and  how  biological  systems  obtain  energy  to  sustain 
live  functions.  For  the  sensors  we  previously  developed  that  utilize  the  enzymes,  LHD  and  GDH,  for  detections  of 
various  metabolites,  biochemical  reactions  that  involved  these  two  enzymes  can  also  be  converted  to  a  biofuel  cell 
system: 


For  the  biofuel  cell  system,  the  anodic  half-cell  was  made  by  an  Au  electrode  coated  with  lactate 
dehydrogenase  (LDH)  submerged  in  solution  containing  lactate  and  nicotinamide  adenine  dinucleotide  (NAD-f), 

thus,  for  the  anodic  half  reaction: 

LDH 

Anode:  Lactate  -i-  NAD"^  — ^  pyruvate  -i-  NADH  -i-  2H^  -i-  2e'  (1) 

As  lactate  was  oxidized  into  pyruvate  in  the  anode,  the  oxidative  potential,  Eo’(25  °C),  would  be  0.19  V. 

The  cathodic  half-cell  was  made  by  a  glassy  carbon  electrode  (GCE)  coated  with  glutamate 
dehydrogenase  (GDH)  submerged  in  solution  containing  ammonia  and  reduced  nicotinamide  adenine  dinucleotide 
(NADH),  the  cathodic  half  reaction  was: 

DDH 

Cathode:  a-Ketoglutarate  NH4'^  NADH  H"^  2e'  — ^  glutamate  NAD"^  H2O  (2) 

As  a-ketoglutarate  was  reduced  into  glutamate  in  the  cathode,  it  generated  a  reductive  potential,  Eo’(25  °C),  of  -0.14 
V. 


Combining  Equation  (1)  and  (2),  the  total  potential  for  the  fuel  cell  with  the  anode  and  cathode 
above  was  0.05  V  (per  mole).  In  general,  biological  reactions  in  nature  do  not  release  large  amount  of  energy  for 
each  reaction  step  to  preserve  energy  utilization  efficiency.  The  overall  reaction  for  the  biofuel  cell  in  our  system 
was: 

LDH.GDH 

Lactate  +  a-ketoglutarate  -1-  NH4‘^ - ^  pyruvate  -1-  glutamate  -1-  H"^  -1-  H2O  (3) 

Since  the  A  Eq’  of  Equation  (3)  was  greater  than  0,  the  reaction  was  spontaneous  and  would  proceed  as  written  from 
left  to  right. 

A.  Anodic  half-cell 

Eigure  14  shows  the  oxidative  responses  of  the  modified  Au  electrode  with  nanogold  particles,  cysteamine 
and  LDH.  As  seen,  the  characteristic  peak  of  lactate  conversion  to  pyruvate  was  detected  at  250  mV  and  the 
accumulative  current  increased  linearly  with  added  lactate  instantaneously.  It  verified  that  the  modified  anodic 
electrode  was  functioning  as  expected  in  Equation  (1). 

B.  Cathodic  half-cell 

Eigure  15  is  the  reductive  response  of  a  GCE  modified  with  2“^  generation  of  PAM  AMs,  nanogold 
particles,  and  GDH.  The  cathodic  half-cell  reaction  functioned  more  efficiently  at  lower  concentrations  of  a- 
ketoglutarate  and  became  less  effective  as  the  accumulative  concentration  of  a-ketoglutarate  was  higher  (>0.025 
mM). 
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Figure  14.  Voltammetric  responses  of  an  Au  electrode  coated  with  cysteamine,  Au  nanoparticles,  and  LDH  at  pH  8. 
Responses  were  stepwise  additions  of  lactate  at  l.Ox'"^  mol/ml  with  linear  current  increments  (oxidative  peaks)  at  250 
mV. 
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Figure  15.  Reductive  responses  of  a  glassy  carbon  electrode  modified  with  PAMAM,  Au  nanoparticle  and  GDH 
measured  at  0.7  V  in  solution  of  ammonia  and  a-ketoglutarate. 


Our  biofuel  cell  system  would  generate  a  relative  low  potential  (0.05V),  but  the  reactants  are  all  readily  available 
from  our  body  which  make  it  closer  to  reality  for  the  system  to  be  implanted  into  our  body  as  power  source  for 
biomedical  devices.  A  similar  approach  can  be  used  to  explore  enzymatic  reactions  within  human  body  that  can 
produce  higher  energy  output.  This  biofuel  cell  can  be  used  potentially  to  power  the  prosthetic  hand  this  grant  is 
developing. 


The  biosensor  platform  thus  far  was  proven  to  be  versatile  and  can  be  used  in  many  biomedical  and  environmental 
applications.  We  continue  to  work  on  the  development  of  these  smart  sensors:  we  are  particularly  focusing  on  the 
development  of  bionanosensors  for  tissue  engineering  and  biocompatibility  studies  and  related  biomedical 
engineering  applications  (see  Appendices  9  &13). 


Further  Development  of  Nanobiosensors 

We  previously  have  successfully  developed  a  glassy  carbon  electrode  (GCE)  biosensor  that  could  detect 
ammonia,  or  glutamate  concentrations  down  to  10'^  M  based  on  the  following  bioenzymatic  reaction: 

a-Ketoglutarate  +  NH4  +  NADH  +  H  +  2e  - ^  glutamate  +  NAD  +  H2O 
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Currently,  we  have  used  the  same  platform  of  electrode  sensor  system  to  explore  the  ultimate  limit  of  concentration 
detection  for  the  system:  down  the  1x10'^^  M,  that  is  at  least  6  orders  of  magnitude  lower  that  any  wet  chemical 
methods  or  electrode(s)  available  in  the  commercial  market  (Figs  16-17). 

The  significance  of  the  research  is  not  only  to  develop  a  sensitive  method  for  chemical  speciation,  but  also  to 
develop  a  viable  method  to  detect  signals  between  organs  and  cells  that  are  reactions -specific,  and  a  sensor  that  can 
differentiate  the  chemical  signals  sent  from  different  cells  or  organs,  a  very  important  step  for  prosthetic  applications 
and  development. 


Figure  16.  Detection  of  ammonia  concentrations  from  10'^ to  '^M  with  a  glassy  carbon  electrode  (GCE)  that  was 
coated  with  PAMAM-Au-GDH/NADH  by  a  potentiometer  from  0.2  to  0.4  V,  species  specific  measurements  located 
(peaks)  at  about  0.01  V.  A  coating  of  PAMAM  (Dendrimer)  appears  to  enhance  performance  of  the  sensor 
compared  to  cysteamine  that  was  used  as  a  linker  for  the  electrode  and  bioenzyme. 
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Figure  17.  Similar  measurements  with  the  same  electrode  from  -1  to  1  V  that  give  the  characteristic  peaks  at 
about  0.75  V. 

Further  research  will  be  concentrating  on  sensor  stability  and  selectivity  in  a  multi -ionic  matrix. 

Comparison  of  Anchoring  Materials  of  High  Performance  Sensors  Modified  with  Nanoparticles  and  Enzymes 

We  previously  tested  the  efficacy  of  various  combinations  of  composite  materials  used  to  construct  the  high 
performance  sensors  that  were  able  to  detect  target  species  (signals)  concentrations  to  levels  below  ppb.  These 
materials  included  various  polymer  and  dendrimers  used  to  link  between  the  anchoring  electrode  and  bioenzymes, 
and  different  bioenzyme  couplings  used  for  selective  detection  of  target  species  (signals). 

We  have  been  investigating  how  the  anchoring  materials  used  to  fabricate  the  electrode  (surface)  may  affect  the 
overall  performance  of  the  sensors/electrodes,  otherwise  the  electrodes  were  all  fabricated  with  the  same  procedures 
and  materials;  the  anchoring  materials  investigated  included  Pt,  Glass  carbon,  Au,  and  Ag.  These  anchoring 
materials  are  important  because  of  the  following  factors.  1.  The  sensor/electrode  detection  is  based  on  redox 
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chemistry  and  anchoring  materials  easily  oxidized  are  expected  to  alter  the  linkage  surface.  Thus,  one  important 
parameter  to  be  ascertained  is  stability  issue  in  detection.  2.  The  anchoring  materials  must  be  able  to  bond  well  with 
the  linking  materials  (polymers  as  linker)  and  the  coupling  bioenzymes :  weak  bonding  between  the  conducting 
electrode  and  the  linker  would  weaken  the  detection  signal  thereby  rending  the  sensor  ineffective.  3.  Cost  can  be  a 
factor  if  the  electrode  is  put  into  commercial  production.  The  cost  factor  for  the  electrodes  in  descending  order  is: 
Glossy  carbon  >  Pt  >  Au  >  Ag. 

Among  the  4  tested  anchoring  materials,  as  expected  and  shown  in  Fig.  18,  Ag  gave  the  most  noise.  It  was  the  most 
unstable  because  when  the  electrode  was  used  multiple  times  (cycles),  the  electrode  characteristic  peak  deteriorated 
rather  fast  compared  to  those  of  other  materials  used  in  this  study. 
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CURVE1  (bareAg  electrode-0 1.DTA) 
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Figure  18.  Ag  bare  electrode  in  0.1  M  of  phosphate  buffer  solution,  test  runs  in  different  voltages  and  repeated  run 
of  same  voltage.  Current  signals  showed  high  signal  fluctuations  with  repeated  runs. 


Out  of  the  3  metals  used  in  the  testing  of  anchoring  materials,  Pt  was  thought  to  be  the  most  ideal  metal  due 
to  its  inertness  to  chemical  reactions.  However,  Pt  appeared  not  to  bind  with  our  linkers  well  and  thus  did  not 
provide  characteristic  signals  as  strong  as  other  metals  for  at  least  2  of  the  coupling  enzymes,  namely,  lactate 
dehydrogenase  (LDH)  and  glutamate  dehydrogenase  (GDH):  this  low  signal  was  particularly  obvious  for  the 
measurement  of  lactate  with  LDH  as  coupling  enzyme.  Despite  this  observation,  Pt  anchored  electrode  appeared  to 
be  functioning  competitively  with  the  GDH  coupling  and  corresponding  reactions  (Fig.  19).  Glassy  carbon  worked 
competitively  with  the  metal  electrodes,  but  is  the  most  expensive  among  all  electrodes  tested. 
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Figure  19.  Performance  comparison  of  Pt  and  Au  electrodes  in  similar  lactate  concentrations:  a.  Pt  electrode  coated 
with  biocomposite  materials;  b.  Au  electrode  coated  with  the  same  materials.  Note  that  characteristic  peaks  at  about 
260  mV  for  Au  electrode  are  more  distinctive,  although  Pt  electrode  also  produced  peaks  that  are  function  of  lactate 
concentrations. 


Further  and  Current  Development  of  Biosensors: 

We  have  highly  modified  our  glassy  carbon  electrode  (GCE)  with  glutamate  dehydrogenase  (GDH)  for  NH4'^ 
detection  (Fig.  20).  This  NH4'^  sensor  (GCE)  was  based  on  the  sensor  platform  that  can  be  used  for  the  detection  of 
many  chemicals  and  metabolites  that  are  generated  in  natural  environment  or  by  human  body.  When  electrodes  are 
coated/modified  with  different  biocomposite  materials,  they  can  be  grouped  together  to  form  an  array  sensor  that 
can  detect  different  chemicals  and  metabolites  simultaneously.  The  measured  current  (in  p A)  was  near  linear  with 
concentration  (in  M)  (Fig.  21).  These  ultra-high  performance  sensors  showed  that  they  could  measure 
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concentrations  down  to  5x10'^^  M,  that  are  at  least  10  orders  of  magnitude  better  than  the  current  ammonia 
electrodes  available  in  the  public  domain.  Clearly  this  innovative  and  productive  area  merits  further  research  and 
development. 
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Figure  20.  Cyclic  voltammogram  responses  of  using  highly  modified  glassy  carbon  electrode  (GCE)  with 
Glutamate  dehydrogenase  (GDH)  for  NH4‘^  detection. 

Voltammogram  outputs  of  Au  electrode  and  GCE  with  concentrations  for  ammonia  detection 


Concentration,  M 

Figure  21.  Results  of  the  same  sensor  platform  (Fig.  20)  that  was  anchored  by  different  materials  (Au  and  glassy 
carbon)  for  NH4'^  detection. 


The  biosensor  platform  thus  far  was  proven  to  be  versatile  and  can  be  used  in  many  biomedical  and 
environmental  applications.  We  continue  to  work  on  the  development  of  these  smart  sensors:  we  are  particularly 
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focusing  on  the  development  of  bionanosensors  for  tissue  engineering  and  biocompatibility  studies  and  related 
biomedical  engineering  applications  (see  Appendices  9  &13). 

B.  Investigate  the  biocompatibility  of  materials  that  are  commonly  used  to  fabricate  sensors: 

Introductory  remarks.  One  established  approach  to  investigate  the  biocompatibility  of  materials  is  to 
determine  whether  or  not  such  materials  exert  cytotoxic  effects  on  mammalian  cells  (Lai  et  al.,  2008,  2010).  Two 
nanomaterials  that  are  commonly  used  to  fabricate  nanobiosensors  are  silicon  dioxide  nanoparticles  and  titanium 
oxide  nanoparticles  (Lai  et  al.,  2008,  2010). 

Molecular  and  Signaling  Mechanisms  underlying  the  Cytotoxic  Effects  of  Metallic  Oxide  Nanoparticles. 

Nanomaterials  have  been  increasingly  used  in  industrial  applications  (e.g.,  drug  delivery,  additives  to  drugs  and 
cosmetics).  Because  of  their  wide  use,  occupational  exposure  to  nanomaterials  and  nanoparticles  may  pose  as  health 
risks.  Recent  studies  have  suggested  that  exposure  to  nanoparticles  may  induce  cytotoxic  effects  in  some 
mammalian  cell  types  (Lai  et  al.,  2010;  Puli  et  al.,  2006)  although  these  effects  have  not  been  systematically 
investigated. 

In  these  studies,  we  have  begun  to  systematically  investigate  the  molecular  and  signaling  mechanisms 
underlying  the  cytotoxic  effects  of  nanomaterials,  especially  nanoparticles,  on  human  neural  and  non -neural  cell 
types.  Here  we  report  on  some  of  the  mechanisms  responsible  for  the  cytotoxic  effects  of  silicon  dioxide  (Si02) 
nanparticles  on  human  astrocytoma  U87  cells  that  are  astrocytes-like. 
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Figure  22.  Effect  of  treatment  with  silicon  dioxide  nanoparticles  on  specific  activities  of  citrate  synthase  in  human 
astrocytoma  U87  cells.  U87  cells  were  treated  at  specified  concentrations  of  silicon  dioxide  nanoparticles  for  48 
hours.  Then  the  activities  of  citrate  synthase  in  the  homogenates  of  treated  and  untreated  (i.e.,  control,  Ctrl)  U87  cells 
were  determined  as  described  in  Materials  and  Methods;  the  activities  of  citrate  synthase  were  expressed  per  mg  of 
homogenate  protein  as  specific  activities.  The  specific  activities  values  were  the  mean  ±  SEM  of  at  least  three 
separate  experiments;  Ctrl  represented  the  value  in  untreated  U87  cell  homogenate;  *p  <  0.05  versus  that  of  control 
cells. 


Because  cell  survival  critically  depends  on  mitochondrial  functions  maintained  at  a  normal  physiological 
level,  we  determined  the  effect  of  Si02  nanoparticles  on  mitochondrial  function  in  U87  cells  by  monitoring  the 
activities  of  one  key  enzymes  of  the  tricarboxylic  acid  (TCA)  cycle  namely,  citrate  synthase  (CS).  As  shown  in 
Figure  22,  at  treatment  concentrations  of  25-100  pg/mL  for  48  hours,  Si02  nanoparticles  induced  dose-related 
increases  in  CS  activities  in  U87  cells. 
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Treatment  of  U87  cells  with  Si02  nanoparticles  could  also  lower  the  survival  of  U87  cells  through  altering 
cell  signaling  pathway(s)  that  regulate(s)  cell  survival  and  proliferation  (7).  We  therefore  investigated  this  possibility 
by  examining  the  effect  of  these  nanoparticles  on  expression  of  ERK  and  phospho-ERK  proteins.  We  observed  that 
when  U87  cells  were  treated  with  1-50  pg/mL  of  Si02  nanoparticles  for  48  hours,  their  protein  expression  of 
phospho-ERK  showed  a  dose-related  decrease  while  that  of  ERK  protein  remained  essentially  unchanged  (Eig.  23), 
suggesting  that  a  lowering  of  this  cell  survival/proliferation  signaling  mechanism  could,  at  least  in  part,  account  for 
the  dose-related  decrease  in  U87  cell  survival  induced  by  these  nanoparticles. 

The  results  of  our  ongoing  studies  on  the  molecular  and  signaling  mechanisms  underlying  the  cytotoxic 
effects  of  silicon  dioxide  (Si02)  nanparticles  indicate  that  alterations  of  mitochondrial  bioenergetics  and  cell  survival 
signaling  underly  the  cytotoxic  effects  of  these  nanoparticles.  Moreover,  they  suggest  there  may  be  other  such 
mechanisms  present.  We  are  therefore  continuing  to  pursue  this  interesting  line  of  investigation. 

Si02  nano  (^g/ml) 

C  1  10  50 

£rk: 


p-£rk: 


p-actin 


Eigure  23.  Effect  of  treatment  with  silicon  dioxide  nanoparticles  on  expression  of  ERK  and  phosphor-ERK  in  human 
astrocytoma  U87  cells.  U87  cells  were  treated  at  specified  concentrations  of  silicon  dioxide  nanoparticles  for  48 
hours.  Then  cell  lysates  of  treated  and  untreated  (i.e.,  control)  U87  cells  were  prepared  as  described  in  Materials  and 
Methods.  The  expression  of  ERK  and  phosphor-ERK  (p-ERK)  was  determined  by  Western  blot  analysis  using  p- 
actin  as  the  loading  control:  Lane  marked  C,  lysate  of  untreated  or  control  U87  cells;  lane  marked  1,  lysate  of  U87 
cells  treated  with  silicon  dioxide  nanoparticles  at  1  pg/ml;  lane  marked  10,  lysate  of  U87  cells  treated  with  silicon 
dioxide  nanoparticles  at  10  pg/ml;  lane  marked  50,  lysate  of  U87  cells  treated  with  silicon  dioxide  nanoparticles  at 
50  pg/ml.  The  blots  were  from  a  typical  experiment.  Two  other  experiments  yielded  essential  the  same  trend  of 
results. 
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Figure  24.  Effect  of  treatment  with  silicon  dioxide  nanoparticles  on  specific  activities  of  citrate  synthase  in  human 
astrocytoma  U87  cells.  U87  cells  were  treated  at  specified  concentrations  of  silicon  dioxide  nanoparticles  for  48 
hours.  Then  the  activities  of  malate  dehydrogenase  in  the  homogenates  of  treated  and  untreated  (i.e.,  control,  Ctrl) 
U87  cells  were  determined  as  described  in  Materials  and  Methods;  the  activities  of  malate  dehydrogenase  were 
expressed  per  mg  of  homogenate  protein  as  specific  activities.  The  specific  activities  values  were  the  mean  ±  SEM 
of  at  least  three  separate  experiments;  Ctrl  represented  the  value  in  untreated  U87  cell  homogenate;  *p  <  0.05  versus 
that  of  control  cells. 


Because  cell  survival  critically  depends  on  mitochondrial  functions  maintained  at  a  normal  physiological 
level,  we  determined  the  effect  of  Si02  nanoparticles  on  mitochondrial  function  in  U87  cells  by  monitoring  the 
activities  of  one  key  enzymes  of  the  TCA  cycle  namely,  malate  dehydrogenase  (MDH).  As  shown  in  Figure  24,  at 
treatment  concentrations  of  25-100  pg/mL  for  48  hours,  Si02  nanoparticles  induced  dose-related  increases  in  MDH 
activities  in  U87  cells. 
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Figure  25.  Effect  of  treatment  with  silicon  dioxide  nanoparticles  on  expression  of  cytochrome  oxidase  subunit  II  in 
human  astrocytoma  U87  cells.  U87  cells  were  treated  at  specified  concentrations  of  silicon  dioxide  nanoparticles  for 
48  hours.  Then  cell  lysates  of  treated  and  untreated  (i.e.,  control)  U87  cells  were  prepared  as  described  in  Materials 
and  Methods.  The  expression  of  cytochrome  oxidase  subunit  II,  encoded  by  mitochondrial  DNA,  was  determined  by 
Western  blot  analysis  using  p-actin  as  the  loading  control:  Lane  1,  lysate  of  untreated  or  control  U87  cells;  lane  2, 
lysate  of  U87  cells  treated  with  silicon  dioxide  nanoparticles  at  25  pg/ml;  lane  3  lysate  of  U87  cells  treated  with 
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silicon  dioxide  nanoparticles  at  50  pg/ml;  lane  4,  lysate  of  U87  cells  treated  with  silicon  dioxide  nanoparticles  at  100 
pg/ml.  The  blots  were  from  a  typical  experiment.  Two  other  experiments  yielded  essential  the  same  trend  of  results. 
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Figure  26.  Effect  of  treatment  with  silicon  dioxide  nanoparticles  on  expression  of  NADH  dehydrogenase  subunit  6 
(ND-6)  in  human  astrocytoma  U87  cells.  U87  cells  were  treated  at  specified  concentrations  of  silicon  dioxide 
nanoparticles  for  48  hours.  Then  cell  lysates  of  treated  and  untreated  (i.e.,  control)  U87  cells  were  prepared  as 
described  in  Materials  and  Methods.  The  expression  of  NADH  dehydrogenase  subunit  6  (ND-6),  encoded  by 
mitochondrial  DNA,  was  determined  by  Western  blot  analysis  using  p-actin  as  the  loading  control:  Lane  1,  lysate  of 
untreated  or  control  U87  cells;  lane  2,  lysate  of  U87  cells  treated  with  silicon  dioxide  nanoparticles  at  25  pg/ml;  lane 
3  lysate  of  U87  cells  treated  with  silicon  dioxide  nanoparticles  at  50  pg/ml;  lane  4,  lysate  of  U87  cells  treated  with 
silicon  dioxide  nanoparticles  at  100  pg/ml.  The  blots  were  from  a  typical  experiment.  Two  other  experiments 
yielded  essential  the  same  trend  of  results. 


On  the  other  hand,  at  treatment  concentrations  of  25-100  pg/mL  for  48  hours,  Si02  nanoparticles  induced 
dose-related  decreases  in  the  expression  of  cytochrome  C  oxidase  subunit  II  (a  mitochondrial  DNA-encoded 
peptide)  in  U87  cells  (Fig.  25).  These  results  strongly  suggested  treatment  with  Si02  nanoparticles  altered  the 
normal  functioning  of  the  mitochondrial  genome  in  U87  cells. 


At  treatment  concentrations  of  25-100  pg/mL  for  48  hours,  Si02  nanoparticles  induced  dose-related 
decreases  in  the  expression  of  NADH  dehydrogenase  subunit  6  (ND  6)  (a  mitochondrial  DNA-encoded  peptide)  in 
U87  cells  (Fig.  26).  These  results  strongly  suggested  treatment  with  Si02  nanoparticles  altered  the  normal 
functioning  of  the  mitochondrial  genome  in  U87  cells.  A  likely  consequence  of  this  effect  of  the  nanoparticles  is  the 
impairment  in  the  electron  transport  chain  of  the  mitochondria  in  U87  cells:  indeed,  the  nanoparticle-induced 
disruption  of  mitochondrial  respiratory  chain  structure  and  function  may  be  one  cause  of  energy  failure  that 
ultimately  led  to  the  death  of  U87  cells. 

Taken  together,  the  results  of  our  ongoing  studies  on  the  molecular  mechanisms  underlying  the  cytotoxic 
effects  of  silicon  dioxide  (Si02)  nanparticles  indicate  that  alterations  of  mitochondrial  bioenergetics  underlying  the 
cytotoxic  effects  of  these  nanoparticles.  Moreover,  they  suggest  there  may  be  other  such  mechanisms  present. 
Consequently,  we  are  continuing  to  pursue  this  interesting  line  of  investigation. 


Our  previous  and  ongoing  studies  have  demonstrated  that  nanoparticles  of  metallic  and  non-metallic  oxides 
exert  differential  cytotoxic  effects  in  neural  cells  derived  from  the  central  nervous  system.  Nonetheless,  as  the 
putative  toxic  effects  of  such  nanoparticles  in  neural  cells  derived  from  the  peripheral  nervous  system  (PNS)  are 
largely  unknown,  we  have  initiated  studies  to  systematically  investigate  the  putative  cytotoxicity  of  nanoparticles  of 
metallic  and  non-metallic  oxides  in  neural  cells  derived  from  the  PNS  (see  Appendices  19,  21-23,  27,  28).  Here  we 
report  on  some  of  the  mechanisms  responsible  for  the  cytotoxic  effects  of  silicon  dioxide  (Si02)  nanparticles  on 
Schwann  cells  and  dorsal  root  ganglion  (DRG)  neurons. 
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Figure  27.  Effects  of  Si02  nanoparticles  on  DRG  neurons  and  Schwann  cells.  Values  are  mean  ±  SEM  of  12 
determinations  and  replicate  experiments  show  the  same  trend.  DRG  neurons  and  Schwann  cells  treated  with  Si02 
nanoparticles  for  36  hours  are  marked  red  and  blue,  respectively. 


Treatment  of  Schwann  cells  (R3)  with  Si02  nanoparticles  induced  a  dose-related  decrease  in  their  survival 
when  we  progressively  increased  the  concentrations  of  the  nanopartcles  from  1  to  200  pM.  The  IC50  for  Si02 
nanoparticles  in  lowering  the  survival  of  Schwann  cells  (R3)  was  -150  pM  and  at  the  highest  concentration 
employed,  only  -40%  of  the  cells  survived  (Fig.  27). 

When  we  exposed  dorsal  root  ganglion  (DRG)  neurons  to  Si02  nanoparticles,  we  did  not  detect  significant 
decreases  in  their  survival  at  lower  treatment  concentrations  (0.1-150  pg/ml)  but  their  survival  was  significantly 
decreased  only  at  the  highest  concentration  employed  (i.e.,  200  pg/ml;  Fig.  27).  Moreover,  DRG  neurons  did  not 
appear  to  internalize  Si02  nanoparticles  in  large  amounts  (data  not  shown).  Nevertheless,  the  DRG  neurons  treated 
with  the  nanoparticles  did  show  some  cytoplasmic  swelling  (data  not  shown). 
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Figure  28.  Uptake  of  silicon  dioxide  nanoparticles  as  determined  by  flow  cytometry. 
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Cellular  upatake  of  Si02  nanoparticles  were  studied  using  FACSCaliburTM  flow  cytometer  and  dark  field 
microscopy.  The  side  scatters  increase  and  forward  scatters  decrease  sequentially,  presumably  due  to  substantial 
light  reflection  by  the  internalization  of  nanoparticles  particles.  Schwann  cell  showed  internalization  of  Si02 
nanoparticles  in  a  dose-related  manner  (Figs.  28-29). 

Nanoparticles  gradually  sediments  onto  Schwann  cells  and  Schwann  cells  appeared  to  internalize  them. 
Once  the  nanoparticles  entered  a  cell,  they  showed  a  tendency  to  aggregate  around  the  nucleus  (data  not  shown). 
However,  the  nanoparticles  did  not  appear  to  penetrate  into  the  nucleus;  rather,  at  higher  treatment  concentrations, 
the  nuclei  appeared  to  be  swollen  and  their  morphology  changed.  At  higher  treatment  concentrations,  the  cell  bodies 
of  the  Schwann  cells  appeared  to  be  much  more  oval,  presumably  due  to  swelling:  this  altered  morphology  was 
distinctly  different  from  the  spindle-shaped  cell  bodies  of  untreated  (i.e.,  control)  Schwann  cells  (data  not  shown). 
Thus,  in  general,  the  photomicrographs  revealed  that  treatment  with  the  nanparticles  induced  dose-related  changes  in 
cellular  morphology,  a  finding  that  appeared  to  correlate  with  the  nanoparticle -induced,  dose-related  progressive 
decrease  in  cell  survival  of  the  treated  cells. 


Figure  30.  Effect  of  Si02  nanoparticles  on  inducing  lactate  dehydrogenase  (LDH)  release  from  Schwann  cells. 
*  Values  are  significantly  different  from  that  in  control  (i.e.,  untreated)  cells:  p<0.05. 


One  of  the  mechanisms  of  cell  death  induced  by  nanoparticles  was  found  to  be  necrosis  as  evident  from  the 
lactate  dehydrogenase  (LDH,  a  marker  of  cytoplasmic  material)  release  from  cells.  The  treatment  of  Schwann  cells 
with  silicon  dioxide  nanoparticles  at  concentrations  higher  than  50  pg/ml  induced  them  to  significantly  release  LDH 
into  the  surrounding  medium,  suggesting  that  the  nanoparticles  induced  necrotic  cell  damage  and  death  (Fig.  30). 

As  shown  in  Fig.  30  above,  one  of  the  mechanisms  of  cell  death  induced  by  nanoparticles  was  found  to  be 
necrosis  as  evident  from  the  LDH  release  from  cells.  One  possible  mechanism  that  contributed  to  the  necrotic 
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damage  and  cell  death  induced  by  silicon  dioxide  nanoparticles  might  be  that  of  induction  of  oxidative  stress.  We 
investigated  this  possibility  by  examining  the  effect  of  these  nanoparticles  on  the  reduced  glutathione  (GSH)  content 
of  Schwann  cells  (Fig.  31). 


SiO^  naoparticles  (pg/ml) 

Figure  31.  Effect  of  silicon  dioxide  nanoparticles  on  GSH  content  in  Schwann  cells.  Results  are  mean  ±  SEM  of 
three  separate  experiments;  *p<0.05  compared  with  control  values. 


As  shown  in  Fig.  31,  treatment  of  Schwann  cells  with  silicon  dioxide  nanoparticles  induced  concentration - 
related  decreases  in  cellular  GSH  content,  suggesting  the  nanoparticles  induced  oxidative  stress  in  these  cells. 

We  have  also  investigated  the  hypothesis  that  magnesium  oxide  (MgO)  nanoparticles  elicit  inflammatory 
responses  in  Schwann  cells. 

MgO  nanoparticles  induced  dose-related  decreases  in  survival  of  Schwann  cells  when  they  were  exposed  to 
MgO  nanoparticles  for  24  hours  (Fig.  32).  The  IC50  of  MgO  nanoparticles  in  lowering  the  survival  of  Schwann  cell 
was  -  100  pg/ml  (Fig.  32).  That  initial  observation  prompted  us  to  monitor  the  effects  of  MgO  nanoparticles  on  the 
morphology  of  Schwann  cells. 

We  found  that  as  the  concentration  of  MgO  nanoparticles  was  increased,  more  and  more  morphological 
differences  between  the  treated  and  untreated  (i.e.,  control)  Schwann  cells  were  noted  (data  not  shown).  When  the 
Schwann  cells  were  treated  with  the  lower  levels  of  the  nanoparticles  (i.e.,  0.1-5  pg/ml),  the  polarity  of  the  cells 
were  more  pronounced  and  they  appeared  to  send  out  more  processes.  Additionally,  at  the  higher  treatment  levels 
(i.e.,  5-100  pg/ml),  the  nanoparticles  induced  the  cells  to  swell  and  round  off,  suggesting  that  those  cells  were 
possibly  undergoing  necrosis. 
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Figure  32.  Survival  of  R3  Schwann  cells  exposed  to  MgO  nanoparticles  for  24  hours  (*;7<0.05  versus  control,  as 
determined  by  ANOVA  with  post-hoc  Tukey  test). 


Morphological  changes  induced  by  MgO  nanoparticles  led  us  to  investigate  the  possibility  of  an 
inflammatory  response  elicited  by  the  Schwann  cells.  Inflammatory  response  is  a  protective  mechanism  that  most 
cells  exhibit  towards  an  obnoxious  stimulus.  We  therefore  examined  the  expression  of  inflammatory  markers  such 
as  interleukin-6  (IL-6)  and  peroxisome -proliferator  activator  receptor  y  (PPARy).  11-6  is  a  proinflammatory  cytokine 
that  protects  the  cells  by  eliciting  immune  response  and  regulating  the  transcription  of  anti-apoptotic  genes.  On  the 
other  hand,  PPARy  is  a  member  of  nuclear  receptor  super-  family  important  in  regulating  many  genes  relating  to 
glucose  metabolism;  it  has  also  been  shown  to  have  anti-inflammatory  actions  by  regulating  cytokine  expression. 

Our  western  blot  analysis  shows  Schwann  cells  treated  with  MgO  nanoparticles  for  24  hours  exhibited 
increased  expression  of  both  of  the  markers  (data  not  shown).  However,  the  simultaneous  increase  in  expression  of 
both  pro-inflammatory  and  anti-inflammatory  markers  in  the  treated  cells  is  intriguing.  This  observation  prompted 
us  to  further  examine  the  expression  of  these  markers  in  Schwann  cells  after  exposing  them  to  the  nanoparticles  for 
48  hours.  The  cells  so  treated  did  not  show  any  difference  in  expression  of  IL-6  and  PPARy  compared  to  those  in 
respective  control  cells  (data  not  shown),  suggesting  that  the  anti-inflammatory  effect  of  PPARy  might  have 
counter-balanced  the  effects  of  IL-6.  Thus,  our  results  may  have  some  pathophysiological  implications  in  the 
impact  of  exposure  to  MgO  nanoparticles  on  the  structure  and  function  of  the  peripheral  nervous  system.  Our  on¬ 
going  and  future  studies  aim  to  further  elucidate  the  mechanism(s)  underlying  the  cytotoxicity  and  inflammatory 
effects  of  MgO  nanoparticles  in  Schwann  cells. 


All  in  all,  the  results  of  our  recent  and  ongoing  studies  strongly  suggest  that  nanoparticles  may  exert 
differential  cytotoxic  effects  on  neural  cell  types  of  the  peripheral  nervous  system.  As  such,  our  results  may  assume 
pathophysiological  importance  in  the  environmental  health  impact  of  nanoparticles.  Obviously,  this  is  an  important 
area  that  deserves  further  study. 
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KEY  RESEARCH  ACCOMPLISHMENTS 


Goal  1:  EMG  Signals  and  System  Identification 

1.  Topical  contribution: 

•  Development  of  Bayesian  filtering  techniques  for  post  processing  of  sEMG  signals. 

•  Utilization  of  system  identification  algorithms  for  extracting  sEMG  signal  -  finger  force  models,  as  well  as 
sEMG  signal  -  finger  motion  models. 

•  Development  of  novel  intelligent  estimation  algorithms  using  Genetic  Algorithms,  Particle  Swarm,  and 
Tabu  Search  methods. 

•  Development  of  spatial  filtering  techniques  for  use  with  array  sEMG  sensors. 

•  Zone  classification  of  amputees  based  on  anatomy  for  finger  force  and  finger  motion  modeling. 

•  Development  of  novel  adaptive  model  fusion  algorithms. 

•  Spectral  analysis  of  sEMG  signals  for  characterizing  skeletal  muscle  fatigue. 

•  Developed  linear  and  none-linear  dynamic  model  fusion  algorithms. 

2.  Student  production: 

•  Graduated  two  PhD  students 

•  Graduated  three  MS  students 

•  Supported  one  additional  PhD  and  one  MS  student 
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Goal  2 A:  Intelligent  Control 


•  Kinematics,  dynamics  and  control  of  prosthetic  hand  with  22  degrees  of  freedom  (DOFs)  were  conducted. 

•  A  control  technique  of  finite-time  linear  quadratic  optimal  control  for  14DOFs,  five-fingered  smart 
prosthetic  hand  was  developed  in  MATLAB  Simulink  with  different  reference  inputs,  including  constant, 
ramp,  sinusoidal  values. 

•  Fusion  of  control  strategies  for  14  DOFs,  five-fingered  smart  prosthetic  hand  was  simulated  to  grasp  an 
object  in  3  dimensional  animations. 

•  A  comprehensive  literature  updated  on  the  topic  of  control  techniques  for  prosthetic  hands  was  conducted 
and  one  book  chapter  was  published. 

•  Hard  control  techniques  such  as  feedback  linearization,  proportional -derivative  (PD),  proportional-integral- 
derivative  (PID),  optimal  and  adaptive  were  developed  for  the  14  DOFs,  five-fingered  smart  prosthetic 
hand. 

•  Soft  computing  techniques  such  as  neural  networks  (NN),  fuzzy  logic  (FL),  adaptive  neural -fuzzy  inference 
system  (ANFIS),  and  genetic  algorithm  (GA)  were  investigated. 

•  The  fusion  of  hard  and  soft  control  techniques,  such  as  FL-i-PD  and  GA-i-PID,  was  developed  for  the  five¬ 
fingered  smart  prosthetic  hand. 


Goal  2AB:  Real-Time  Control 

•  Development  of  new  methods  for  power  grasping  and  precision  grasping  for  fully  actuated  hands 

•  Design,  Optimization  and  Control  of  under-actuated  prosthetic  hand 

•  Robust  Controller  Design  for  Command  Following  Controller 

Goal  2B:  Embedded  Hierarchical  Real-Time  Systems 


•  The  construction  of  a  test  bed  that  integrates  the  software  tool  chain  and  prototype  hardware 

•  The  study  and  experimental  set  up  of  a  real-time  operating  system  on  the  embedded  processor 

•  Implementation  and  various  control  strategies  and  test  their  performance  and  loading  on  the  microcontroller 

•  Real-time  acquisition  and  processing  of  sEMG  and  sEMG-based  algorithms  on  the  microcontroller 
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Goal  3:  Robotic  Hand 


•  Manufacturing  and  testing  of  Hand  1  Prototype  II,  basically  a  testing  device. 

•  Design  of  Hand  2  Prototype  I,  a  remotely-actuated  prosthetic  hand. 

•  Manufacturing  of  Hand  2  Prototype  I. 

•  Application  of  the  general  kinematic  synthesis  algorithm  for  the  design  of  articulated  systems  for 
finger  and  thumb  motion. 

•  Development  of  a  complete  design  methodology  for  articulated  systems  to  be  used  for  the  design 
of  hand  motion,  including  data  capture,  kinematic  synthesis,  optimization  of  solutions  and 
prototyping. 

•  Refinement  of  the  process  for  the  camera-based  data  acquisition  system,  to  recover  finger  pose 
from  a  single  camera.  Conclusions  regarding  vision-based  precision  data  capture. 
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Goal  4:  Biocompatibility  and  Signaling 

•  Development  of  a  co-culture  model  for  biocompatibility  and  other  tissue  engineering  studies  and 
applications 

•  Development  of  cell  models  of  peripheral  nervous  system  neural  cells  consisting  of  dorsal  root 
ganglion  neurons  and  Schwann  cells  for  biocompatibility  and  other  tissue  engineering  studies  and 
applications 

•  Characterization  of  cell  models  consisting  of  dorsal  root  ganglion  neurons  and  Schwann  cells 

•  Development  of  “smart”  biosensors  for  tissue  engineering  and  biocompatibility  studies  and 
applications 

•  Characterization  of  cytotoxicity  of  silicon  dioxide  nanoparticles  in  human  neural  and  non -neural  cells 

•  Elucidation  of  cell  death  mechanisms  underlying  cytotoxic  effects  induced  by  silicon  dioxide  and 
magnesium  oxide  nanoparticles  in  human  astrocytoma  U87  (astrocytes-like)  cells,  Schwann  cells,  and 
dorsal  root  ganglion  (DRG)  neurons 

•  Initiation  of  a  systematic  examination  of  putative  cytotoxicity  of  metallic  oxide  nanoparticles 
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REPORTABLE  OUTCOMES 


A.  PUBLICATIONS: 

Goal  1:  EMG  Signal  Identification 

Peer  Reviewed  Journal  Publications 


1.  Anish  Sebastian,  Parmod  Kumar,  Marco  P.  Schoen,  ‘"Modeling  surface  electromyogram  dynamics  using 
Hammerstein-Wiener  models  with  comparison  of  HR  and  spatial  filtering  techniques  f  International  Journal  of 
Circuits,  Systems  and  Signal  Processing,  VoL  5(5),  pp.  545  -  556,  2011. 

2.  Anish  Sebastian,  Parmod  Kumar,  Marco  P.  Schoen,  “Spatial  filter  masks  optimization  using  genetic  algorithm 
and  modeling  dynamic  behavior  of  sEMG  and  finger  force  signals  f  International  Journal  of  Circuits,  Systems 
and  Signal  Processing  VoL  5(6),  pp.  597  -  608,  2011. 

3.  J.  Rafiee,  M.A.  Rafiee,  N.  Prause,  and  M.  P.  Schoen,  “Wavelet  basis  functions  in  biomedical  signal 
processing,''  International  Journal  of  Expert  Systems  with  Applications,  Vol.  38(5)  pp.  6190-6201,  May  2011. 

4.  J.  Rafiee,  M.A.  Rafiee,  F.  Yavari,  and  M.  P.  Schoen,  “Feature  extraction  of  forearm  EMG  signals  for 
prosthetics,"  International  Journal  of  Expert  Systems  with  Applications,  Vol.  38(4)  pp.  4058-4067,  April  2011. 

5.  Parmod  Kumar,  Chandrasekhar  Potluri,  Anish  Sebastian,  Steve  Chiu,  Alex  Urfer,  D.  Subbaram  Naidu,  Marco  P. 
Schoen,  “Adaptive  Multi  Sensor  Based  Nonlinear  Identification  of  Skeletal  Muscle  Force,"  WSEAS 
Transactions  on  Systems,  Vol.  10(9),  pp.  1050-1062,  October  2010. 

Peer  Reviewed  Conference  Proceedings: 

6.  Chandrasekhar  Potluri,  Madhavi  Anugolu,  Steve  Chiu,  Alex  Urfer,  Marco  P.  Schoen,  D.  Subbaram  Naidu, 
“Fusion  of  Spectral  Models  for  Dynamic  Modeling  of  sEMG  and  Skeletal  Muscle  Force,  ”  Proceedings  of  the 
34*  Annual  International  Conference  of  the  IEEE  Engineering  in  Medicine  &  biology  Society,  San  Diego, 
August  28-September  1,  2012. 

7.  Chandrasekhar  Potluri,  Madhavi  Anugolu,  Steve  Chiu,  Marco  P.  Schoen,  D.  Subbaram  Naidu,  “A  sEMG  based 
Real-time  Adaptive  Joint  angle  Estimation  and  Control  for  a  Prosthetic  Hand  Prototype,  ”  Proceedings  of  the 
12*  WSEAS  International  Conference  on  Systems  Theory  and  Scientific  Computation  (ISTASC  ’12),  Istanbul, 
Turkey,  August  21-23,  2012. 

8.  Madhavi  Anugolu,  Chandrasekhar  Potluri,  Steve  Chiu,  Member  ,  Alex  Urfer,  Jim  Creelman  and  Marco  P. 
Schoen,  “A  sEMG-skeletal  muscle  force  data  fusion  based  on  minimum  description  length  criterion" 
Proceedings  of  the  2012  ICIA  World  Conference,  Las  Vegas,  July  16-19,  2012. 

9.  M.  Anugolu,  C.  Potluri,  P.  Kumar,  M.  P.  Schoen,  “Genetic  Algorithm  Based  Optimization  ofKullback 
Information  Criterion:  Improved  System  Identification  of  Skeletal  Muscle  Force  and  sEMG  Signals,  ” 
Proceedings  of  the  2012  IEEE  International  Instrumentation  and  Measurement  Technology  Conference,  Graz, 
Austria,  May  2012. 

10.  Alex  Urfer,  Jim  Creelman,  Parmod  Kumar,  Anish  Sebastion,  Madhavi  Anugolu,  and  Marco  Schoen,  “The 
Development  of  a  Functional  Amputation  Residuum  Measurement  of  the  Upper  Extremity  for  Potential 
Myoelectric  Prosthesis  Use,"  Combined  Sections  meeting  of  the  American  Physical  Therapy  Association, 
Chicago,  Eebruary  8-11,  2012. 
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11.  C.  Potluri,  M.  Anugolu,  Y.  Yihun,  A.  Jensen,  S.  Chiu,  M.  P.  Schoen,  D.  S.  Naidu,  “Optimal  Tracking  of  a 
sEMG  based  Force  Model  for  a  Prosthetic  Hand,''  Proceedings  of  the  33rd  Annual  International  IEEE  EMBS 
Conference,  Boston,  MA,  August  30-  September  3,  2011. 

12.  M.  Anugolu,  C.  Potluri,  A.  Ilyas,  P.  Kumar,  S.  Chiu,  N.  Devine,  A.  Urfer,  M.  P.  Schoen,  “A  Review  on  Sensory 
Feedback  for  sEMG  Based  Prosthetic  Hands,"  Proceedings  of  the  International  Conference  on  Artificail 
Intelligence,  ICAFll,  Las  Vegas,  NV,  July  18-21,  2011. 

13.  Alexander  Urfer,  Jim  Creelman,  Parmod  Kumar,  Anish  Sebastian,  Madhavi  Anugolu,  and  Marco  P.  Schoen, 
“The  Development  of  a  Functional  Amputation  Residuum  Measurement  of  the  Upper  Extremity  for  Potential 
Myoelectric  Prosthesis  Use,"  submitted  for  review,  APTA- American  Physical  Therapy  Association's  CSM 
2012,  Tampa  PL,  Pebruary  2  -  13,  2012. 

14.  Parmod  Kumar,  Anish  Sebastian,  Chandrasekhar  Potluri,  Adnan  Ilyas,  Madhavi  Anugolu,  Alex  Urfer,  Marco  P. 
Schoen,  “Adaptive  Finger  Angle  Estimation  from  sEMG  Data  with  Multiple  Linear  and  Nonlinear  Model  Data 
Fusion,"  Proceedings  of  the  WSEAS  10*  International  Conference  on  Dynamical  Systems  and  Control,  Iasi, 
Rumania,  pp.  154  -  159,  July  1  -3,  2011. 

15.  Anish  Sebastian,  Parmod  Kumar,  Marco  P.  Schoen,  “Optimized  Spacial  Filter  Mask  using  Genetic  Algorithm 
and  System  Identification  for  Modeling  sEMG  and  Finger  Force  Signals,"  Proceedings  of  the  WSEAS  10* 
International  Conference  on  Dynamical  Systems  and  Control,  Iasi,  Rumania,  pp.  136  -  141,  July  1  -3,  2011. 

16.  Anish  Sebastian,  Parmod  Kumar,  Marco  P.  Schoen,  “Evaluation  of  Filtering  Techniques  applied  to  surface 
EMG  data  and  Comparison  based  on  Hammer stein-Wiener  Models,"  Proceedings  of  the  WSEAS  10* 
International  Conference  on  Dynamical  Systems  and  Control,  Iasi,  Rumania,  pp.  130  -  135,  July  1  -3,  2011. 

17.  P.  Kumar,  C.  Potluri,  A.  Sebastian,  Y.  Yihun,  A.  Ilyas,  M.  Anugolu,  R.  Sharma,  S.  Chiu,  J.  Creelman,  A.  Urfer, 
D.S.  Naidu,  and  M.  P.  Schoen,  “A  Hybrid  Adaptive  Multi  Sensor  Data  Fusion  for  Estimation  of  Skeletal  Muscle 
Force  for  Prostethic  Hand  Control,"  International  Conference  on  Artificail  Intelligence,  ICAI’l  1,  Las  Vegas, 
NV,  July  18-21,2011. 

18.  P.  Kumar,  A.  Sebastian,  J.  Creelman,  A.  Urfer,  and  M.  P.  Schoen,  “Spectral  Analysis  of  sEMG  Signals  to 
Investigate  Skeletal  Muscle  Fatigue,"  Proceedings  of  the  50*  IEEE  Conference  on  Decision  and  Control  and 
European  Control  Conference,  Orlando  PL,  December  12-15,  2011. 

19.  C.  Potluri,  Y.  Yihun,  M.  Anugolu,  P.  Kumar,  M.  Anugolu,  S.  Chiu,  M.P.  Schoen,  D.S.  Naidu,  “Implementation 
of  sEMG-Based  Real-Time  Embedded  Adaptive  Finger  Force  Control  for  Prosthetic  Hand,"  Proceedings  of  the 
50*  IEEE  Conference  on  Decision  and  Control  and  European  Control  Conference,  Orlando  PL,  December  12- 
15,2011. 

20.  P.  Kumar,  A.  Sebastian,  M.  Anugolu,  C.  Potluri,  A.  Passih,  Y.  Yihun,  A.  Jensen,  Y.  Tang,  C.-H.  Chen,  S.  Chiu, 
K.  Bosworth,  D.S.  Naidu,  J.  Creelman,  A.  Urfer,  and  Marco  P.  Schoen,  “An  Adaptive  Hybrid  Data  Fusion 
Based  Identification  of  Skeletal  Muscle  Force  with  ANFIS  and  Smoothing  Spline  Curve  Fitting,"  Proceedings  of 
the  2011  IEEE  International  Conference  on  Puzzy  Systems,  Taipei,  Taiwan,  June  27-30,  2011. 

21.  Parmod  Kumar,  Chandrasekhar  Potluri,  Madhavi  Anugolu,  Anish  Sebastian,  Steve  Chiu,  Alex  Urfer,  D. 
Subbaram  Naidu,  Marco  P.  Schoen,  “An  Hybrid  Adaptive  Data  Fusion  with  Linear  and  Nonlinear  Models  for 
Skeletal  Muscle  Force  Estimation,"  Proceedings  of  the  IEEE  5th  Cairo  International  Conference  on  Biomedical 
Engineering  (CIBEC),  Cairo,  Egypt,  December  16-18,  2010. 

22.  Parmod  Kumar,  Chandrasekhar  Potluri,  Anish  Sebastian,  Steve  Chiu,  Alex  Urfer,  D.  Subbaram  Naidu,  Marco  P. 
Schoen,  “An  Adaptive  Multi  Sensor  Data  Fusion  with  Hybrid  Nonlinear  ARX  and  Wiener-Hammerstein  Models 
for  Skeletal  Muscle  Force  Estimation,"  Proceedings  of  the  WSEAS  Systems  Conference,  pp.  186  -  191,  July 
22-24,  2010,  Corfu,  Greece. 
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23.  Anish  Sebastian,  Parmod  Kumar,  Marco  P.  Schoen,  “A  Study  on  Hubridization  of  Particle  Swarm  and  Tabu 
Search  Algorithms  for  unconstrained  Optimization  and  Estimation  Problems,''  Proceedings  of  the  WSEAS 
Systems  Conference,  pp.  458  -463,  July  22-24,  2010,  Corfu,  Greece. 

24.  Parmod  Kumar,  Nikesh  Joshi,  Chandrasekhar  Potluri,  Jensen  Alex,  Marco  P.  Schoen,  Steve  Chiu,  ''Genetic 
Algorithm  Running  Time  Optimization  Using  OpenMP  Parallel  Computing,"  Proceedings  of  The  2010  World 
Congress  in  Computer  Science  Computer  Engineering  and  Applied  Computing  Conference,  Las  Vegas,  NV, 
July  12-15,  2010. 

25.  Anish  Sebastian,  Parmod  Kumar,  Marco  P.  Schoen,  Alex  Urfer,  Jim  Creelman,  and  D.  Subbaram  Naidu, 
"Analysis  ofEMG-Force  Relation  Using  System  identification  and  Hammer stein-Wiener  Models,"  Proceedings 
of  the  Dynamic  Systems  and  Control  Conference  (DSCC),  Boston,  MA,  September  2010. 

26.  Parmod  Kumar,  Anish  Sebastian,  Chandrasekhar  Polturi,  Alex  Urfer,  D.  Subbaram  Naidu,  Marco  P.  Schoen, 
"Towards  Smart  Prosthetic  Hand:  Adaptive  Probability  Based  Skeletal  Muscle  Eatigue  Model, "  Proceedings  of 
the  32”^  Annual  International  Conference  of  the  IEEE  Engineering  in  Medicine  and  Biology  Society,  Buenos 
Aires,  Argentina,  August  31 -September  2010. 

27.  Chandrasekhar  Potluri,  Parmod  Kumar,  Madhavi  Anugolu,  Alex  Urfer,  D.  Subbaram  Naidu,  Marco  P.  Schoen, 
"Frequency  Domain  Surface  EMG  Sensor  Fusion  for  Estimating  Finger  Forces,"  Proceedings  of  the  32”^ 
Annual  International  Conference  of  the  IEEE  Engineering  in  Medicine  and  Biology  Society,  Buenos  Aires, 
Argentina,  August  31 -September  2010. 

28.  Chandrasekhar  Potluri,  Parmod  Kumar,  Madhavi  Anugolu,  Alex  Urfer,  Marco  P.  Schoen,  D.  Subbaram  Naidu, 
"sEMG  Based  Fuzzy  Control  Strategy  with  ANFIS  Path  Planning  for  Prosthetic  Hand, "  Proceedings  of  the  3^^ 
IEEE  International  Conference  on  Biomedical  Robotics  and  Biomechatronics,  Tokyo,  Japan,  September  26-30, 
2010. 
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Goal  2 A:  Intelligent  Control 

Portions  of  goal  2 A  have  been  published  in  four  international  peer-reviewed  conference  papers  (attachments  2A-1, 
2A-2,  2A-5,  and  2A-7),  one  international  journal  (attachment  2A-3),  and  one  book  chapter  (attachment  2A-4);  two 
international  journal  papers  (attachments  2A-8  and  2A-9)  have  been  reviewed  and  two  technical  reports 
(attachments  2 A- 10  and  2A-1 1)  have  been  completed  as  follows: 

1.  C.-H.  Chen,  D.  S.  Naidu,  and  M.  P.  Schoen.  An  adaptive  control  strategy  for  a  five-fingered  prosthetic 
hand.  In  the  14^^  World  Scientific  and  Engineering  Academy  and  Society  (WSEAS)  International 
Conference  on  Systems,  Latest  Trends  on  Systems  (volume  II),  Corfu  Island,  Greece,  July  22-24,  pp.  405- 
410,  2010.  (attachment  2A-1) 

2.  C.-H.  Chen  and  D.  S.  Naidu.  Optimal  control  strategy  for  two-fingered  smart  prosthetic  hand.  In 
Proceedings  of  the  15^^  International  Association  of  Science  and  Technology  for  Development  (lASTED) 
International  Conference  on  Robotics  and  Applications  (RA  2010),  Cambridge,  Massachusetts,  USA, 
November  1-3,  pp.  190-196,  2010.  (attachment  2A-2) 

3.  C.-H.  Chen,  D.  S.  Naidu,  and  M.  P.  Schoen.  Adaptive  control  for  a  five-fingered  prosthetic  hand  with 
unknown  mass  and  inertia.  World  Scientific  and  Engineering  Academy  and  Society  (WSEAS)  Journal  on 
Systems,  Vol.  10,  No.  5,  pp.  148-161,  May  2011.  (attachment  2A-3) 

4.  D.  S.  Naidu  and  C.-H.  Chen.  Automatic  control  strategies  for  smart  prosthetic  hand  technology:  an 
overview,  book  chapter  12,  to  appear  in  a  book  titled  “Distributed  Diagnosis  and  Home  Healthcare  (D2H2): 
Volume  2”,  American  Scientific  Publishers,  CA,  pp.  201-223,  2011.  (attachment  2A-4) 

5.  C.-H.  Chen  and  D.  S.  Naidu.  Fusion  of  fuzzy  logic  and  PD  control  for  a  five-fingered  smart  prosthetic 
hand.  In  Proceedings  of  the  2011  IEEE  International  Conference  on  Euzzy  Systems  (EUZZ-IEEE  2011), 
Taipei,  Taiwan,  June  27-30,  pp.  2108-2115,  2011.  (attachment  2A-5  and  2A-6) 

6.  C.-H.  Chen  and  D.  S.  Naidu.  Hybrid  genetic  algorithm  PID  control  for  a  five-fingered  smart  prosthetic 
hand.  In  Proceedings  of  the  6th  International  Conference  on  Circuits,  Systems  and  Signals  (CSSdl), 
Vouliagmeni  Beach,  Athens,  Greece,  March  7-9,  pp.  57-63,  2012.  (attachment  2A-7) 

7.  C.-H.  Chen  and  D.  S.  Naidu.  A  new  optimal  control  strategy  for  a  five-fingered  smart  prosthetic  hand. 
Journal  oflET  Control  Theory  and  Applications.  (Submitted)  (attachment  2A-8) 

8.  C.-H.  Chen  and  D.  S.  Naidu.  Hybrid  control  strategies  for  a  five-finger  smart  prosthetic  hand.  Journal  of 
Biomedical  Signal  Processing  and  Control  (Elsevier).  (Submitted)  (attachment  2A-9) 

9.  P.  Ezenwa,  “Kinematics,  dynamics  and  control  of  prosthetic  hand  with  extended  degrees  of  freedom,”  M.S. 
thesis.  Measurement  and  Control  Engineering,  Idaho  State  University,  (attachment  2 A- 10) 

10.  A.  Khamis,  “Optimal  control  strategy  for  smart  prosthetic  hand,”  technical  report.  Measurement  and 
Control  Engineering,  Idaho  State  University,  2012.  (attachment  2A-11) 
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Goal  2AB:  Real-Time  Control 


•  Amir  Fassih,  D.Subbaram  Naidu,  Steve  Chiu,  Parmod  Kumar,  “Robust  Control  of  a  Prosthetic  Hand  Based 
on  a  Hybrid  Adaptive  Finger  Angle  Estimation”,  Wseas  Conf.  Athen,  Greece,  March  7-9,2012 

•  Amir  Fassih,  D.Subbaram  Naidu,  Steve  Chiu,  Parmod  Kumar,  “Design  and  Control  of  an  Underactuated 
Prosthetic  Hand”,  Wseas  Conf.  Athen,  Greece,  March  7-9,2012 

•  Fassih,  D.S.  Naidu,  S.  Chiu,  And  M.P.  Schoen,  “Power  Grasping  of  a  Prosthetic  Hand  Based  Upon  Virtual 
Spring-Damper  Hypothesis”,  lASTED  Int.  Conf  Robotics  And  Applications,  Cambridge,  MA,  November 
1-3,2010 

•  Fassih,  D.S.  Naidu,  S.  Chiu,  And  M.P.  Schoen,  “Precision  Grasping  of  a  Prosthetic  Hand  Based  on  Virtual 
Spring  Damper  Hypothesis”,  leee  5th  Cairo  International  Biomedical  Engineering  Conference,  Cairo, 
Egypt,  Dec  2010 

•  P.  Kumar,  C.  H.  Chen,  A.  Sebastian,  M.  Anugolu,  C.  Potluri,  A.  Fassih,  Y.  Yihun,  A.  Jensen,  Y.  Tang,  S. 
Chiu,  K.  Bosworth,  “An  Adaptive  Hybrid  Data  Fusion  Based  Identification  of  Skeletal  Muscle  Force  With 
Anfis  And  Smoothing  Spline  Curve  Fitting”,  International  Conference  On  Fuzzy  Systems,  Taipei,  Taiwan, 
June  27  -  June  30,  2011. 

•  Potluri,  M.  Anugolu,  P.  Kumar,  A.  Fassih,  P.  Yarlagadda,  Y.  Yihun,  And  S.  Chiu,  “Real-Time  Semg 
Acquisition  And  Processing  Using  A  Pic  32  Microcontroller”,  Esa’ll  -  9th  Int'l  Conference  On  Embedded 
Systems  And  Applications,  Las  Vegas,  Nevada,  Usa,  July  18-21,  2011. 
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Goal  2B:  Embedded  Hierarchical  Real-Time  Systems 


1.  Chandrasekhar  Potluri,  Parmod  Kumar,  Madhavi  Anugolu,  Alex  Urfer,  Steve  Chiu,  D.  Subbaram  Naidu, 
and  Marco  P.  Schoen,  ‘'Frequency  Domain  Surface  EMG  Sensor  Fusion  for  Estimating  Finger  Forces,  ” 
32nd  Annual  International  Conference  of  the  IEEE  Engineering  in  Medicine  and  Biology  Society,  Buenos 
Aires,  Argentina,  Aug.  31  -  Sept.  4,  2010. 

2.  Chandrasekhar  Potluri,  Parmod  Kumar,  Jeff  Mo  liter,  Madhavi  Anugolu,  Jensen  Alex,  Kenyon  Hart,  and 
Steve  Chiu,  “Multi-Level  Embedded  Motor  Control  for  Prosthesis,  ”  International  Conference  on 
Embedded  Systems  and  Applications,  ESA’2010,  Las  Vegas,  Nevada,  USA,  July  12-15,  2010. 

3.  Chandrasekhar  Potluri,  Parmod  Kumar,  Madhavi  Anugolu,  Steve  Chiu,  Alex  Urfer,  Marco  P.  Schoen, 
and  D.  Subbaram  Naidu,  ‘‘sEMG  Based  Euzzy  Control  Strategy  with  ANEIS  Path  Planning  Eor  Prosthetic 
Handf  3rd  IEEE  RAS  &EMBS  International  Conference  on  Biomedical  Robotics  and  Biomechatronics, 
Tokyo,  Sept  26-30,  2010. 

4.  Chandrasekhar  Potluri,  Chandrabanu  Vedantam,  Shanmuk  Anjaneyulu  Dasari,  Deepak  Kumar,  Avinash 
M,  Marco  P.  Schoen,  D.  Subbaram  Naidu,  “  Hand  Gestures  Recognition  Based  on  sEMG  Signal  Using 
Wavelet  and  Pattern  Recognition’’'  International  conference  on  Aerospace  Electronics,  Communication  and 
Instrumentation  (ASECI),  Vijayawada,  A.P,  India,  Jan  06-07,  2010._ 

5.  Chandrasekhar  Potluri,  Yimesker  Yihun,  Parmod  Kumar,  Jeff  Molitor,  Steve  C.  Chiu,  D. 
Subbaram  Naidu,  Fellow,  IEEE,  S.Hossein  Mousavinezhad,  “sEMG  Based  Real-Time  Embedded 
Force  Control  Strategy  for  a  Prosthetic  Hand  Prototype”  IEEE  International  Conference  on 
Electro/Information  Technology,  Mankato,  Minnesota,  USA,  May  15-17,  2011. 

6.  Chandrasekhar  Potluri,  Madhavi  Anugolu,YimeskerYihun,Alex  Jensen,  Steve  Chiu  Member,  IEEE, 
Marco  P.  Schoen,  Senior  Member,  IEEE,  and  D.  Subbaram  Naidu,  Eellow,  IEEE.  “Optimal  Tracking  of  a 
sEMG  based  Force  Model  for  a  Prosthetic  Hand”,  33rd  Annual  International  Conference  of  the  IEEE 
Engineering  in  Medicine  and  Biology  Society,  Boston,  MA,  USA,  Aug  31-  Sep  3,  2011 

7.  Chandrasekhar  Potluri,  Madhavi  Anugolu,  Yimesker  Yihun,  Parmod  Kumar,  Steve  Chiu,  Member, 
IEEE,  Marco  P.  Schoen,  Senior  Member,  IEEE,  D.  Subbaram  Naidu,  Fellow,  IEEE  “Implementation  of 
sEMG-Based  Real-Time  Embedded  Adaptive  Finger  Force  Control  for  a  Prosthetic  Hand”,  IEEE 
Conference  on  Decision  and  Control  and  European  Control  Conference  (IEEE  CDC-ECC),  Orlando, 
Elorida,  USA,  December  12-15,  2011. 

8.  Chandrasekhar  Potluri,  Madhavi  Anugolu,  Parmod  Kumar,  Amir  Eassih,  Yimesker  Yihun,  Steve  Chiu, 
and  Subbaram  Naidu,  ''Real-Time  sEMG  Acquisition  and  Processing  Using  a  PIC  32  Microcontroller,  ” 
ESA’l  1  -  9th  Int'l  Conference  on  Embedded  Systems  and  Applications,  Las  Vegas,  Nevada,  USA,  July  18- 
21,2011. 

9.  Chandrasekhar  Potluri,  Madhavi  Anugolu,  Alex  Jensen,  Girish  Sriram,  Shiwei  Liu,  Steve  Chiu,  "PIC  32 
Microcontroller  Based  sEMG  Acquisition  System  and  Processing  Using  Wavelet  Transforms,  ”  ESA’ 12  - 
9th  Int'l  Conference  on  Embedded  Systems  and  Applications,  Las  Vegas,  Nevada,  USA,  July  16-19,  2012. 
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10.  Chandrasekhar  Potluri,  Madhavi  Anugolu,  Steve  Chiu,  Alex  Urfer,  Alba  Perez,  Marco  P.  Schoen,  D. 
Subbaram  Naidu  “Fusion  of  Spectral  Models  for  Dynamic  Modeling  of  sEMG  and  Skeletal  Muscle  Force” 
submitted  to  34th  Annual  International  Conference  of  the  IEEE  Engineering  in  Medicine  and  Biology 
Society,  San  Diego,  CA,  USA,  Aug  28-Sep  1,  2012. 
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Goal  3,  Robotic  Hand:  Manuscripts  published  or  in  press: 

Yihun,  Y.,  Bosworth,  K.  and  Perez-Gracia,  A,  “Design  Optimization  of  Spatial  Mechanisms  to  be  submitted  to  the 
2013  ASME IDET  Conference. 

Batbold,  B.,  Thomas,  F.,  Yihun,  Y.  and  Perez-Gracia,  A.,  “Approximate  Workspace  Synthesis  for  RCCR  Linkages”, 
to  be  submitted  to  the  2013  lEToMM  Computational  Kinematics  conference. 

Simo  Serra,  E.  and  Perez  Gracia,  A.,  “Kinematic  Synthesis  Using  Tree  Topologies”,  Mechanism  and  Machine 
Theory,  2012  (under  review). 

Yihun,  Y.,  Rahman,  M.S.,  and  Perez-Gracia,  A.,  “Design  of  an  Exoskeleton  as  a  Finger-Joint  Angular  Sensor”, 
2012  IEEE  EMBS  Conference,  San  Diego,  CA,  August  28-September  1,  2012. 

Yihun,  Y.,  Miklos,  R.,  Perez-Gracia,  A.,  Reinkensmeyer,  D.J.,  Denney,  K.  and  Wolbrecht,  E.T.,  “Single  Degree-of- 
Freedom  Exoskeleton  Mechanism  Design  for  Thumb  Rehabilitation”,  2012  IEEE  EMBS  Conference,  San  Diego, 

CA,  August  28-September  1,  2012. 

Scott,  K.  and  Perez-Gracia,  A.,  “Design  of  a  Prosthetic  Hand  with  Remote  Actuation”,  2012  IEEE  EMBS 
Conference,  San  Diego,  CA,  August  28-September  1,  2012. 

Simo-Serra,  E.,  Perez-Gracia,  A.,  Moon,  H.  and  Robson,  N.,  “Design  of  Multifmgered  Robotic  Hands  for  Finite 
and  Infinitesimal  Tasks  Using  Kinematic  Synthesis”,  2012  Advances  in  Robot  Kinematics  conference. 

Perez  Gracia,  A.,  “Synthesis  of  Spatial  RPRP  Closed  Linkages  for  a  Given  Screw  System”,  ASME  Journal  of 
Mechanisms  and  Robotics,  3(2),  2011. 

Simo-Serra,  E.,  Moreno-Noguer,  E.,  and  Perez-Gracia,  A.,  “Design  of  Non-anthropomorphic  Robotic  Hands  for 
Anthropomorphic  Tasks”,  accepted  at  the  ASME  International  Design  Engineering  Technical  Conferences,  IDETC 
2011,  Washington  DC,  USA,  August  29-31,  2011. 

Crawford,  A.L.,  Molitor,  J.,  Perez  Gracia,  A.,  and  Chiu,  S.,  “Design  of  a  Robotic  Hand  and  Simple  EMG  Input 
Controller  with  a  Biologically-Inspired  Parallel  Actuation  System  for  Prosthetic  Applications”,  1st  International 
Conference  on  Applied  Bionics  and  Biomechanics  (ICABB),  Venice,  Italy,  October  14-16,  2010. 

Invited  oral  presentations: 

Polytechnic  University  of  Catalonia,  Barcelona,  Spain:  “The  Smart  Prosthetic  Hand  Project”,  presentation  at  the 
Equal  Opportunities  Seminar,  Eebruary  2011. 
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Goal  4:  Biocompatibility  and  Signaling 


Our  research  has  been  very  productive:  to  date,  we  have  9  journal  articles,  3  reviews,  and  20  conference 

proceedings  papers  published  or  in  press,  published  40  abstracts,  and  given  9  invited  oral  and  31  poster 

presentations  (see  lists  below  for  details). 

Journal  Articles  published  or  in  press: 

1.  Lai  JCK,  Ananthakrishnan  G,  Jandhyam  S,  Dukhande  VV,  Bhushan  A,  Gokhale  M,  Daniels  CK  & 
Leung  SW  (2010)  Treatment  of  Human  Astrocytoma  U87  Cells  with  Silicon  Dioxide  Nanoparticles 
Lowers  Their  Survival  and  Alters  Their  Expression  of  Mitochondrial  and  Cell  Signaling  Proteins. 
International  Journal  of  Nanomedicine  5:715-723. 

2.  Jaiswal  AR,  Bhushan  A,  Daniels  CK  &  Lai  JCK  (2010)  A  Cell  Culture  Model  for  Diabetic  Neuropathy 
Studies.  Journal  of  the  Idaho  Academy  of  Science  46(l):58-63. 

3.  Wong  YYW,  Jaiswal  AR,  Bhushan  A,  Leung  SW  &  Lai  JCK  (2010)  Further  Elucidation  of 
Neuroprotective  Properties  of  Astrocytoma  (Astrocytes-like)  Cells.  Journal  of  the  Idaho  Academy  of 
Science  46(l):52-57. 

4.  Patil  PP,  Lai  MB,  Leung  SW,  Lai  JCK  &  Bhushan  A  (2010)  Differential  Cytotoxic  Effects  of 
Magnesium  Oxide  Nanoparticles  on  Cisplatin-sensitive  and  Cisplatin-resistant  Leukemia  Cancer  Cells. 
Journal  of  the  Idaho  Academy  of  Science  46(l):70-75. 

5.  Wright  CL,  Lai  JCK,  Chan  AWK,  Minski  MJ,  Lim  L  &  Leung  SW  (2010)  Metallomic  Distribution  in 
Various  Regions  of  the  Brain  as  Influenced  by  Dietary  Intakes  and  Their  Implications.  In  Proceedings 
of  the  ISEIS  2010  International  Conference  on  Ecological  Informatics  and  Ecosystem  Conservation, 
August  27-29,  Beijing,  China,  published  in  Procedia  Engineering  01  (2010)  0159-0171. 

6.  Leung  SW,  Siddhanti  S,  Williams  B,  Chan  AWK,  Minski  MJ,  Daniels  CK  &  Lai  JCK  (2010)  Effects 
of  Diet  Intake  on  Metal  and  Electrolyte  Distributions  in  Various  Organs.  In  Proceedings  of  the  ISEIS 
2010  International  Conference  on  Ecological  Informatics  and  Ecosystem  Conservation,  August  27-29, 
Beijing,  China,  published  in  Procedia  Engineering  01  (2010)  0104-0108. 

7.  Leung  SW,  Wang  Y  &  Lai  JCK  (2011)  Biomedical  Applications  of  Modified  Carbon  Glassy  Electrode 
Sensor  with  Nanoparticles  and  Dendrimers.  Sensors  &  Transducers  (2011)  Volume  11,  Special  Issue, 
April  2011,  pp.  74-82. 

8.  Gao  W,  Lai  JCK  &  Leung  SW  (2012)  Functional  Enhancement  of  Chitosan  and  Nanoparticles  in  Cell 
Culture,  Tissue  Engineering  and  Pharmaceutical  Applications.  Frontiers  in  Physiology  3,  Article  321, 
pp.  1-13  [published:  21  August  2012.  Doi:  10. 3389/fphys.2012. 00321]. 

9.  Leung  SW,  Assan  D  &  Lai  JCK  (2012)  Evaluation  of  Anchoring  Materials  for  Ultra -Sensitive 
Biosensors  Modified  with  Au  Nanoparticles  and  Enzymes.  Sensors  &  Transducers  Journal,  Volume  15 
(Special  Issue:  Oct.  2012),  pp.  59-70. 


Review  Articles  published  or  in  press: 

1.  Bhushan  A,  Patil  PP,  Leung  SW  &  Lai  JCK  (2013)  Metallic  Nanoparticles  in  Cancer  Imaging  and 
Therapy.  In:  CRC  Biomedical  Engineering  Handbook,  4*  Edition,  CRC  Press  (in  press). 

2.  Lai  JCK  &  Leung  SW  (2012)  Manganese  and  Its  Interrelations  with  Other  Metal  Ions  in  Health  and 
Disease.  In:  Encyclopedia  of  Metalloproteins  (Uversky  VN,  Kretsinger  RH  &  Permyakov  EA,  eds.). 
Springer  (in  press). 

3.  Lai  JCK,  Jaiswal  AR,  Lai  MB,  Jandhyam  S,  Leung  SW  &  Bhushan  A  (2013)  Toxicity  of  Silicon 
Dioxide  Nanoparticles  in  Mammalian  Neural  Cells.  In:  Clinical  Nanomedicine  —  From  Bench  to 
Bedside  (Bawa  R,  Audette  GF  &  Rubinstein  I,  eds.).  Pan  Stanford  Series  in  Nanomedicine  (Bawa,  R, 
Series  Ed.),  Volume  1,  Pan  Stanford  Publishing,  Singapore  (in  press). 
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Conference  Proceedings  Papers  published  or  in  press: 

1.  Jaiswal  A,  Wong  YYW,  Bhushan  A,  Daniels  C  &  Lai  JCK  (2010)  A  Noncontact  Co-Culture  Model  of 
Peripheral  Neural  Cells  for  Nanotoxicity,  Tissue  Engineering  and  Pathophysiological  Studies. 
Technical  Proceedings  of  the  2010  NSTI  Nanotechnology  Conference  and  Expo  -  Nanotech  2010, 

Vol.  3  Chapter  8:  Environment,  Health  &  Safety,  Pages  527-531. 

2.  Wong  YYW,  Jaiswal  AR,  Dukhande  VV,  Bhushan  A,  Leung  SW  &  Lai  JCK  (2010)  Elucidation  of 
Neuroprotective  Properties  of  Astrocytoma  (Astrocytes-like)  Cells  in  Neural  Cell  Culture  Models  In 
Vitro:  Applications  in  Tissue  Engineering  and  Nanotoxicology.  Technical  Proceedings  of  the  2010 
NSTI  Nanotechnology  Conference  and  Expo  -  Nanotech  2010,  Vol.  3  Chapter  8:  Environment,  Health 
&  Safety,  Pages  561-564. 

3.  Leung  SW,  Gao  W,  Gu  H,  Bhushan  A  &  Lai  JCK  (2010)  Chitosan  Membrane  in  Combinations  with 
Nanoparticles  and  Adriamycin  as  a  Treatment  to  Inhibit  Glioma  Growth  and  Migration.  Technical 
Proceedings  of  the  2010  NSTI  Nanotechnology  Conference  and  Expo  -  Nanotech  2010,  Vol.  3 
Chapter  3:  Nano  for  Biotech,  Interfaces  &  Tissues,  Pages  206-209. 

4.  Leung  SW,  Wang  Y,  Gu  H  &  Lai  JCK  (2010)  Biomedical  Applications  of  Modified  Carbon  Glassy 
Electrode  Sensor  with  Nanoparticles  and  Dendrimers.  Technical  Proceedings  of  the  2010  NSTI 
Nanotechnology  Conference  and  Expo  -  Nanotech  2010,  Vol.  3  Chapter  1:  Bio  Sensors,  Diagnostics  & 
Imaging,  Pages  122-124. 

5.  Bhushan  A,  Patil  PP,  Bhardwaj  V,  Lai  MB,  Daniels  CK,  Leung  SW  &  Lai  JCK  (2010)  Cross 
Resistance  of  Magnesium  Oxide  Nanoparticles  to  Cisplatin  in  Leukemia  Cells:  Mechanistic  Studies.  In 
Seminar  Proceedings  of  Institution  of  Mechanical  Engineers  Seminar  on  Nanotechnology  in  Medicine 
and  Biotechnology,  October  2010,  London,  UK,  Chapt.  5,  pp.  1-4. 

6.  Leung  S  &  Lai  J  (2011)  Advanced  Dehydrogenase  Biofuel  Cell  Modified  with  Highly  Branched 
Polymers  and  Nanogold  Sol-Gel.  In  Proceedings  of  2011  International  Conference  on  Agricultural  and 
Biosystems  Engineering  (ICABE  2011).  Lecture  Notes  in  Information  Technology  Vols.  3-4,  pp.  41- 
44. 

7.  Leung  S,  Williams  B,  Lai  J,  Chan  A  &  Minski  M  (2011)  Elemental  Analyses  in  Organ  Systems  in  a 
Small  Animal  after  Life-Long  Controlled  Diet.  In  Proceedings  of  2011  International  Conference  on 
Agricultural  and  Biosystems  Engineering  (ICABE  2011).  Lecture  Notes  in  Information  Technology 
Vols.  3-4,  pp.  45-48. 

8.  Leung  SW  &  Lai  JCK  (201 1)  Advanced  Biofuel  Cell  Composed  of  Highly  Modified  Electrodes  for 
Biomedical  Applications.  Technical  Proceedings  of  the  2011  NSTI  Nanotechnology  Conference  and 
Expo  -  Nanotech  2011,  Vol.  3,  Chapter  9:  Nanotech  for  Oil,  Gas  &  BioEnergy,  pp.  636-639. 

9.  Jaiswal  AR,  Lu  S,  Pfau  J,  Wong  YYW,  Bhushan  A,  Leung  SW,  Daniels  CK  &  Lai  JCK  (2011)  Effects 
of  Silicon  Dioxide  Nanoparticles  on  Peripheral  Nervous  System  Neural  Cell  Models.  Technical 
Proceedings  of  the  2011  NSTI  Nanotechnology  Conference  and  Expo  -  Nanotech  2011,  Vol.  3, 
Chapter  7:  Environment,  Health  &  Safety,  pp.  541  -  544. 

10.  Wong  YYW,  Jaiswal  A,  Dukhande  VV,  Bhushan  A,  Leung  SW  &  Lai  JCK  (2011)  New  In  Vitro 
Strategy  of  Astrocytoma  (Astrocytes -like)  Cells  Treated  with  Pioglitazone  (PPARgamma  agonist) 
Offers  Neuroprotection  Against  Nanoparticles -Induced  Cytotoxicity.  Technical  Proceedings  of  the 
2011  NSTI  Nanotechnology  Conference  and  Expo  -  Nanotech  2011,  Vol.  3,  Chapter  6:  Nano  Medical 
Sciences  &  Neurology,  pp.  455  -  458. 

11.  Jain  A,  Jaiswal  AR,  Lu  S,  Wong  YYW,  Bhushan  A,  Leung  SW,  Daniels  CK  &  Lai  JCK  (201 1) 
Molecular  Effects  of  Silicon  Dioxide  Nanoparticles  on  Cell  Survival  Signaling  of  Dorsal  Root 
Ganglion  (DRG)  Neurons  and  Schwann  Cells.  Technical  Proceedings  of  the  2011  NSTI 
Nanotechnology  Conference  and  Expo  -  Nanotech  2011,  Vol.  3,  Chapter  7:  Environment,  Health  & 
Safety,  pp.  545  -  548. 

12.  Lu  S,  Jaiswal  AR,  Wong  YYW,  Bhushan  A,  Leung  SW,  Daniels  CK  &  Lai  JCK  (2011)  Differential 
Cytotoxic  Effects  of  Titanium  Oxide  Nanoparticles  on  Peripheral  Nervous  System  Neural  Cells. 
Technical  Proceedings  of  the  2011  NSTI  Nanotechnology  Conference  and  Expo  -  Nanotech  2011, 

Vol.  3,  Chapter  7:  Environment,  Health  &  Safety,  pp.  533  -  536. 

13.  Lai  JCK,  Gao  W  &  Leung  SW  (2011)  Effects  of  Chitosan  and  Nanoparticles  on  Survival  of  Schwann 
Cells  and  Dorsal  Root  Ganglion  Neurons.  Technical  Proceedings  of  the  2011  NSTI  Nanotechnology 
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Conference  and  Expo  -  Nanotech  2011,  VoL  3,  Chapter  6:  Nano  Medical  Sciences  &  Neurology,  pp. 
440  -  442. 

14.  Leung  SW,  Chan  A,  Minsk!  M  &  Lai  JCK  (201 1)  Comparison  of  Elemental  Distribution  in  Rat’s  Brain 
after  Lifelong  Treatment  with  Excessive  Mn^"^  in  Drinking  Water  and  the  Health  Implications. 
Proceedings  of  International  Water  Convention,  Singapore,  July  4-8,  2011,  Article  IWA-6218R1,  pp. 
1-10. 

15.  Wright  GL,  Lai  JCK,  Chan  A,  Minsk!  M  &  Leung  SW  (2011)  Influence  of  Metallomic  Distribution  in 
Brain  by  Prolong  Consumption  of  Contaminant  in  Drinking  Water.  Proceedings  of  International  Water 
Convention,  Singapore,  July  4-8,  2011,  Article  IWA-6228R1,  pp.  1-21. 

16.  Gao  X,  Assan  D,  Lai  JCK  &  Leung  SW  (2012)  Comparison  of  Anchoring  Materials  for  High 
Performance  Sensors  Modified  with  Nanoparticles  and  Enzymes.  In  Technical  Proceedings  of  the  2012 
NSTI  Nanotechnology  Conference  &  Expo  -  Nanotech  2012,  Vol.  1,  Chapter  1:  Nanoscale  Materials 
Characterization,  pages  17-20. 

17.  Lu,  S,  Bhushan  A,  Leung  SW,  Daniels  CK  &  Lai  JCK  (2012)  Cytotoxic  Effects  of  Lour  Metallic 
Oxide  Nanoparticles  on  Dorsal  Root  Ganglion  (DRG)  Neurons.  In  Technical  Proceedings  of  the  2012 
NSTI  Nanotechnology  Conference  &  Expo  -  Nanotech  2012,  Vol.  3,  Chapter  5:  Environmental  Health 
&  Safety,  pages  346-349. 

18.  Idikuda  VK,  Jaiswal  AR,  Wong  YYW,  Bhushan  A,  Leung  SW  &  Lai  JCK  (2012)  Cytotoxicity  of 
Magnesium  Oxide  Nanoparticles  in  Schwann  Cells.  In  Technical  Proceedings  of  the  2012  NSTI 
Nanotechnology  Conference  &  Expo  -  Nanotech  2012,  Vol.  3,  Chapter  5:  Environmental  Health  & 
Safety,  pages  342-345. 

19.  Lai  JCK,  Gao  W,  Bhushan  A  &  Leung  SW  (2012)  Cytotoxic  Effects  of  Short  Multi-Wall  Carbon 
Nanotubes  in  Dorsal  Root  Ganglion  (DRG)  Neurons.  In  Technical  Proceedings  of  the  2012  NSTI 
Nanotechnology  Conference  &  Expo  -  Nanotech  2012,  Vol.  3,  Chapter  5:  Environmental  Health  & 
Safety,  pages  338-341. 

20.  Assan  D,  Gao  X,  Lai  JCK  &  Leung  SW  (2012)  Surfactant  Effect  on  Intercellular  Transport  of  DNA, 
Proteins,  and  Electrolytes.  In  Technical  Proceedings  of  the  2012  NSTI  Nanotechnology  Conference  & 
Expo  -  Nanotech  2012,  Vol.  3,  Chapter  3:  Materials  for  Drug  &  Gene  Delivery,  pages  162-165. 


Abstracts  published: 

1.  Jaiswal  A,  Wong  YYW,  Bhushan  A,  Daniels  C  &  Lai  JCK  (2010)  A  Noncontact  Co-Culture 
Model  of  Peripheral  Neural  Cells  for  Nanotoxicity,  Tissue  Engineering  and 
Pathophysiological  Studies.  NSTI  Nanotechnology  Conference  and  Expo  -  Nanotech  2010, 
June  21-25,  2010,  Anaheim,  CA  (in  Abstracts  Volume). 

2.  Wong  YYW,  Jaiswal  AR,  Dukhande  VV,  Bhushan  A,  Leung  SW  &  Lai  JCK  (2010) 
Elucidation  of  Neuroprotective  Properties  of  Astrocytoma  (Astrocytes -like)  Cells  in  Neural 
Cell  Culture  Models  In  Vitro:  Applications  in  Tissue  Engineering  and  Nanotoxicology.  NSTI 
Nanotechnology  Conference  and  Expo  -  Nanotech  2010,  June  21-25,  2010,  Anaheim,  CA  (in 
Abstracts  Volume). 

3.  Leung  SW,  Gao  W,  Gu  H,  Bhushan  A  &  Lai  JCK  (2010)  Chitosan  Membrane  in 
Combinations  with  Nanoparticles  and  Adriamycin  as  a  Treatment  to  Inhibit  Glioma  Growth 
and  Migration.  NSTI  Nanotechnology  Conference  and  Expo  -  Nanotech  2010,  June  21-25, 
2010,  Anaheim,  CA  (in  Abstracts  Volume). 

4.  Leung  SW,  Wang  Y,  Gu  H  &  Lai  JCK  (2010)  Biomedical  Applications  of  Modified  Carbon 
Glassy  Electrode  Sensor  with  Nanoparticles  and  Dendrimers.  NSTI  Nanotechnology 
Conference  and  Expo  -  Nanotech  2010,  June  21-25,  2010,  Anaheim,  CA  (in  Abstracts 
Volume). 

5.  Wright  GL,  Lai  JCK,  Chan  AWK,  Minsk!  MJ,  Lim  L  &  Leung  SW  (2010)  Metallomic 
Distribution  in  Various  Regions  of  the  Brain  as  Influenced  by  Dietary  Intakes  and  Their 
Implications.  ISEIS  2010  International  Conference  on  Environmental  Informatics,  Beijing, 
China,  August  27-29,  2010  (in  Abstracts  Volume). 

6.  Leung  SW,  Siddhanti  S,  Williams  B,  Chan  AWK,  Minsk!  MJ,  Daniels  CK  &  Lai  JCK  (2010) 
Effects  of  Dietary  Intake  on  Metal  and  Electrolyte  Distributions  in  Various  Organs.  ISEIS 
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2010  International  Conference  on  Environmental  Informatics,  Beijing,  China,  August  27-29, 
2010  (in  Abstracts  Volume). 

7.  Bhushan  A,  Patil  PP,  Bhardwaj  V,  Lai  MB,  Daniels  CK,  Leung  SW  &  Lai  JCK  (2010)  Cross 
Resistance  of  Magnesium  Oxide  Nanoparticles  to  Cisplatin  in  Leukemia  Cells:  Mechanistic 
Studies.  Institution  of  Mechanical  Engineers  Seminar  on  Nanotechnology  in  Medicine  and 
Biotechnology,  October  2010,  London,  UK  (in  Program  &  Abstracts). 

8.  Gao  W,  Lai  JCK  &  Leung  SW  (2011)  Effects  of  Chitosan  on  Schwann  Cells  and  Dorsal  Root 
Ganglion  Neurons.  53^^  Annual  Symposium  of  the  Idaho  Academy  of  Science,  March  31- 
April  2,  2011,  The  College  of  Idaho,  Caldwell,  ID.  Journal  of  Idaho  Academy  of  Science, 
47(1):  59. 

9.  Jaiswal  AR,  Lu  S,  Bhushan  A,  Daniels  CK,  Leung  SW  &  Lai  JCK  (2011)  Toxicity  of 
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CONCLUSIONS 


Goal  1:  EMG  Signal  Identification 

In  the  first  part  of  this  final  report  on  Goal  1  (Chapter  1),  the  primary  research  aim  was  at  identifying  the  most 
favorable  signal  processing  methodologies  to  model  sEMG-force  and  sEMG-angle  relationships.  Here,  various  types 
of  filters  have  been  tested  extensively,  from  the  most  basic  Butterworth  filters  to  the  nonlinear  Bayesian  filters,  for 
single  electrode  configurations.  The  filtered  signals  were  initially  modeled  using  linear  and  non-linear  modeling 
techniques  e.g.  output  error  models  (OE),  auto  regressive  with  exogenous  input  models(ARX),  nonlinear  ARX 
(NLARX),  Box-Jenkins  models,  to  name  a  few.  The  estimated  force  fit  values  for  the  actuating  sEMG  signal  was  in 
the  range  of  30-40%  (100%  represents  a  perfect  fit  between  the  estimated  and  actual  force).  As  a  result  of  these  poor 
fit  values,  optimization  of  the  nonlinear  Bayesian  filter  parameters  and  the  nonlinear  Hammerstein- Wiener  model 
order  was  performed  using  Genetic  Algorithm.  The  optimization  helped  improve  the  model  fit  percentages 
significantly  (about  20%).  We  extended  the  analysis  of  sEMG-force  modeling  using  a  hybrid  Particle  Swarm 
Optimization  coupled  with  Tabu  Search  (PSO-TS)  to  help  improve  the  speed  of  the  optimization  process. 

Another  study  undertaken  was  to  perform  data  analysis  from  a  large  sensor  array  placed  on  and  around  the 
motor  points  of  the  forearm.  This  study  exhaustively  analyzed  various  linear  and  nonlinear  spatial  filters.  The 
nonlinear  and  linear  spatial  filters  (TDD,  NDD  and  NET,  NLTO  and  NLAED)  did  outperform  the  other  filtering 
methods.  The  only  other  filter  which  had  a  comparable  performance  to  the  spatial  filters  was  the  Bessel  filter.  The 
spatial  filter  masks  were  then  modified  for  optimum  estimation  of  force.  Again,  a  Genetic  algorithm  was  used  to 
optimize  the  filter  masks  for  various  spatial  filters.  This  again  led  to  a  significant  increase  in  the  fit  percentages,  but 
the  masks  were  significantly  different  than  those  from  the  reported  literature.  We  also  performed  a  study  on  the 
classification  of  zones  of  the  arm  (degree  of  amputation)  to  identify  the  most  favorable  locations  to  place  the  sEMG 
sensors.  The  results  obtained  were  in  good  agreement  with  the  ideal  locations  for  sEMG  measurement  from 
literature. 

The  issue  of  skeletal-muscle  fatigue  is  further  addressed  in  phase  II  of  this  project,  and  sEMG  -  Skeletal- 
Muscle  Eorce  -  Skeletal-Muscle  Eatigue  models  are  designed  for  smart  prosthesis  application.  Eor  the  skeletal- 
muscle  fatigue,  the  modeling  is  done  using  OE  models,  modal  transformations  and  curve  fitting  of  the  eigenvalues  in 
continuous  time.  Various  possible  linear  and  nonlinear  models  for  the  motor  point  sensor  for  the  ring  finger  are 
investigated.  sEMG  and  force  data  was  captured  with  different  experiment  design  including  with  a  9-sEMG  sensor 
array  and  used  with  Adaptive  Neuro  Euzzy  Inference  System  (ANEIS)  and  Smoothing  Spline  Curve  Eitting.  All  the 
approaches  used  in  this  research  work  give  better  estimation  of  the  skeletal -muscle  force  of  a  human  arm  for 
prosthetic  hand  design  then  previously  reported. 
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Goal  2 A:  Intelligent  Control 


•  22  Degree-of-Freedom  Prosthetic  Hand:  Kinematics,  dynamics  and  control  models  of  smart  prosthetic 
hand  with  22  degrees  of  freedom  (DOFs)  were  conducted.  In  our  approach,  the  problem  of  forward 
kinematics  using  the  Denavit-Hartenberg  (D-H)  method  was  applied  to  compute  the  position  of  the  end- 
effector  (fingertip)  given  the  joint  variable.  This  followed  by  the  inverse  kinematics  which  is  a  little  more 
difficult  problem.  The  inverse  kinematics  calculates  the  joint  variables  given  the  position  of  the  hand. 
Based  on  the  kinematic  structure,  a  mathematical  model  that  describes  the  dynamics  of  the  hand  was 
calculated.  These  dynamic  models  were  calculated  using  the  Lagrangian  and  Newton  Euler  formulations. 
Hard  control  strategies  such  as  feedback  linearization  and  proportional  integral  derivative  (PID)  control 
were  applied  to  control  the  hand  based  on  the  kinematic  and  dynamic  models. 

•  Optimal  Control  with  Simulink:  A  control  technique  of  finite-time  linear  quadratic  optimal  control  for  14 
DOFs,  five-fingered  smart  prosthetic  hand  was  developed  in  MATLAB  Simulink  with  different  reference 
inputs,  including  constant,  ramp,  sinusoidal  values.  The  optimal  control  was  used  for  feedback  linearized 
dynamics  to  minimize  tracking  error.  The  simulations  of  this  optimal  controller  showed  good  performance. 

•  3D  Simulation:  Fusion  of  control  strategies  for  14  degrees  of  freedom  (DOFs),  five-fingered  smart 
prosthetic  hand  was  simulated  to  grasp  an  object  in  3  dimensional  animations. 

•  Literature  Survey:  A  comprehensive  literature  updated  on  the  topic  of  control  techniques  for  prosthetic 
hands  was  conducted  and  one  book  chapter  was  published. 

•  Adaptive  Control:  An  adaptive  control  strategy  for  the  14  DOFs,  five-fingered  smart  prosthetic  hand  with 
unknown  mass  and  inertia  of  all  the  fingers  is  developed  in  this  work.  In  modeling,  the  various  links  used 
for  the  five  fingers  of  the  prosthetic  hand  are  shown.  A  cubic  polynomial  for  the  trajectory  planning  is  used. 
In  particular,  using  a  desired  orientation  for  three-link  fingers,  the  forward  and  inverse  kinematics  of  the 
prosthetic  hand  system  regarding  the  analytical  solutions  between  the  angular  positions  of  joints  and  the 
positions  and  orientations  of  the  end-effectors  (fingertips)  have  been  obtained.  The  simulations  of  the 
resulting  adaptive  controller  with  five-fingered  prosthetic  hand  show  enhanced  performance.  This  work 
was  published  in  one  international  journal. 

•  Optimal  Control:  This  paper  addresses  a  new  optimal  control  strategy  for  a  five -fingered  prosthetic  hand, 
to  speed  up  the  performance  and  improve  the  accuracy,  by  modifying  the  performance  index  with  an 
exponential  term.  First,  the  trajectory  planning  of  the  joints  of  each  finger  is  designed  by  using  cubic 
polynomial.  Then  the  dynamic  equations  of  the  prosthetic  hand  and  feedback  linearization  technique  are 
employed.  Next,  the  optimal  control  method  with  modified  performance  index  is  applied  to  the  prosthetic 
hand.  Finally,  simulations  show  that  the  proposed  technique  provides  much  faster  response  with  high 
accuracy  compared  to  adaptive  neuro -fuzzy  inference  system  (ANFIS)  based  inverse  kinematics  for 
trajectory  planning  and  PID  control.  This  work  has  been  submitted  to  Journal  of  lET  Control  Theory  and 
Applications. 

•  Hybrid  Control  (GA+PID):  A  hybrid  of  soft  control  technique  of  ANFIS  and  genetic  algorithm  (GA)  and 
hard  control  technique  of  proportional-integral-derivative  (PID)  for  a  five-fingered,  smart  prosthetic  hand  is 
presented.  The  ANFIS  is  used  for  inverse  kinematics  and  GA  is  used  for  tuning  the  PID  parameters  with 
the  objective  of  minimizing  the  error  squared  between  desired  and  actual  angles  of  the  links  of  the  fingers 
of  the  prosthetic  hand.  Simulation  results  for  all  the  five  fingers  with  GA-tuned  PID  controller  exhibit 
superior  performance  compared  to  the  PID  control  without  GA.  This  work  was  published  in  one 
international  peer-reviewed  conference  paper. 

•  Hybrid  Control  (FL+PD):  A  hybrid  of  soft  control  technique  of  ANFIS  and  fuzzy  logic  (FL)  and  hard 
control  technique  of  proportional -derivative  (PD)  for  a  five-fingered,  smart  prosthetic  hand  is  presented. 
The  ANFIS  is  used  for  inverse  kinematics  and  FL  is  used  for  tuning  the  PD  parameters  with  two  input 
layers  (error  and  error  change)  using  7  triangular  membership  functions  and  49  fuzzy  logic  rules. 
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Simulation  results  with  FL-tuned  PD  controller  exhibit  superior  performance  compared  to  the  PD  and  PID 
control  alone.  This  work  was  published  in  one  international  peer-reviewed  conference  paper  and  the 
extended  work  has  been  submitted  to  Journal  of  Biomedical  Signal  Processing  and  Control  (Elsevier). 

Goal  2B:  Embedded  Hierarchical  Real-Time  Systems 

The  work  under  Goal  2B  during  this  Year  demonstrated  the  usability  of  a  fast  prototyping  test  bed  for  the 
sEMG  acquisition,  validation  and  verification  of  model -based  controller  designs.  We  were  also  able  to 
study  in  more  details  the  impact  of  implementation  on  the  embedded  control,  including  the  use  of  CAN  and 
RTOS.  Furthermore,  we  began  our  investigation  on  the  modeling  and  simulation  of  our  embedded  control 
through  collaboration  with  Johns  Hopkins  University’s  Applied  Physics  Laboratory. 
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Goal  3:  Robotic  Hand 


The  main  objective  of  Goal  3  was  to  develop  a  prosthetic  hand  adapted  to  the  findings  of  the  research 
team.  Hand  1  Prototype  II  is  finalized  and  is  considered  a  good  learning  experience.  The  new  design, 
Hand  2,  has  been  developed.  It  presents  a  radically  different  design  and  overcomes  some  of  the  main 
problems  of  Hand  1.  This  hand  has  been  manufactured  and  is  at  the  assembly  stage.  We  expect  the  hand 
to  be  fully  operative  by  January  2013.  The  expertise  gained  and  the  effort  put  into  it  is  going  to  be  the 
base  for  continuing  research  in  multi-finger  hand  design,  including  collaborations  for  design  for  grasping 
and  manipulation. 

In  addition,  much  insight  has  been  gained  in  the  design  process  for  multi -fingered  robotic  hands.  The 
methodology  developed  during  this  research,  which  includes  a  motion  capture  system,  a  general,  multi¬ 
finger  kinematic  synthesis  algorithm,  and  a  link  optimization  post-processing,  will  lead  to  better  and  more 
diverse  designs  of  articulated  systems  to  be  used  to  substitute,  or  together  with,  the  human  hand,  such  as 
prosthetic  hands,  partial  hand  prostheses,  exoskeletons  and  robotic  hands  for  human-robot  interaction. 

This  design  framework  is  to  be  made  freely  available  as  a  set  of  software  packages  easy  to  interact 
together,  so  that  both  researchers  and  developers  can  benefit  from  its  design  flexibility. 
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Goal  4:  Biocompatibility  and  Signaling 

We  have  made  significant  progress  in  studies  specified  in  Goal  4  of  our  proposal.  In  the  process  of  setting 
up  the  “Sensor  on  Cells  on  Skin  Model,”  we  have  identified  the  three  stages  we  need  to  undergo  to  achieve  this 
goal:  (i)  stage  one  involves  the  development  of  different  human  and  other  mammalian  cells  (including  nerve 
and  skin  cells)  in  co-culture;  (ii)  stage  two  requires  the  juxtaposition  of  cells  in  relation  to  the  membrane  as 
illustrated  in  Fig.  1.  above  (this  figure  was  included  in  our  proposal);  and  (hi)  stage  three  involves  designing  the 
sensor(s)  and  fitting  them  into  the  “sensor  on  cells  on  skin  model”  (as  shown  in  Fig.  1).  We  have  accomplished 
stages  (i)  and  (ii)  by  developing  the  “co-culture”  and  the  “non-contact”  cell  models  and  demonstrating  that  these 
models  can  be  useful  and  relevant  in  facilitating  studies  to  address  various  mechanistic  issues  in 
biocompatibility  and  other  tissue  engineering  and  nanotoxicity  research.  Furthermore,  we  have  developed  new 
cell  models  of  peripheral  nervous  systems  consisting  of  dorsal  root  ganglion  neurons  and  Schwann  cells.  These 
models  are  particularly  useful  for  elucidating  nerve  degeneration  and  regeneration.  We  are  currently 
characterizing  these  models  further.  Our  extensive  literature  survey  indicates  that  our  approaches  are  truly  novel 
and  will  lead  to  further  ground-breaking  discoveries  because,  as  we  have  already  discussed  above,  the  whole 
important  issue  of  how  tissue  and  cellular  inflammatory  responses  are  elicited  by  implant  material(s)  have  not 
been  resolved  and  is  poorly  understood.  By  way  of  heading  towards  completing  stage  (hi),  we  have  developed 
several  “smart”  sensors  that  are  pH  sensitive  and  self-assembling  with  nanoparticles.  Thus  far,  we  are  using 
glassy  carbon,  gold,  or  silver  as  anchor  material  for  the  sensor  electrode.  This  type  of  “smart”  sensor  can  be 
employed  to  detect  many  enzymatic  and  chemical  reactions  known  to  occur  in  different  tissues/organs.  Thus, 
we  are  focusing  on  the  development  of  biosensors  for  tissue  engineering  and  biocompatibility  studies  and 
related  biomedical  engineering  applications.  We  also  recently  noted  that  some  of  the  sensors  we  have  designed 
can  also  be  developed  into  fuel  cells  and  related  applications. 

One  important  but  as  yet  poorly  characterized  facet  of  biocompatibility  pertains  to  the  putative  nanotoxicity 
of  nanoparticles  and  other  nanomaterials  employed  to  fabricate  artificial  implants.  As  part  of  our  systematic 
studies  to  elucidate  the  cytotoxicity  of  nanoparticles  of  metallic  oxides  that  are  commonly  found  in  composites 
in  fabricating  such  implants,  we  have  further  characterized  the  effects  of  silicon  dioxide  and  magnesium  oxide 
nanoparticles  on  human  neural  cells,  normal  human  fibroblasts,  dorsal  root  ganglion  neurons,  and  Schwann 
cells.  We  have  elucidated  some  of  the  cellular  and  molecular  mechanisms  underlying  the  cytotoxicity  of  these 
nanoparticles  on  human  and  non-human  neural  cells.  These  are  important  advances  in  nanotoxicity  research 
because  of  the  paucity  of  literature  on  the  cytotoxicity  of  nanoparticles  of  metallic  and  non-metallic  oxides  in 
neural  cells  Thus,  our  findings  may  have  toxicological  and  other  pathophysiological  implications  on  exposure 
of  humans  and  other  mammalian  species  to  such  nanoparticles. 
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Modeling  surface  electromyogram  dynamics 
using  Hammerstein-Wiener  models  with 
comparison  of  HR  and  spatial  filtering 

techniques 


ANISH  SEBASTIAN,  PARMOD  KUMAR,  MARCO  P.  SCHOEN 


Abstract —  The  national  limb  loss  statistics  paints  a  grim  picture. 
Given  the  staggering  limb  loss  numbers,  the  need  to  develop  a 
“Smart  Prosthetic  Device”  has  never  been  more  exigent.  Despite 
years  of  effort  by  various  government  organizations  and  dedicated 
work  on  part  of  many  scientists,  we  are  still  quite  a  ways  away  from 
creating  the  “perfect”  prosthetic.  Using  electromyogram  (EMG) 
signals  to  control  prosthetic  devices  is  and  has  been  in  the  past,  one 
of  the  most  promising  directions  for  this  research.  However,  most  of 
the  control  schemes  being  used,  are  based  on  either  pre-programming 
the  motion  using  threshold  values  of  the  EMG  signal  as  reference,  or 
using  the  root-mean-squared  values  of  the  EMG  signal  to  actuate  the 
prosthetic  device.  Using  such  a  control  strategy,  makes  it  impossible 
to  capture  the  underlying  dynamics  between  EMG  signals  and  the 
intended  finger  movements  and  forces.  As  a  result  of  which  the  user 
needs  to  make  an  effort  to  learn  to  use  the  device,  which  can  be  very 
exhaustive.  We  propose  to  use  system  identification  based  dynamic 
models  which  are  extracted  from  recorded  surface  EMG  (sEMG) 
signals  and  the  corresponding  finger  forces.  A  key  influence  on  the 
resulting  quality  of  such  models  is  the  filtering  methods  used  for  the 
EMG  signals.  This  paper  presents  a  thorough  analysis  of  spatial 
filtering  and  other  filtering  methods  as  a  possible  solution  to  capture 
the  dynamics  of  the  sEMG  signals,  and  perhaps  in  the  future  use 
these  models  to  implement  control  schemes  which  would  mimic  the 
intricate  force  changes  for  a  prosthetic  hand.  The  different  filters  are 
compared  on  the  basis  of  the  EMG-finger  force  model  fit 
percentages,  obtained  from  System  Identification  using  various  Non- 
Einear  Hammerstein-Wiener  models.  The  nonlinear  spatial  filters 
gave  better  fit  values  as  compared  to  the  standard  filtering 
techniques. 

Keywords —  Spatial  Filtering,  Hammerstein-Wiener,  Surface 
Electromyogram  (sEMG),  System  Identification,  Sensor  Array, 
Modeling. 
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I.  Introduction 

Bout  50%  of  the  people  who  need  upper  extremity 
prosthetics  do  not  use  them,  [I].  This  could  be  due  any 
one  of  the  common  following  reasons;  Lack  of  a)  Dexterity, 
b)  Comfort  and  c)  High  Cost.  Despite  advances  in  the  fields  of 
manufacturing,  electronics,  signal  processing,  sensor  design, 
and  our  understanding  of  biological  signals,  we  still  face  a 
huge  challenge  designing  a  prosthetic  device.  This  is  due  to 
the  fact  that  such  a  device  has  to  compete  with  one  that  nature 
has  gifted  us.  A  human  hand  is  without  doubt  the  best  possible 
design.  For  a  prosthetic  hand,  to  encompass  all  of  the  human 
hands  features  and  capabilities  is  as  of  now  still  a  distant 
reality.  Electromyogram  (EMG)  signals  have  been  used  for 
quite  some  time  now  in  the  control  of  prosthesis.  The  EMG 
signal  is  a  small  voltage  signal  (in  mV),  generated  by  skeletal 
muscles.  This  signal  carries  information  of  the  objective  the 
user  would  like  to  execute.  Using  surface  EMG  (sEMG) 
signals,  researchers  have  been  able  to  actuate  motors  on 
artificial  prosthetic  devices.  EMG  signals  can  be  measured 
using  intramuscular  electrodes,  needle  electrodes,  or  by 
placing  electrodes  on  the  surface  of  the  skin.  The  purpose  for 
which  the  sEMG  signal  is  being  recorded  generally 
determines  whether  it  should  be  measured  within  the  muscle 
using  needle  electrodes  or  surface  measurement  using 
electrodes  on  the  skin  would  suffice.  If,  the  purpose  of 
recording  the  EMG  signal  is  to  look  for  diseases  relating  to  a 
particular  muscle,  one  might  be  better  off  using  needle 
electrodes.  On  the  other  hand,  if  it  is  to  be  used  to  actuate 
motors  on  a  prosthetic  device,  which  a  user  might  want  to  take 
off  and  wear  without  the  need  of  medical  supervision,  surface 
EMG  would  suffice.  Measuring  the  EMG  signal  on  the 
surface  of  the  skin  is  also  less  uncomfortable.  This  method  is 
generally  suited  only  for  superficial  muscles.  Even  though 
recording  sEMG  is  favorable,  it  is  plagued  with  many  issues, 
such  as  crosstalk  from  firing  of  multiple  motor  points  in  the 
vicinity  of  the  recording  location,  which  can  cause  significant 
corruption  of  the  signal  at  that  site,  motion  artifacts,  and  poor 
signal  if  the  motor  unit  is  not  identified  correctly,  etc.  Needle 
electrodes,  on  the  other  hand,  require  trained  medical 
professionals  for  appropriate  placement  of  the  electrodes  in 


the  muscle.  This  paper  investigates  sEMG  signals  only  with 
the  objective  to  extract  intended  finger  forces.  The  sEMG- 
force  relationship  is  modeled  using  Hammerstein- Wiener 
models  to  characterize  the  dynamics.  These  models  would 
characterize  the  controller  dynamics  for  sEMG  based 
prosthetic  hands.  We  look  to  overcome  the  crosstalk  issue  in 
the  measurement  by  using  an  array  of  nine  (9)  sEMG  sensors, 
and  utilizing  spatial  filters  to  isolate  and  improve  the  quality 
of  the  signals  at  the  identified  site  for  EMG  recording.  The 
sensor  array  was  placed  on  the  motor  unit  location,  which  was 
identified  for  the  subject  using  a  muscle  stimulator.  The 
sensors  were  then  placed  around  the  motor  unit  to  form  a  3x3 
square  matrix.  The  processed  signal  was  then  used  for 
identifying  various  dynamical  models  for  the  prediction  of  the 
force,  from  the  recorded  sEMG  signal,  that  was  generated 
during  various  voluntary  contractions  of  the  subjects’  hand.  A 
comparison  of  the  various  outcomes  (model  fit  values 
computed)  from  the  system  identification  process,  using  signal 
processing  techniques  stated  in  the  ISEK  [2]  guidelines  and 
the  spatially  filtered  signals  are  presented  in  this  paper.  The 
experiments  were  conducted  for  long  durations  also,  in  order 
to  analyze  the  effects  of  the  muscle  fatigue  on  the  model 
structures. 

II.  Problem  Formulation 

EMG  signal  should  ideally  be  measured  at  a  motor  unit.  A 
motor  unit  (MU)  consists  of  an  a-motoneuron  in  the  spinal 
cord  and  the  muscle  fiber  it  innervates.  Figure  1  shows  the 
path  of  the  signal  form  the  brain  to  the  muscle. 


sEMG  signals  are  influenced  by  multiple  factors; 
physiological  and  non-physiological  factors.  The 
physiological  factors  are;  A)  Fiber  membrane  properties  and 
B)  Motor  unit  properties.  Fiber  membrane  properties  are 
further  sub-divided  into  i)  Average  muscle  fiber  conduction 
velocity,  ii)  Distribution  of  motor  unit  conduction  velocities, 
iii)  Distribution  of  conduction  velocities  of  the  fibers  within 


the  motor  units  and  iv)  Shape  of  the  intracellular  action 
potentials.  Whereas  the  motor  unit  properties  are  subdivided 
into  i)  Number  of  recruited  motor  units,  ii)  Distribution  of 
motor  unit  discharge  rates,  iii)  Statistics  and  coefficient  of 
variation  of  discharge  rates  and  iv)  Motor  unit 
synchronization. 

The  non-physiological  factors  are;  A)  Antomic,  B) 
Detection  System,  C)  Geometrical  and  D)  Physical.  The 
anatomic  factors  include,  i)  Shape  of  the  volume  conductor,  ii) 
Thickness  of  the  subcutaneous  tissue  layers,  iii)  tissue 
inhomogeneities,  iv)  Distribution  of  the  motor  unit  territories 
in  the  muscle,  v)  Size  of  the  motor  unit  territories,  f) 
distribution  and  the  number  of  fibers  in  the  motor  unit 
territory,  vi)  Distribution  and  number  of  fibers  in  the  motor 
unit  territories,  vii)  Length  of  the  fibers,  viii)  Spread  of  the 
endplates  and  tendon  junctions  within  the  motor  units,  and  ix) 
Spread  of  the  innervations  zones  and  tendon  regions  among 
motor  units.  The  detection  system  used  also  plays  an 
important  part  in  influencing  the  sEMG  measurements.  Some 
of  the  factors  which  need  to  be  taken  into  account,  with  the 
detection  systems,  are  i)  Skin  electrode  contact  (impedance, 
noise),  ii)  Spatial  filtering  for  signal  detection,  iii)  Inter¬ 
electrode  distance,  iv)  Electrode  size  and  shape,  and  v) 
Inclination  of  the  detection  system  relative  to  the  muscle  fiber 
orientation,  and  vi)  Location  of  the  electrodes  over  the 
muscle.  The  geometrical  factors  are,  i)  Muscle  fiber 
shortening  and  ii)  Shift  of  the  muscle  relative  to  the  detection 
system.  And  the  physical  factors  are  i)  Conductivities  of  the 
tissue  and  ii)  Amount  of  crosstalk  from  nearby  muscles  [4]. 
This  is  not  a  comprehensive  list  of  all  the  factors  that 
influence  sEMG  signals  but  provides  an  insight  into  the 
complexity  that  one  might  encounter  while  modeling  sEMG- 
force  or  sEMG-joint  angle  data.  Some  of  the  processing 
methods  implemented  for  EMG  have  been  mentioned  in  [5-9] 

Since  sEMG  is  plagued  by  a  multitude  of  issues,  as  pointed 
out  in  the  previous  paragraph,  one  cannot  approach  this 
problem  by  realistically  trying  to  account  for  each  of  the 
variables  in  the  measurement,  nor  can  one  oversimplify  the 
problem  at  hand  by  assuming  a  simple  linear  or  a  non-linear 
relation  between  the  sEMG  signal  and  the  corresponding 
finger  force  generated.  Hence  the  approach  presented  in  this 
paper  is  to  assume  a  black-box  model  in  order  to  deduce  a 
suitable  relation  or  model  structure  for  the  two  signals.  This 
approach  has  been  found  to  be  of  merit  in  our  previous  studies 
and  has  been  been  reported  in  [10]  &  [1 1]  to  yield  satisfactory 
fits  percentages. 

III.  Problem  Solution 

"Spatial  filtering"  is  broadly  defined  as  a  method  which 
computes  spatial  density  estimates  for  events  that  have  been 
observed  at  individual  locations.  These  filters  are  used  when 
there  is  no  a  priori  curve  to  fit  to  a  data  series.  Instead,  it  relies 
on  nearby  or  adjacent  values  to  estimate  the  value  at  a  given 
point.  These  filters  take  out  variability  in  a  data  set  while 
retaining  the  local  features  of  data.  Spatial  filtering  is 


principally  associated  with  digital  image  processing.  This 
method  may  be  applied  to  almost  any  data  in  the  form  of  a 
grid.  The  most  common  spatial  filters  are  the  low-pass  and 
high-pass  spatial  filters.  These  are  focal  functions  whose 
operation  is  determined  by  a  kernel  or  neighborhood 
of  cells  around  each  pixel  or  grid  position  [12].  Grid 
cells  “covered”  by  a  kernel  are  multiplied  by  the  matching 
kernel  entry  and  then  the  weighted  average  is  calculated  and 
assigned  as  the  value  for  the  central  cell,  G.  For  example,  an 
asymmetric  3x3  kernel  may  look  like  the  one  shown  in 
Equation  (1),  or  any  combination  of  the  weights.  Typically  a, 
b  are  positive  integers.  If  a=b=\,  then  the  kernel  provides  a 
simple  smoothing  or  averaging  operation.  The  weights  in  the 
kernel  can  be  modified  for  specific  cases  or  data  sets.  In  any 
case  the  weighted  average  is  divided  by  the  sum  of  the 
elements  of  the  kernel.  Filters  of  this  type  are  sometimes 
referred  to  as  low-pass  filters. 


Symmetric  Kernel  = 


a  a  a 
aba 
a  a  a 


(1) 


If  the  weights  in  the  kernel  is  similar  to  the  one  in  Equation 
(2)  and  a,  b,  c  are  positive  integers,  and  if  the  following, 
b>a>c,  is  tme,  then  the  kernel  is  described  as  a  Gaussian  filter 
which  is  symmetric  but  center-weighted. 


Symmetric  Kernel  = 


c  a  c 
aba 
c  a  c 


(2) 


The  filtered  grid  value  ‘G’  of  an  m=NxN  kernel  matrix, 
with  Ci  set  of  coefficients  and  Pi  -  set  of  source  grid  values,  is 
calculated  as: 


G  = 


m 

Z  C  A 
i=l  i  ^ 
m 

Ci 

l=\ 


+ 


(3) 


where,  B  is  often  set  to  0.  5  is  a  bias  term  to  increase  or 
decrease  the  resulting  value  of  ‘G'.  This  kernel  is  also 
sometimes  referred  to  as  the  ‘filter  mask’. 


if s  often  more  intuitive  to  work  with  correlation.  The  filtered 
result  g(k,  1)  is  obtained  by  centering  the  mask  over  pixel  {k,  1) 
and  multiplying  the  elements  of  /  with  the  overlapping 
elements  of  the  mask  and  then  adding  them  up.  In  other 
words,  the  objective  is  to  amplify  the  activity  of  motor  unit/s 
located  closest  to  the  recording  site  (ideally  the  actual  motor 
location  for  the  particular  finger)  and  reducing  the  EMG 
signal  generated  by  other  motor  units  located  further  away  or 
motor  units  of  other  fingers.  Other  ways  to  increase  the 
selectivity  of  surface  EMG  recordings  is  by  reducing  the 
electrode  size  (i.e.,  skin-electrode  contact  area  or  inter¬ 
electrode  distance)  [13]  and/or  by  applying  temporal  filters 
[14].  More  recent  work  has  focused  on  advances  in  the  design 
of  surface  electrode  arrays  [15-16]  to  extract  single  motor  unit 
information  from  sEMG.  A  large  number  of  traditional  [17- 
19]  and  adaptive  [20]  linear  spatial  filters  have  been 
extensively  used  to  glean  more  information  out  of  sEMG 
signals  and  to  understand  it  much  better. 

For  this  paper,  the  experiments  were  carried  out  on  a 
healthy  male  subject  to  extract  dynamical  models  describing 
the  relationship  between  sEMG-force  signals.  The  motor 
points  were  located  using  a  Muscle  Stimulator,  manufactured 
by  Rich-Mar  Corporation  (model  number  HV  1100).  The 
motor  location  of  the  ring  finger  was  chosen  for  the 
experiments.  The  EMG  detection  system  used  was  a  Delsys, 
Bagnoli-16  channel  EMG  (DS-160,  S/N-1116).  The  sensors 
used  for  measuring  the  sEMG  action  potentials  were  three 
pronged  DE  3.1  differential  surface  electrodes.  The  subjects’ 
skin  was  prepared,  according  to  the  ISEK  standards,  before 
the  sensors  were  placed  over  the  motor  point.  The  electrodes 
were  placed  along  the  muscle  fibers  (Flexor  Digitorum 
Superficialis)  for  recording  sEMG.  Multiple  sEMG  sensors  in 
an  array  configuration  were  mounted  on  and  around  the 
identified  motor  unit,  as  shown  in  Figure  2. 


Fig.  2  Experimental  Setup  -  Loeation  of  sEMG  sensors 


Linear  Spatial  Filtering:  Linear  spatial  filtering  would 
modify  the  sEMG  array  data  ‘/’  by  replacing  the  value  at  each 
location  with  a  linear  function  of  the  values  of  nearby  data 
points.  Moreover,  this  linear  function  is  assumed  to  be 
independent  of  the  data  point  locations  {k,  /),  where  {k,  1)  are 
the  indices  of  the  data  points  in  f  which  is  represented  by  a 
composite  data  matrix.  This  kind  of  operation  can  be 
expressed  as  convolution  or  correlation.  For  spatial  filtering. 


The  subjects’  hand  was  placed  on  a  flat  surface;  the 
reference  electrode  was  placed  on  the  elbow  where  there  is  no 
sEMG  signal.  Sensor  CHI  was  placed  on  the  identified  motor 
unit  location.  CH2  and  CHS  were  placed  along  the  muscle 
fiber  in  front  and  behind  CHI  respectively.  Channels  4-9  were 
placed  in  the  orientation  as  shown  in  Figure  2.  Nine  different 
experiments  were  conducted  and  the  corresponding  sEMG 


signal  was  measured  simultaneously  from  all  the  nine  sensors. 
The  force  generated  by  the  subject’s  fingers,  for  a  given 
motion,  was  measured  using  a  stress  ball  with  a  force  sensitive 
resistor  (FSR)  mounted  on  it. 

The  change  in  the  resistance  of  the  FSR  is  directly 
proportional  to  the  force  being  applied.  Figure  3  shows  the 
location  of  the  FSR  on  the  stress  ball.  Experiments  1  and  2 
were  used  to  check  for  any  spurious  signals  that  might  be 
recorded  due  to  the  slight  angle  at  which  the  subjects’  hand 
was  held.  Experiments  3  to  6  were  done  using  a  stress  ball 
with  a  lesser  stiffness  as  compared  to  experiments  7,  8  &  9. 

Also,  a  thumb  restrain  was  used  for  experiments  5-9.  The 
thumb  restrain  is  showed  in  the  Figure  3.  The  stress  ball  was 
changed  as  we  were  also  interested  in  looking  at  the  changes 
in  the  sEMG  signal  when  fatigue  occurs,  and  also  how  it 
would  affect  the  modeling  for  the  relation  between  force- 
sEMG  using  System  Identification  (SI). 


Fig.  3  Force  Sensitive  Resistor  and  Thumb  Restrain 


The  linear  spatial  filters  tested  in  this  paper  for  isolating  the 
motor  unit  action  potentials  (MUAPs)  are;  1)  Longitudinal 
Single  Differential  (LSD),  2)  Transverse  Single  Differential 
(TSD),  3)  Longitudinal  Double  Differential  (LDD),  4) 
Transverse  Double  Differential  (TDD),  5)  Normal  Double 
Differential  (NDD),  6)  Inverse  Binomial  (IB2)  and  7)  Inverse 
Rectangular  (IR)  Filter.  The  mask  of  these  filters  and  the 
corresponding  resultant  equations  on  application  of  the  mask 
to  the  grid  data  obtained  from  the  sEMG  array  arrangement 
are  given  below. 
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LSD  Equation  =  sEMGl-sEMG2;  TSD  Equation  =  sEMGl - 
sEMG5.  We  can  similarly  deduce  the  equations  for  the 
other  spatial  filters. 
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In  this  paper,  nonlinear  spatial  filters  have  also  been 
discussed  these  have  been  reported  in  literature  [21].  These 
are  1)  1-D  Nonlinear  Transverse  spatial  filter  (NET),  2)  1-D 
Nonlinear  Longitudinal  spatial  filter  (NEE),  3)  2-D  Nonlinear 
spatial  filter  in  Two-  Orthogonal  Directions  (NLTOD)  and  4) 
Nonlinear  spatial  filter  in  All  Four  possible  Directions 
(NLAFD).  The  nonlinear  spatial  filters  use  the  Teager-Kaiser 
Energy  (TKE)  Operator,  [22].  This  technique  is  a  threshold 
‘energy’  based  approach  where  outliers  are  first  detected  and 
then  replaced  by  their  estimated  values.  This  nonlinear 
operator  differs  from  the  common  way  to  calculate  the  energy 
of  a  discrete-time  signal  as  the  average  sum  of  its  squared 
magnitudes.  The  energy  of  a  generating  system  of  a  simple 
oscillation  signal  was  computed  as  the  product  of  the  square 
of  the  amplitude  and  the  frequency  of  the  signal.  It  was  found 
that  this  nonlinear  operator  exhibits  several  attractive  features 
such  as  simplicity,  efficiency  and  ability  to  track 
instantaneously-varying  special  patterns.  Since  its 
introduction,  several  applications  have  been  derived  for  one¬ 
dimensional  [23-24],  and  two  dimensional  signal  processing 
[25].  The  nonlinear  spatial  filters  with  the  TKE  operator 
incorporated  are  given  as  follows;  the  general  form  of 
nonlinear  spatial  filter  using  the  (TKE)  operator  is  given  in 
Equation  (4); 

^[x{ny\  =  x^{n)- x{n  +  \)x{n-\)  (4) 

a)  1-D  Nonlinear  Transverse  Spatial  Filter  (NET);  Equation 

(5) 

2 

j  ^  [x(m,  f7)]  =  X  {m,n)  -  x{m -\,n)x{m +  \,n)  (5) 
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Result  Equation: 


b)  1-D  Nonlinear  Longitudinal  Spatial  Filter  (NEE);  Equation 

(6) 


(8) 


^  j  ^  [x(m,  f7)]  =  X  {m,n)  -  x{m,n -\)x{m,n +  \)  (6) 

c)  Nonlinear  Spatial  Filter  in  Two  Orthogonal  Directions 
(NLTOD):  Equation  (7) 

'^d,2  =  '^d,2m  '^d,n 

2 

=2x  (m,  n)  -  x(m  - 1,  n)x{m  +  \,n)-  x(m,  n  -  l)x(m,  n-\-l) 

d)  Nonlinear  Spatial  Filter  in  all  Four  Directions  (NLAFD): 
Equation  (8) 


^ d  4  ^)]  “  ~  +  h  n) 
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IV.  Simulation  Results 

Plots  of  the  raw  data  gathered  are  shown  in  Figure  4.  The 
plots  shown  in  Figure  4  represent  the  raw  data  collected 
from  the  nine  channels  of  the  sensor  grid  in  the  same 
orientation  as  shows  in  Figure  2. 
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Fig.  4  sEMG  Raw  Signal  Channels  1-9  &  the  eorresponding  Foree  signal 


The  data  shown  in  Figure  4  is  for  comparison  of  the  sEMG 
obtained  from  various  location  of  the  subject’s  arm.  Notice  the 
change  especially  in  the  amplitude  of  the  sEMG  at  Channel  1, 
4  &  5.  Figure  5  shows  the  filtered  sEMG  (location  CHI)  at  the 
motor  point  using  four  (4)  HR  filters;  1)  Bessel  2) 
Butterworth,  3)  Chebyshev  Type  I  and  4)  Chebyshev  Type  IT 
The  filter  characteristics  of  these  4  filters  were  in  accordance 
to  the  ISEK  standards. 

Figure  6  plots  the  filtered  sEMG  signal  data  from  the  sensor 


array  after  they  were  filtered  using  various  spatial  filters.  In 
addition  to  these  11  spatial  filters.  The  relation  of  sEMG- 
Force  was  modeled  using  Non-Linear  Hammerstein- Wiener 
models.  This  modeling  method  has  been  proven  to  work  in  the 
past  [10],  [1 1]  in  assuming  a  black-box  model  structure  for  the 
system.  In  order  to  model  the  sEMG-Force  relation,  the 
filtered  data  from  the  various  experiments  was  split  into 
various  four  (4)  time  windows. 


sEMG1  -  Bessel  Filtered 


Samples 

sEMG1  -  Chebyshev  Type  I  Filtered 


sEMG1  -  Butterworth  Filtered 


Samples 

sEMG1  -  Chebyshev  Type  II  Filtered 


Fig.  5  sEMGl  at  Motor  Point  (CH  1)  Filtered  using  HR  Filters;  Bessel,  Butterworth,  Chebyshev  I  &  Chebyshev  II 


sEMG1  -  Longitudnal  Single  Differential 


sEMG1  -  Transverse  Double  Differential 


sEMG1  -  Transverse  Single  Differential 


sEMG1  -  Longitudnal  Double  Differential 
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sEMG1  -  Normal  Double  Differential 


sEMG1  -  Inverse  Binomial  2-D 


sEMG1  -  Inverse  Rectangular 


Fig.  6  sEMGl  at  Motor  Point  of  Ring  Finger  (CH  1)  Filtered  using  Linear  Spatial  Filters;  LSD,  TSD,  LDD,  TDD,  NDD,  IB2  &  IR 


Equation  9  describes  the  general  Hammerstein- Wiener  model 
structure: 

w(0  =  /((g(0),  Z>(0  =  4^^w(0,  y{t)  =  h{x{t)),  (9) 

Fj,  M) 

where,  w{t)  and  b{t)  are  internal  variables,  w{t)  has  the  same 
dimensions  as  u{t)  -  input,  and  x(^)  has  the  same  dimensions 
as  y{t)  -  output.  g()  and  hQ)  are  the  input  and  output  non¬ 
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linearity  functions  respectively.  B{q)  and  F{q)  are  regression 
polynomials.  The  model  fit  values  are  computed  using 
Equation  (10)  as  follows; 

1  “  Ilf  “  V II 

//7  =  1  00  *  II  II  II  (10) 

\\y-  y\\ 

where,  y  is  the  estimated  output  by  the  model. 
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Fig.  7  Variations  in  Force  levels;  experiment  3,  4,  6,  7,  8  &  9 


The  time  windows  used  for  estimation  and  validation  of  the 
models  were  called  ‘ze '  and  ‘zv '  respectively,  ‘ze '  contained 
8000  sample  points  and  ‘zv '  contained  data  points  shifted  by 
2000  sample  points.  For  example,  if  ‘ze'  was  a  time  window 
between  2-6  seconds  i.e.  samples  4000-12000,  then  ‘zv'  was 
between  3-7  seconds  i.e.  6000-14000  samples.  Thus  the 
Hammerstein- Wiener  method  uses  ‘ze '  to  estimate  the  model 
structure  and  based  on  this  information  predicts  the  next  2000 
sample  points.  The  data  was  filtered  using  the  various  filters 
mentioned  in  the  previous  sections.  We  would  like  to  stress 
once  again  the  point  that  the  force  was  varied  randomly  and 
the  subject  was  in  no  way  trying  to  achieve  maximum 
voluntary  contractions  during  each  cycle.  A  cycle  is  defined  as 
the  subject  starting  without  any  force  on  the  stress  ball, 
squeezing  it  (to  any  force  level)  and  then  going  back  to  no 
force.  The  subject  has  to  keep  the  finger  in  contact  with  the 
force  ball  throughout  this  cycle. 

A  plot  of  the  variations  in  force  achieved  for  6  experiments 
is  shown  in  Figure  7.  The  Matlab™  code  for  the 
Hammer  stein- Wiener  model  is:  nlhw(ze,  [n^  \  .....  ...). 

The  modeling  was  carried  out  by  varying  -  the  number  of 
past  output  terms  used  to  predict  the  current  output,  -  the 


number  of  past  input  terms  used  to  predict  the  current  output 
and  rij^-  the  delay  from  input  and  output  in  terms  of  the 

number  of  samples  for  the  various  Hammerstein- Wiener 
models. 

42  models  with  variations  in  and  were  tested  while 

the  value  of  was  kept  as  1.  The  total  number  of  models 

estimated  were  15  (filter  types)  x  4  (time  windows)  x  42 
models  per  time  window  x  4  experiments  =  10,080  models. 
This  paper  does  not  list  all  these  models  but  identifies  and 
reports  only  the  significant  results  of  the  analysis. 

As  an  example,  for  experiment  3,  for  time  window  of  2-7 

sec,  the  fit  values  obtained  by  varying  between  2-7  and 
between  3-9,  are  shown  in  Figure  8.  Figure  8  contains  a  lot 

of  information  as  it  shows  49  models  fit  percentages  for  each 
of  the  HR  and  spatial  filter  types  tested.  The  large  variation  in 
the  model  fit  values  can  be  attributed  to  the  fact  that  the  two 
data  sets  have  poor  correlation  between  one  another.  The 
significant  result,  for  this  time  section,  were  noted  for  the 
Bessel  and  NLTO  filters,  these  are  plotted  in  Figure  9 

The  predicted  model  output  plots  for  these  values  are 
shown  in  Figure  10. 
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Fig.  8  Fit  %  for  Hammerstein- Wiener  Models  -  Various  HR  &  Spatial  Filters  (time  window  2-7  see,  exp3) 
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Fig.  9  Fit  %  for  Hammerstein- Wiener  Models  -  Bessel  &  NLTO  (time  window  2-7  see,  exp3) 


The  other  filters  used  also  predict  the  future  variations  in 
force  but  the  fit  percentages  were  in  the  range  of  30-48%.  A 
key  objective  of  this  research  is  help  develop  a  control  regime 
which  in  not  based  on  threshold  values  of  force  can 
incorporate  the  dynamics  in  the  force.  This  would  help  to 
control  the  response  of  the  artificial  limb  to  be  closer  to  that  of 
the  actual  hand.  Similarly  we  tested  various  models  for  the 
other  experiments  too.  Another  set  of  results  which  gave  very 


high  values  of  fit  was  for  the  later  time  windows.  This  case 
was  especially  interesting  as  the  subject  had  fatigued  due  to 
the  repetitive  experiments,  but  the  Hammerstein- Wiener 
models  did  successfully  capture  the  variations  in  the  sEMG 
signal.  The  Hammerstein- Wiener  models  performed  very  well 
even  as  the  sEMG  signal  changed  and  we  obtained  fit  values 
in  the  high  sixties. 
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Fig.  10  Measured  data  (blaek)  a)  Bessel  (blue)  56.36%  and  b)  NLTO  (red)  60.13%  for  exp  3  time  window  2-7seeonds. 

Figure  1 1  shows  the  model  fit  values  obtained  for  these  later  expectations  the  Hammerstein- Wiener  Models  performed  very 
data  windows.  As  can  be  seen  from  the  plots,  contrary  to  our  well  and  produced  very  good  fit  values. 
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Fig.  1 1  Fit  Values  Obtained  for  Different  Hammerstein- Wiener  Models  -  Bessel,  NLTO  NLT,  TDD,  NDD,  NLAFD  Filters  (time  window 

20-25  see,  exp5) 


Figure  12,  13  and  14  shows  the  model  output  plots  for  some 
of  the  filters  mentioned  in  Figure  11.  The  only  HR  filter 
whose  performance  matched,  and  in  a  few  cases  exceeded,  the 
performance  of  the  linear  and  the  non-linear  spatial  filters  was 
the  Bessel  filter.  As  can  be  seen  from  Figure  12  the  Bessel 


filter  modeled  the  sEMG-force  relation  to  52.85  %  though  this 
is  a  slightly  lower  value  than  the  Butterworth  filter  mentioned, 
the  spread  of  the  model  fit  values  was  more  consistent  in  the 
range  of  45-50%  as  compared  to  the  Butterworth  filter  which 
had  a  far  more  spread  out  distribution. 
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Fig.  12  Measured  Data  (Blaek)  &  Estimated  Data  (Blue) 
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Fig.  13  Measured  Data  (Blaek)  &  Estimated  Data  (Blue) 


V.  Conclusion 

The  Hammerstein- Wiener  models  worked  very  well  in 
capturing  the  dynamics  of  the  force  levels  for  the  various 
experiments  conducted.  This  method  of  modeling  could  help 


in  improving  the  control  over  the  motors  used  in  prosthetic 
devices  to  mimic  the  actual  changes  force  levels  in  a  real 
hand.  This  method  also  performed  very  well  in  the  scenarios 
where  the  subject  did  fatigue  but  the  affects  were  successfully 


yi  (■imi 


E»ilimaled 


m29=[6”  I]:  "n."«  (NI-AFD) 

fl.  CBim) 


Fig.  14  Measured  Data  (Blaek)  &  Estimated  Data  (Blue) 


modeled  by  the  Hammer stein-Wiener  models.  The  nonlinear 
and  linear  spatial  filters  (TDD,  NDD  and  NET,  NLTO  and 
NLAFD)  did  outperform  the  other  filtering  methods  used 
especially  for  the  later  time  windows.  The  only  other  filter 
which  had  a  comparable  performance  to  the  spatial  filters  was 
the  Bessel  filter.  Further  investigation  into  reducing  the  wide 
range  of  the  fit  values  obtained  needs  to  be  performed.  One  of 
the  possible  methods  to  pursue  would  be  to  use  Genetic 
Algorithm  to  optimize  the  model  parameters  and  and 

also  the  number  of  iterations  used  for  the  modeling  of  sEMG- 
force  levels.  One  of  the  possible  reasons  for  poor  fit  values 
could  also  be  attributed  to  the  model  trying  to  over-fit  the  data 
sets. 
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Spatial  filter  masks  optimization  using 
genetic  algorithm  and  modeling  dynamic 
behavior  of  sEMG  and  finger  force  signals 
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Abstract  —  Electromyography  (EMG)  signals  are  widely  used  for 
clinical  and  biomedical  applications.  One  of  the  rapidly  advancing 
fields  of  application  of  EMG  is  in  the  control  of  smart  prosthetic 
devices  for  rehabilitation  purposes.  This  paper  presents  the 
investigation  of  the  use  of  System  Identification  (SI)  for  modeling 
sEMG-Finger  force  relation  in  the  pursuit  of  improving  the  control  of 
a  smart  prosthetic  hand.  Finger  force  and  sEMG  data  are  generated 
by  having  the  subject  perform  a  number  of  random  motions  of  the 
ring  finger  to  simulate  various  force  levels.  Post-processing  of  the 
sEMG  signal  is  performed  using  spatial  filtering.  The  linear  and 
nonlinear  spatial  filters  are  compared  based  on  the  ‘kurtosis’ 
improvements  and  also  based  on  the  fit  values  of  the  models  obtained 
using  system  identification,  in  particular  the  Hammerstein- Wiener 
models.  The  results  of  the  modeling  using  linear  spatial  filters  were 
found  to  be  in  the  region  of  30-45%,  some  of  these  linear  spatial 
filter  masks  were  selected  randomly  to  investigate  if  there  is  any 
improvement  in  modeling  the  sEMG-force  relation.  The  spatial  filter 
masks  are  optimized  using  a  Genetic  Algorithm  (GA)  for  two 
conditions;  constrained  and  unconstrained.  The  model  fit  values  of 
the  identified  models  are  used  as  the  cost  function  in  the  GA 
optimization  scheme.  The  results  are  compared  to  the  reported  filter 
mask  values  in  the  literature.  The  unconstrained  GA  based  filter 
mask  values  and  in  some  instances  the  constrained  GA  based  mask 
values  perform  better  than  the  filter  masks  reported  in  literature  in  24 
out  of  the  26  cases  tested. 

Keywords —  Spatial  Filtering,  System  Identification,  Surface 
Electromyogram,  Sensor  Array,  Genetic  Algorithm, 
Hammerstein-Wiener  Modeling. 

I.  Introduction 

N  the  United  States  there  are  approximately  1.7  million 
people  living  with  limb  loss  [1].  It  is  estimated  that  one  out 
of  every  200  people  in  the  U.S.  has  had  an  amputation  [2].  An 
ideal  prosthetic  hand  has  to  be  dexterous;  easy  to  manufacture, 
must  use  little  power  and  at  the  same  time,  must  be  of  low 
cost.  Building  such  a  prosthetic  hand,  which  can  mimic  the 
entire  gamut  of  motions  and  have  the  functionality  and 
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dexterity  of  a  human  hand  exactly,  has  eluded  researchers  so 
far.  Most  of  the  hand  grasping  motions  that  a  prosthetic  device 
would  need  to  perform  have  been  classified  by  Feix  [3].  One 
of  the  main  strategies  used  in  making  a  prosthetic  hand  “user 
friendly”  is  to  use  the  electromyogram  (EMG)  signal  to 
control  a  prosthetic  device.  An  EMG  signal  is  a  small  voltage 
signal  (in  mV)  which  is  generated  by  skeletal  muscles.  EMG 
signals  have  a  wide  range  of  applications  in  the  fields  of 
medicine  (orthopedic,  surgery,  functional  neurology  and  gait 
and  posture  analysis),  rehabilitation  (post  surgery/accident, 
neurological  rehabilitation,  physical  therapy  and  active 
training  therapy),  ergonomics  (risk  prevention,  ergonomic 
design,  etc.)  and  sports  science  (biomechanics,  movement 
analysis,  athlete  strength  training  and  sports  rehabilitation). 
EMG  is  measured  using  fine  wire  intramuscular  electrodes, 
needle  electrodes,  or  on  the  surface  of  the  skin  over  the  motor 
point  using  surface  electrodes.  Surface  electrodes  are  quick 
and  easy  to  apply,  do  not  need  medical  supervision,  cause 
minimal  discomfort  and  are  generally  suited  for  superficial 
muscles.  Needle  electrodes  on  the  other  hand  require  trained 
medical  professionals  for  appropriate  placement  within  the 
muscle.  The  study  of  EMG  signals,  whether  they  are  recorded 
using  needle  sensors  or  by  placing  electrodes  on  the  surface  of 
the  skin,  can  provide  a  window  into  the  fascinating  world  of 
how  the  motors  of  our  body  work  seamlessly  to  meet  the 
rigorous  demands  we  place  on  them.  The  first  investigator  of 
EMG  signals  is  considered  to  be  H.  Piper  in  1912,  [4].  Since 
then,  there  have  been  significant  advances  in  the  field  of  EMG 
signaling.  Now,  we  have  a  much  better  understanding  of  what 
information  can  be  derived  from  EMG  signals  and  the  various 
applications  they  could  be  used  for.  Needle  EMG  sensors  are 
considered  more  accurate  than  surface  EMG  methods,  as  they 
can  detect  Motor  Unit  Action  Potentials  (MUAPs)  in  a  very 
small  volume,  as  small  as  a  tip  of  a  needle.  Nonetheless, 
surface  EMG  signals  also,  are  used  in  a  large  number  of 
applications.  One  must  be  careful  though,  when  drawing 
“conclusions”  using  surface  EMG  signals,  [5]. 

Surface  EMG  signals  have  a  variety  of  clinical  and 
engineering  applications.  Few  of  the  clinical  applications 
include  a)  kinesiologic  analysis  of  movement  disorders,  b) 
differentiating  types  of  tremors,  myoclonus,  and  dystonia,  c) 
for  evaluating  gait  and  posture  disturbances,  and  for 
evaluating  psychophysical  measures  of  reaction  and 
movement  time,  [6].  Engineering  applications  include  a) 


interpretation  of  neural  control  signals  for  research,  [7],  b) 
extraction  of  command  signal  for  control  of  prosthetic  or 
robotic  devices,  [8-10]  to  name  a  few. 

This  paper  deals  with  surface  electromyogram  signals 
(sEMG).  In  the  past,  multiple  methods  have  been  investigated 
for  extracting  useful  information  from  EMG  signals.  Some  of 
these  methods  include  employing  low-pass  or  band-pass 
filtering;  others  have  also  used  notch  filtering  to  remove 
power  line  noise,  [11].  Whitening  filters  can  increase  the 
quality  of  the  amplitude  estimates  of  the  sEMG  signals,  [12]. 
Other  methods  include  Markov  models,  [13]  and  fuzzy  logic 
control,  [14]  -  for  classification  of  EMG,  and  wavelet 
processing,  [15].  Currently,  the  accepted  standardized  method 
on  how  EMG  signals  must  be  recorded  and  analyzed  is  set  by 
the  International  Society  of  Electromyography  and 
Kinesiology  (ISEK)  [16]. 

The  EMG  signal  is  a  complicated  signal,  which  is 
controlled  by  the  nervous  system  and  is  dependent  on  the 
anatomical  and  physiological  properties  of  muscles.  EMG 
signal  acquires  noise  while  traveling  through  different  tissues. 
Moreover,  the  EMG  detector,  particularly  surface  electrodes 
collects  signals  from  different  motor  units  simultaneously 
which  may  have  been  generated  through  the  interaction  of 


different  motor  unit  signals.  sEMG  signals  are  influenced  by 
multiple  factors,  some  of  which  are;  a)  shape  of  the  volume 
conductor,  b)  the  thickness  of  the  subcutaneous  tissue  layers, 
c)  tissue  inhomogeneities,  d)  distribution  of  the  motor  unit 
territories  in  the  muscle,  e)  size  of  the  motor  unit  territories,  f) 
distribution  and  the  number  of  fibers  in  the  motor  unit 
territory,  g)  length  of  the  fibers,  h)  spread  of  the  endplates  and 
tendon  junctions  within  the  motor  units,  and  i)  spread  of  the 
innervations  zones  and  tendon  regions  among  motor  units. 
The  type  of  detection  system  used  also  plays  an  important  part 
in  influencing  the  sEMG  measurements.  Some  of  the  factors 
which  need  to  be  taken  into  account,  with  the  detection 
systems,  are  a)  skin  electrode  contact  (impedance,  noise),  b) 
spatial  filtering  for  signal  detection,  c)  inter-electrode 
distance,  d)  electrode  size  and  shape,  and  e)  inclination  of  the 
detection  system  relative  to  the  muscle  fiber  orientation,  [17]. 
Some  of  the  processing  methods  implemented  for  EMG 
processing  have  been  mentioned  in  [18-22].  Fig.  1  shows  the 
locations  where  surface  EMG  electrodes  might  be  placed  in 
the  vicinity  of  a  muscle  and  the  underlying  anatomy  of  a 
muscle. 
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Fig.  1  Muscle  anatomy  &  surface  electrodes  placement  [23] 


II.  Problem  Formulation 

Measurement  of  a  surface  EMG  signal,  along  with  an  actual 
recorded  sEMG  signal  is  shown  in  Fig.  2  (a).  This  EMG 
signal  was  obtained  from  a  healthy  male  subject.  The  subject 
had  performed  squeezing  of  a  stress  ball  with  a  force  sensitive 
resistor  (FSR)  mounted  on  it.  The  change  in  the  resistance  of 
the  FSR  is  correlated  to  the  various  force  level  that  the  subject 


could  generate.  Fig.  2  (b)  shows  the  sEMG  plot  and  the 
corresponding  change  in  force  for  one  of  the  experiments 
performed.  As  can  be  seen  the  sEMG  signal  is  very  noisy,  it 
must  have  been  affected  by  any  of  the  factors  that  are 
mentioned  in  the  previous  section.  Another  important  factor 
that  influences  sEMG  signals  is  cross-talk  from  the 


neighboring  motor  units  of  the  muscle.  All  these  factors 
modify  the  underlying  signal  for  a  given  contraction  and 
relaxation  of  the  subject’s  muscle.  Many  previous  works  make 
different  assumptions  while  modeling  the  sEMG-force 
relation;  like  for  example,  in  the  simplest  form  assuming  a 
linear  relation  between  sEMG  &  force,  developing  transfer 
functions  of  the  hand  without  including  the  different  factors 
influencing  the  sEMG  signal  or  using  the  root-mean-squared 
(RMS)  value  of  the  sEMG  signal  in  order  to  formulate 
simplified  models. 

In  reality  it  is  impossible  to  account  for  all  the  factors 
influencing  the  sEMG  signal.  However,  by  making  some  of 
the  assumptions  mentioned  earlier,  one  might  end  up  with  a 


deficient  model  relating  the  sEMG-force  data.  The  underlying 
dynamics  of  the  sEMG  signal  may  be  lost  in  the  process  of 
oversimplification.  In  order  to  avoid  some  of  these  pitfalls  our 
approach  is  to  assume  a  black-box  model  to  deduce  a  suitable 
relation  or  model  structure  for  the  two  signals.  Here,  the 
modeling  of  the  sEMG-finger  force  relation  is  not  based  on 
root-mean-square,  or  average  values  of  the  sEMG  signal, 
hence,  we  facilitate  the  capture  of  the  dynamical  changes  in 
the  force  levels.  Our  approach  of  using  Hammerstein- Wiener 
models  has  been  found  to  be  of  merit  in  our  previous  studies 
[24,  25]  and  have  yielded  satisfactory  fits. 
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Fig.  2  (a)  Measurement  of  sEMG  &  actual  sEMG  from  test  subject,  (b)  Force  and  corresponding  sEMG 


III.  Problem  Solution 

The  data  collected  is  from  a  nine  (3x3)  sensor  array  and 
rather  than  analyzing  the  data  only  at  the  motor  unit,  we 
considered  using  spatial  filters.  Spatial  filtering  is  a  very 
attractive  choice  as  it  can  be  used  to  either  amplify  the  signal 
at  the  motor  unit  or  extract  useful  information  from  the  entire 
grid.  "Spatial  filtering"  is  broadly  defined  as  a  method  which 
computes  spatial  density  estimates  for  events  that  have  been 
observed  at  individual  locations.  These  filters  are  used  when 
there  is  no  a  priori  curve  to  fit  to  a  data  series.  Instead,  it  relies 
on  nearby  or  adjacent,  values  to  estimate  the  value  at  a  given 


point.  The  most  common  spatial  filters  are  the  low-pass  and 
high-pass  spatial  filters.  These  are  focal  functions  whose 
operation  is  determined  by  a  kernel  or  neighborhood  of  NxN 
cells  around  each  pixel  or  grid  position  [26].  Grid  cells 
“covered”  by  a  kernel  are  multiplied  by  the  matching  kernel 
entry  and  then  the  weighted  average  is  calculated  and  assigned 
as  the  value  for  the  central  cell,  G.  For  example,  an 
asymmetric  3x3  kernel  may  look  like  the  one  shown  in 
Equation  (1),  or  any  combination  of  the  weights.  Typically  a, 
b  are  positive  integers.  If  a=Z?=I,  then  the  kernel  provides  a 
simple  smoothing  or  averaging  operation.  Filters  of  this  type 
are  sometimes  referred  to  as  low-pass  filters. 


Symmetric  Kernel  = 


a  a  a 

aba.  ^2) 
a  a  a 

The  filtered  grid  value  ‘G’  of  an  m=NxN  kernel  matrix, 
with  Cf  set  of  coefficients  and  Pf  -  set  of  source  grid  values,  is 
calculated  as; 
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C  . 


where,  B  is  often  set  to  0.  5  is  a  bias  term  to  increase  or 
decrease  the  resulting  value  of  ‘G'.  This  kernel  is  also 
sometimes  referred  to  as  the  ‘filter  mask’.  The  linear  spatial 
filters  tested  in  this  paper  are;  1)  Longitudinal  Single 
Differential  (LSD),  2)  Transverse  Single  Differential  (TSD), 
3)  Longitudinal  Double  Differential  (LDD),  4)  Transverse 
Double  Differential  (TDD),  5)  Normal  Double  Differential 
(NDD),  6)  Inverse  Binomial  (IB2)  and  7)  Inverse  Rectangular 
(IR)  Filter.  The  mask  of  these  filters  and  the  corresponding 
resultant  equations  on  application  of  the  mask  to  the  grid  data 
obtained  from  the  sEMG  array  arrangement  are  given  below. 

EMG  Array  Information,  Spatial  Filter  Mask 


sEMGl 

sEMGS 

sEMG6 

0 

0 

0 

sEMG2 

sEMGl 

sEMG3 

-1 

1 

0 

sEMG^ 

sEMGA 

sEMG9 

0  0  0  _ 
Result  Equation:  -  sEMG2  +  sEMGl 


“0 

-1 

0“ 

“0 

0 

0“ 

“0 

-1  0“ 

TSD= 

0 

1 

0 

LDD= 

-1 

2  -1 

TDD  = 

0 

2  0 

_0 

0 

0_ 

_0 

0 

0_ 

_0 

-1  0_ 

9  9 


LSD  Equation  =  sEMGl-sEMG2;  TSD  Equation  =  sEMGl- 
sEMG5;  we  can  similarly  deduce  the  equations  for  the  other 
spatial  filters. 
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In  this  paper,  some  nonlinear  spatial  filters  have  also  been 
discussed,  these  have  been  reported  in  the  literature  [27],  these 
are  1)  1-D  Nonlinear  Transverse  spatial  filter  (NLT),  2)  1-D 
Nonlinear  Longitudinal  spatial  filter  (NLL),  3)  2-D  Nonlinear 
spatial  filter  in  Two-  Orthogonal  Directions  (NLTOD)  and  4) 
Nonlinear  spatial  filter  in  All  Four  possible  Directions 
(NLAFD).  The  Nonlinear  Spatial  Filters  use  the  Teager- 
Kaiser  Energy  (TKE)  Operator  [28].  This  technique  is  a 
threshold  ‘energy’  based  approach  where  outliers  are  first 


detected  and  then  replaced  by  their  estimated  values.  General 
Form  of  Nonlinear  Spatial  Filter  using  the  Teager-Kaiser 
(TKE)  operator  is  given  in  equation  (4),  where  x(n)  denotes 
the  location  of  the  sensor  in  the  grid; 

'¥[x{n)]  =  x^in)-xin  +  l)x{n-l).  (4) 

a)  1-D  Nonlinear  Transverse  Spatial  Filter  (NLT);  equation 

(5) 

2 

j  ^  [x(m, /?)]  =  X  (m,n)  -  x(m -l,n)x(m +  l,n).  (5) 

where,  d  ,is  the  subscript  for  the  dimension,  for  the  1-D  filters  it  is  1  and  m 
denotes  the  longitudinal  direction  i.e.  along  the  muscle  fiber. 

b)  1-D  Nonlinear  Longitudinal  Spatial  Filter  (NLL);  equation 

(6) 

2 

'F  j  ^  [x(w,  ft)]  =  X  {m,n)  -  x{m,n -\)x{m,n +  \).  (6) 

n  denotes  the  transverse  direction  i.e.  perpendicular  to  the  muscle  fiber. 

c)  Nonlinear  Spatial  Filter  in  Two  Orthogonal  Directions 
(NLTOD);  equation  (7) 

2 

=2x  (m,  n)  -  x{m  -  1,  n)x{m  +  1,  ft)  -  x(m,  n  -  l)x(m,  n  +  1). 

d)  Nonlinear  Spatial  Filter  in  all  Four  Directions  (NLAFD); 
equation  (8) 

2 

'F  r  ^[x(ff2,  ft)]  =  4x  (fft,  ft)  -  x(fft  - 1,  ft)x(fft  +  1,  ft) 

u 

-x(ftt,  ft  -  l)x(fft,  n  +  \)-  x(m  -\,n  +  l)x(m  +  \,n-\) 

-x(m  - 1,  ft  -  l)x(ftt  +  1,  ft  +  1). 

The  experiments  were  carried  out  on  a  healthy  male  subject. 
The  ring  finger  motor  point  was  located  using  a  muscle 
stimulator,  manufactured  by  Rich-Mar  Corporation  (model 
number  HV  1100).  Fig.  3  shows  a  picture  of  the  Muscle 
Stimulator  used.  The  EMG  detection  system  used  was  a 
Delsys,  Bagnoli-16  channel  EMG  (DS-160,  S/N-1116).  The 
sensors  used  for  measuring  the  surface  EMG  action  potentials 
were  three  pronged  DE  3.1  differential  surface  electrodes. 


Fig.  3  Muscle  stimulator 

The  material  for  the  contacts  of  the  electrode  is  99.9%  pure 


silver,  the  contacts  are  10mm  long,  1mm  in  diameter  and 
spaced  10mm  apart.  The  subjects’  skin  was  prepared, 
according  to  the  ISEK  standards,  before  the  sensors  were 
placed  over  the  motor  point.  The  electrodes  were  placed  along 
the  muscle  fibers  (Flexor  Digitorum  Superficialis)  for 
recording  surface  EMG.  The  reference  electrode  was  placed 
on  the  elbow  where  there  is  no  sEMG  signal.  Nine  different 
experiments  were  conducted  and  the  corresponding  sEMG 
signal  was  measured  simultaneously  from  all  the  nine  (9) 
sensors.  The  force  generated  by  the  subject’s  fingers,  for  a 
given  motion,  was  measured  using  a  stress  ball  with  a  force 
sensitive  resistor  (FSR)  mounted  on  it.  Fig.  4  shows  the 
location  of  the  FSR  on  the  stress  ball. 


Fig.  4  Force  sensitive  resistor  and  thumb  restrain 


System  Identification 

System  Identification  (SI)  has  its  roots  in  standard  statistical 
techniques,  such  as  least-squares  and  maximum  likelihood 
methods,  for  instance.  SI  helps  the  user  to  build  mathematical 
models  of  a  dynamic  system  based  on  measured  data.  This  is 
done  by  adjusting  the  parameters  within  a  given  model  until 
its  output  emulates  the  measured  input  in  some  minimum 
fashion,  [29].  System  identification  is  especially  usehil  for 
modeling  systems  that  cannot  be  easily  represented  in  terms  of 
first  principles  or  know  physical  laws.  In  this  case,  one  can 
use  SI  to  perform  black-box  modeling,  where  the  measured 
data  determines  the  model  structure. 

Black-box  modeling  has  the  following  advantages;  1)  the 
structure  and  the  order  of  the  model  need  not  be  known,  and 
2)  many  model  structures  can  be  estimated  and  compared,  and 
the  best  among  them  can  be  selected  to  suit  the  measured  data 
sets.  Systems  that  can  be  represented  using  ordinary 
difference  or  differential  equations  can  be  modeled  using 
grey-box  models.  Grey-box  models  have  a  known 
mathematical  structure  and  unknown  parameters  and  they 
have  the  following  advantages  over  black-box  models;  1) 
Known  constraints  can  be  imposed  on  the  model 
characteristics,  2)  there  are  fewer  model  parameters  to 
estimate,  3)  coupling  between  parameters  can  be  defined  in 
the  model  structure,  and  4)  in  the  non-linear  case  the  dynamic 
equations  can  be  specified  dynamically. 

The  most  common  system  identification  models  in 
engineering  are  Auto-Regressive  with  exogenous  input 
(ARX)  and  Auto-Regressive  Moving  Average  with 


exogenous  input  (ARMAX).  The  more  recent  additions  to 
system  identification  have  been  black-box  models  with  a  non¬ 
linear  structure  such  as  Artificial  Neural  Networks,  Fuzzy 
models  and  so  on. 

The  most  basic  relationship  between  the  input  and  the 
output  of  a  system  can  be  given  by  a  linear  difference 
equation,  [30]  such  as: 

y{t)  +  a^y{t  - 1)  + . . .  +  a^^yit  -n)  =  byi{t  - 1)  + . .  \u(t  -  m)  ,  (9) 

where,  are  the  input  and  output  of  the  system  at  time  t 
respectively,  and  are  the  parameters  of  the  system. 

d  =  [a^,...,a„bi,...,b„f  ,  (10) 

where,  is  the  parametric  vector  with  coefficients  and  . 

(p(t)  =  \_-y{t  - 1)...  -  y{t  -  n)u(t  -  -  m)f  ,  (1 1) 

then  we  can  write:  y{t)  =  <p  ,  (12) 

where,  (p{t)  is  the  regression  vector. 

Generally,  a  model  structure  is  a  parameterized  mapping  from 
past  inputs  and  outputs  to  the  space  of  the  model  outputs, 
[31]: 

m0)=gio,z^~')  ,  (13) 

where,  is  the  predicted  output. 

In  practice  most  of  the  systems  are  nonlinear  and  the  output 
is  a  non-linear  function  of  the  input  variables.  However,  linear 
models  often  sufficiently  and  accurately  describe  system 
dynamics.  While  modeling  a  system  using  grey-box  models, 
the  linear  and  the  nonlinear  structures  can  be  set  using  its 
differential  or  difference  equations.  Since  linear  models  are 
adequate  for  many  situations,  it  should  be  tried  first  to  see  if 
the  results  of  the  model  fit  are  satisfactory. 

It  is  a  possible  and  a  quite  common  situation  where  the 
dynamics  of  the  system  can  be  well  described  using  linear 
models,  but  they  do  not  account  for  any  static  nonlinearities  at 
the  input  and/or  at  the  output.  This  might  be  the  case  if  the 
actuators  are  nonlinear.  For  example  when  saturation  occurs 
or  when  the  sensors  employed  have  nonlinear  characteristics. 
A  model  with  a  static  nonlinearity  at  the  input  is  called  a 
Hammerstein  model.  When  the  nonlinearity  is  at  the  output  a 
Wiener  model  is  more  appropriate.  The  combination  of  the 
two  is  then  the  Hammerstein- Wiener  model,  [32].  Refer  Fig. 
5  [A]  (a)  and  (b)  for  Hammerstein  and  Wiener  models 
respectively.  Consider  the  Hammerstein  case  where  the  static 
nonlinear  function  / (•)  can  be  parameterized  either  in  terms 
of  physical  parameters,  such  as  saturation  point  and  saturation 
level,  or  in  black-box  terms  such  as  spline-function 
coefficients.  This  defines  /(•,/;),  [31].  If  the  linear  model  is 
given  by,  the  predicted  output  model  will  be  in  the  following 
form: 

Equation  14  describes  the  Hammerstein- Wiener  model 
structure: 

w{t)  =  f{{g{t)),  w(t),  y{t)  =  h{x(t)),  {\4) 

where,  w{t)  and  b{t)  are  internal  variables,  w{t)  has  the  same 
dimensions  as  u{t)  -  input,  and  x(^)  has  the  same  dimensions 


as  y{t)  -  output.  gQ  and  hQ  are  the  input  and  output  non¬ 
linearity  functions  respectively.  B(q)  and  F(q)  are  regression 

polynomials.  Fig.  5 [A]  and  5[B]  represent  the  Hammerstein- 
Wiener  models  individually  and  their  combination 
respectively.  The  model  fit  values  are  computed  using 
Equation  15  as  follows; 

A'/  -  1  nn  *  ^  ^  II  (15) 

y-  y 

where,  y  is  the  estimated  output  by  the  model.  The  linear 
block  is  specified  using  the  terms  n^  -  the  number  of  zeros 
plus  one,  the  number  of  poles  and  rij^  -  the  delay  from  the 

input  to  the  output  in  terms  of  the  number  of  samples.  The 
commonly  used  nonlinear  estimators  for  Hammerstein- Wiener 
model  are,  a)  Dead  Zone,  b)  Piecewise  Linear,  c)  Saturation, 
d)  Sigmoid  Network,  and  e)  Wavelet  Network,  [32]. 


(a) 


(b) 


up  GA  are  as  follows: 

1)  Generate  a  random  population  of  chromosomes  - 
these  chromosomes  carry  information  of  the  population  and 
are  confined  in  the  feasible  solution  space. 

2)  Evaluate  the  objective  or  fitness  function  f(p)  for  each 
chromosome.  3)  Create  a  new  population  or  offspring  from 
the  initial  population  by  using  certain  rules. 
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Fig.  6  General  steps  in  a  binary  genetic  algorithm 


Fig.  5  [A]  (a)  Hammerstein  Model,  (b)  Wiener  Model 
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Fig.  5  [B]  Hammerstein- Wiener  model  structure 
Genetic  Algorithm  (GA) 

Genetic  Algorithm  is  a  class  of  evolutionary  methods  for 
solving  both  constrained  and  unconstrained  optimization 
problems  that  are  based  on  natural  selection.  This  is  the  same 
rule  that  governs  biological  systems.  In  GA,  the  population  of 
individual  solutions  is  modified  repeatedly.  A  solution  is 
given  by  a  set  of  parameters  (genes)  and  packaged  as  a 
chromosome.  Each  step  or  iteration  the  GA  selects  individuals 
(chromosomes)  in  a  fashion  that  may  include  some 
randomness,  from  a  given  population,  as  parents,  and  uses 
them  to  produce  offspring  for  the  next  generation.  Over 
successive  iterations  or  generations,  the  population  evolves 
and  finally  reaches  an  optimal  solution.  The  steps  that  make 


These  rules  include  a)  Selection  -  selection  of  two  parent 
chromosomes  from  the  population  according  to  their  fitness, 
b)  Crossover  -  crossover  the  parents  to  form  new  offspring,  if 
no  crossover  is  performed  then  the  offspring  is  an  exact  copy 
of  the  parents,  c)  Mutation  -  involves  the  changing  of  a 
variable  in  a  chromosome  or  some  other  change  in  the  original 
chromosome  as  defined  by  the  user,  d)  Acceptance  Condition 
-  if  offspring  satisfies  the  acceptance  condition,  include 
offspring  in  the  new  population  or  else  discard.  4)  Use  the 
offspring  as  the  parents  for  the  generation  of  a  new 
population.  5)  Continue  until  the  end  condition  is  satisfied. 
Fig.  6  presents  a  graphical  interpretation  of  the  steps  in  GA.  In 
this  work,  GA  is  used  to  assist  in  finding  the  optimal  values  of 
the  filter  mask  for  the  filtration  of  the  sEMG  signal  using  the 
various  spatial  filters.  The  cost  function  that  the  GA  tries  to 
minimize,  is  the  model  fit  obtained  from  system  identification 
of  the  sEMG-force  data  that  was  collected. 

Fig.  7  gives  an  overview  of  the  method  that  was  followed 
for  this  paper. 
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Fig.  7  Overview  of  the  methodology  used 


IV.  Simulation  Results 

The  results  of  spatially  filtered  data  for  the  linear  and  the 
nonlinear  spatial  filters  were  first  compared  based  on  the 
''Kurtosis''  criteria,  [27-28].  'Kurtosis’  is  a  measure  of 
whether  the  data  sets  are  peaked  or  flat  relative  to  a  normal 
distribution.  That  is,  data  sets  with  high  kurtosis  tend  to  have  a 
distinct  peak  near  the  mean,  decline  rather  rapidly,  and  have 
heavy  tails.  Data  sets  with  low  kurtosis  tend  to  have  a  flat  top 
near  the  mean  rather  than  a  sharp  peak.  A  uniform  distribution 
would  be  the  extreme  case.  The  mathematical  expression  for 
kurtosis  is  given  in  Equation  1 1 . 

E[x']‘ 

Fig.  8  shows  the  plot  obtained  for  the  various  filters  based 
on  the  kurtosis  measure.  The  y-axis  is  the  kurtosis 
improvements  which  is  the  ratio  of  the  output  to  the  input 
kurtosis.  It  is  evident  from  the  plot  that  the  NLT,  NLL,  NLTO 
and  the  NLAFD  spatial  filters  performed  very  well  as 
compared  to  the  linear  spatial  filters  under  investigation.  The 
best  kurtosis  improvements  were  obtained  for  experiment  4  - 
44  for  the  nonlinear  spatial  filters.  The  x-axis  in  Fig.  5  shows 
the  numbers  allotted  to  the  various  spatial  filters  investigated. 
Based  on  these  results  we  focused  our  attention  to  the  linear 
spatial  filter  masks  for  experiment  3,  which  exhibits  poor 
model  fit  percentages  and  also  low  kurtosis  values.  This  paper 
does  not  investigate  the  reason  for  the  low  kurtosis  values  of 
the  linear  spatial  filters  but  only  investigates  the  use  of  GA  to 
improve  the  low  model  fit  percentages  obtained  for 
experiment  3.  The  filters  were  compared  based  on  the  model 
fit  values  obtained  from  various  Hammerstein- Wiener  models. 


The  Matlab^  code  for  the  Hammerstein- Wiener  model  is: 
nlhw(ze,  [n^n^  n^],  ....,  ...).  The  modeling  was  carried  out 

by  varying  n^  -  the  number  of  zeros  plus  one,  Uj-  -  the 

number  of  poles  and  nj^-  the  delay  from  input  and  output  in 
terms  of  the  number  of  samples  for  the  various  Hammerstein- 
Wiener  models.  In  all,  42  models  with  variations  in  and 

rij^  were  tested  while  the  value  of  was  kept  as  1.  The  total 

number  of  models  estimated  were  7  (filter  types)  x  4  (time 
windows)  x  42  models  per  time  window  =  1,176  models.  The 
time  windows  used  for  estimation  and  validation  of  the 
models  were  called  'ze’  and  ‘zv'  respectively,  'ze’  contained 
8000  sample  points  and  ‘zv '  contained  data  points  shifted  by 
2000  sample  points.  For  example,  if  'ze’  was  a  time  window 
between  2-6  seconds  i.e.  samples  4000-12000,  then  ‘zv'  was 
between  3-7  seconds  i.e.  6000-14000  samples.  These  models 
were  computed  using  the  filter  masks  available  in  literature. 
On  examining  the  fit  values  closely  we  found  them  to  have 
large  variation  from  one  model  order  to  another.  One  of  the 
reasons  of  this  could  be  due  to  the  poor  correlation  in  the 
estimation  and  validation  data  sets,  on  account  of  the  large 
variations  that  were  achieved  in  the  force.  This  paper  does  not 
list  all  these  models  tested  but  identifies  and  reports  only  the 
significant  results  of  the  analysis.  We  found  that  the  filters 
tested  performed  poorly  in  the  initial  time  window  of  2-7 
seconds  for  experiment  3.  Some  of  the  models  for  this  time 
window  were  selected  and  then  recomputed  using  GA  to 
optimize  the  filter  mask  with  the  fitness  function  being  the  fit 
value  of  an  identified  model  achieved  for  a  given  model  order. 


Comp ^iri son  of  Spati^ll  Filters 
Exp  1  to  9  -  With  Force  (Raw  Data) 


— *-EXP3 
— A-EXP4 
— »t^EXP5 
— •-EXPG 
— EXP7 
-■-EXP  8 
-^EXPg 


Fig.  8  Kurtosis  plots  of  various  filters  for  exp3  -  9;  y-axis  numbers  are  for  the  various  filters  tested  1-NLT,  2-NLL,  3-NLTO,  4-NLAFD,  5- 

LSD,  6-TSD,  7-LDD,  8-TDD,  9-NDD,  10-IB2,  and  10-  IR 


Table  1  shows  an  example  of  the  fits  that  were  obtained  on 
varying  the  parameters  of  the  Hammerstein- Wiener  model. 
The  highlighted  models  (and  a  few  other  models)  were 
selected  randomly  to  be  optimized  using  GA.  We  had  two 
scenarios  under  GA  -1)  GA  Constrained  and  2)  GA  - 
Unconstrained.  The  first  scenario  GA  constrained  optimized 
only  the  mask  entry  a22  (location  of  the  sEMG  sensor  on  the 
motor  unit).  The  other  entries  of  the  filter  mask  were  then 


computed  from  this  optimized  value.  In  the  second  scenario, 
GA  unconstrained  we  let  GA  optimize  all  the  entries  for 
various  masks.  The  GA  parameters  for  optimization  were  as 
follows:  number  of  iterations:  50;  initial  population  size 
Generation  0:  96;  population  size  Generation  1:  48;  Number 
of  Chromosomes  kept  for  mating:  24;  and  mutation  rate  was 
set  to  4%.  Figure  9  shows  the  difference  between  the  two  GA 
scenarios. 


Table  1  Example  of  System  Identification  Results  Using  Filter  Mask  from  Literature  -  Highlighted  Models  Optimized  using 

GA 


Model 

Number 

Ha 

Hb 

Hk 

LDD 

LSD 

TDD 

TSD 

NDD 

IB2 

IR 

ml 

2 

3 

1 

31.06 

41.39 

39.53 

-9.685 

45.55 

33.79 

35.38 

m2 

2 

4 

1 

31.86 

17.4 

39.36 

43.19 

36.84 

16.88 

23.89 

m3 

2 

5 

1 

23.54 

35.94 

30.09 

2.247 

39.78 

36.17 

38.16 

m4 

2 

6 

1 

3.266 

41.99 

41.28 

43.46 

10.83 

36.41 

36.7 

m5 

2 

7 

1 

31.58 

40.55 

44.65 

31.28 

2.593 

32.26 

36.34 

m6 

2 

8 

1 

37.84 

4.259 

21.89 

20.08 

8.036 

36.22 

36.57 

m7 

2 

9 

1 

31.42 

0.1887 

35.78 

28.71 

38.11 

35.54 

35.82 

m8 

3 

3 

1 

36.59 

40.04 

36.17 

12.33 

4.478 

41.09 

35.81 

m9 

3 

4 

1 

20.74 

40.72 

31.53 

36.57 

29.76 

37.43 

38.76 

mlO 

3 

5 

1 

39.87 

11.53 

39.83 

30.24 

39.25 

35.15 

37.9 

: 

: 

: 

: 

; 

: 

: 

: 

m40 

7 

7 

1 

34.91 

10.18 

40.79 

35.21 

35.24 

33.42 

37.92 

m41 

7 

8 

1 

0.1127 

36.28 

39.68 

40.26 

20.27 

35.88 

24.32 

m42 

7 

9 

1 

36.55 

-0.412 

25.24 

31.31 

35.4 

34.26 

39.82 

Genetic  Algoiithm 


CoHsfraiiied 


Unconstiaiiied 


-  Optimized  Filter  Mask  E^try  sEMGl  only  -  All  the  non-zero  entries  were  optimized 

-  Other  non-zero  entries  computed  from  sEMGl 
value 


Fig.  9  Two  genetic  algorithm  scenarios  tested 


Table  2  Results  of  constrained  and  unconstrained  GA  of  highlighted  models  from  Table  1 


Longitudinal  Single  Differential  (LSD) 

Fit  % 

From 

Literature 

GA 

Constrained 

GA 

Unconstrained 

ml 

41.39 

48.9135 

57.9136 

m4 

41.99 

41.5731 

60.2369 

m8 

40.04 

40.5924 

46.3310 

m9 

40.72 

45.2322 

45.4538 

Longitudinal  Double  Differential  (LDD) 

Fit  % 

From 

Literature 

GA 

Constrained 

GA 

Unconstrained 

ml 

31.06 

42.8291 

61.3475 

m6 

37.84 

53.3134 

63.7240 

ml2 

35.54 

44.2513 

51.7942 

m31 

39.44 

47.0034 

60.6489 

Transverse  Single  Differential  (TSD) 

Fit  % 

From 

Literature 

GA 

Constrained 

GA 

Unconstrained 

m2 

43.19 

44.0017 

65.9038 

m4 

43.46 

43.0529 

58.2755 

mil 

44.24 

39.7867 

44.8431 

m31 

29.1 

43.5787 

47.6688 

Transverse  Double  Differential  (TDD) 

Fit  % 

From 

Literature 

GA 

Constrained 

GA 

Unconstrained 

ml 

39.53 

41.5297 

59.8055 

m5 

44.65 

49.4667 

68.4191 

mlO 

39.83 

41.307 

63.8523 

ml5 

43.01 

43.3466 

56.5113 

Inverse  Binomial  2  (IB2) 

Fit  % 

From 

Literature 

GA 

Constrained 

GA 

Unconstrained 

ml 

33.79 

38.6076 

58.2365 

m3 

36.17 

38.9074 

58.1653 

m4 

36.41 

38.9957 

55.5179 

m8 

41.09 

47.2971 

55.0537 

Normal  Double  Differential  (NDD) 

Fit  % 

From 

Literature 

GA 

Constrained 

GA 

Unconstrained 

ml 

45.55 

53.1512 

57.9496 

m3 

39.87 

47.1084 

60.7374 

m7 

38.11 

51.8065 

60.5535 

mil 

39.01 

46.881 

56.1193 

From  the  results  in  Table  2  we  can  see  that  the  optimization  of 
the  filter  mask  using  GA  worked  in  almost  all  the  cases 
chosen.  GA  without  constraints  performed  significantly  better, 
in  most  cases,  than  the  filter  masks  reported  in  literature  and 
also  the  mask  which  we  computed  using  GA,  which  only 
optimized  the  entry  (^22)  i.e.  the  weight  associated  with  the 
sEMG  signal  at  the  motor  unit.  This  restriction  on  GA  would 


leave  the  filter  mask  symmetrical.  But  looking  at  the  results  of 
the  GA,  we  can  conclude  that  the  filter  mask  need  not  always 
be  symmetrical  for  analysis  of  sEMG,  especially  for  data 
recorded  using  an  array.  All  the  filter  masks,  with  the 
individual  entries  of  the  masks  that  were  obtained  after 
optimization  along  with  the  respective  fit  values  are  provided 
in  Table  3. 


Table  3  Optimized  filter  masks  for  constrained  and  unconstrained  GA 


Linear  Spatial 
Filter  Type 

Mask  in  Literature 

GA  Optimized  Spatial  Filter  Mask  - 
Constrained 

GA  Optimized  Spatial  Filter  Mask  - 
Unconstrained 

LDD 

ml 

I 

"0  0  o' 

-1  2  -1 

0  0  0 

nt  31.06"/ 

'000 

-6.5  13  -6.^ 

0  0  0 

Fit  42.8912  ' 

Vo 

0  0  o' 

-64.2686  23.5033  -20.8633 

0  0  0  _ 

Fit  61.3475  "/o 

LSD 

in4 

I 

'0  0  o' 

-1  1  0 

000 

nt  41.99  "/ 

F 

■  0  0  o' 

-220 

000 

it  41.5731"/ 

'o 

0  00 

-52.7866  54  0 

0  0  0 

Fit  60.2369"/o 

- 

TDD 

m5 

I 

'0  -1  o' 

020 

_0  -1  0_ 

nt  44.65 "/ 

Fi 

'0  -27  o' 

0  54  0 

0  -27  0 

Lt  49.4667  ^ 

yo 

'0  -41.5561  o' 

0  54.7329  0 

0  -22  0 

Fit  68.4191  "/o 

TSD 

m2 

I 

'0  -1  o' 

0  1  0 

0  0  0 

nt  43.19 "/ 

F 

0  -28.5  O' 

0  57  0 

0  0  0 

it  44.0017"/ 

'0  -74  o' 

0  89.6214  0 

0  0  0_ 

Fit  65.9038  "/o 

NDD 

m3 

I 

0  -1  0 

-1  4  -1 

0-10 

nt  39.87  "/ 

0  -6.75  0 

-6.15  27  -6.75 

0  -6.75  0 

Fit  47.1084  % 

0  -11.5790  0 

-46.7773  36.9276  -11.8061 

0  -70.0491  0 

Fit  60.7374  "/o 

IB2 

ml 

I 

-1  -2  -1 

-2  12  -2 

-1  -2  -1 

nt  33.79 "/ 

^0 

'-0.42  -0.83  -0.42' 

-0.83  5  -0.83 

-0.42  -0.83  -0.42 

Fit  38.6076  % 

■ -9.3405  -85.0222  -53.7102' 

-95.4633  42  -30.7811 

-28.6087  -8.2511  -10.0189 

Fit  58.2365  "/o 

V.  Conclusion 

The  linear  spatial  filter  masks  as  reported  in  the  literature  have 
poor  model  fit  percentages  and  poor  kurtosis  improvements. 
Though  the  reason  for  the  low  kurtosis  improvements  of  the 
linear  spatial  filters  was  not  investigated  here,  we  optimized 
the  linear  spatial  filter  masks  using  GA  and  compared  them 
based  on  the  model  fit  values  achieved.  The  selected  model 
structure  for  characterizing  the  sEMG  and  finger  force  data  is 
a  Hammerstein- Wiener  model.  The  fit  values  did  improve 
significantly  in  the  two  GA  scenarios  -  GA  with  and  without 
constraints.  The  GA  without  constraints  performed  better  than 


the  GA  with  constrains,  which  brings  into  focus  the  possibility 
that  the  sEMG  signal  distribution  over  the  entire  grid  cannot 
be  assumed  to  be  symmetrically  distributed  and  that  the 
weights  associated  with  the  sEMG  signal  at  various  locations 
need  to  be  modified  depending  on  probably  the  subject  and 
also  based  on  the  experimental  design.  This  is  in  contrast  to 
the  reported  filter  mask  in  the  literature,  which  are  all 
symmetric.  Almost  all  the  filter  masks  optimized  resulted  in  a 
significant  improvement  over  the  masks  reported  in  literature. 
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During  the  last  two  decades,  wavelet  transform  has  become  a  common  signal  processing  technique  in 
various  areas.  Selection  of  the  most  similar  mother  wavelet  function  has  been  a  challenge  for  the  appli¬ 
cation  of  wavelet  transform  in  signal  processing.  This  paper  introduces  Daubechies  44  (db44)  as  the  most 
similar  mother  wavelet  function  across  a  variety  of  biological  signals.  Three-hundred  and  twenty  four 
potential  mother  wavelet  functions  were  selected  and  investigated  in  the  search  for  the  most  similar 
function.  The  algorithms  were  validated  by  three  categories  of  biological  signals:  forearm  electromyo¬ 
graphic  (EMG),  electroencephalographic  (EEG),  and  vaginal  pulse  amplitude  (VPA).  Surface  and  intramus¬ 
cular  EMG  signals  were  collected  from  multiple  locations  on  the  upper  forearm  of  subjects  during  ten 
hand  motions.  EEG  was  recorded  from  three  monopolar  Ag-AgCl  electrodes  (Pz,  POz,  and  Oz)  during 
visual  stimulus  presentation.  VPA,  a  useful  source  for  female  sexuality  research,  were  recorded  during 
a  study  of  alcohol  and  stimuli  on  sexual  behaviors.  In  this  research,  after  extensive  studies  on  mother 
wavelet  functions,  results  show  that  db44  has  the  most  similarity  across  these  classes  of  biosignals. 
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1.  Introduction 

Biosignal  processing  has  been  rapidly  developing,  increasing  the 
understanding  of  complex  biological  processes  in  a  wide  variety  of 
areas.  Wavelet  transform  (Daubechies,  1991)  is  a  powerful  time- 
frequency  approach  which  has  been  applied  to  multiple  domains 
of  biosignal  processing,  such  as  EMG  (e.g.  Englehart,  Hudgins,  & 
Parker,  2001),  EEG  (e.g.  Kurt,  Sezgin,  Akin,  Kirbas,  &  Bayram,  2009; 
Rosso  et  al.,  2001;  Subasi,  2005;  Ting,  Guo-zheng,  Bang-hua,  & 
Hong,  2008),  EGG  (e.g.  Engin,  Eedakar,  Engin,  &  Korurek,  2007; 
Manikandan  &  Dandapat,  2008;  Singh  &  Tiwari,  2006),  VPA  (e.g. 
Rafiee,  Rafiee,  &  Michaelsen,  2009).  A  significant  focus  on  the  appli¬ 
cation  of  wavelet  transforms  (e.g.  Englehart  et  al.,  2001;  Earina, 
Lucas,  &  Doncarli,  2008)  has  permitted  rapid  development  in  the 
field.  However,  the  selection  of  the  most  appropriate  mother  wave¬ 
let  to  characterize  commonalities  amongst  signals  within  a  given 
domain  is  still  lacking  in  biosignal  processing.  The  main  contribu¬ 
tions  to  find  the  optimum  basis  function  can  be  found  in  several 
papers  (e.g.  Brechet,  Lucas,  Doncarli,  &  Earina,  2007;  Earina,  do 
Nascimento,  Lucas,  &  Doncarli,  2007;  Elanders,  2002;  Landolsi, 
2006;  Lucas,  Gaufriau,  Pascual,  Doncarli,  &  Earina,  2008;  Rafiee  & 
Tse,  2009;  Singh  &  Tiwari,  2006;  Tse,  Yang,  &  Tam,  2004). 


*  Corresponding  author.  Address:  Department  of  Mechanical,  Aerospace  and 
Nuclear  Engineering,  Jonsson  Engineering  Center,  Rm.  2049,  110  8th  Street,  Troy, 
NY  12180-3590,  USA.  Tel.:  +1  518  276  6351;  fax:  +1  518  276  6025. 

E-mail  addresses:  rafiee@rpi.edu,  krafiee81@gmail.com  (J.  Rafiee). 


The  mother  wavelet  function  is  the  main  base  of  wavelet  trans¬ 
forms  that  would  permit  identification  of  correlated  coefficients 
across  multiple  signals.  The  more  similar  the  mother  wavelet  func¬ 
tion  is  to  the  wavelet  coefficients  across  signals,  the  more  precisely 
the  signal  of  interest  can  be  identified  and  isolated;  hence,  identi¬ 
fication  of  a  mother  wavelet  function  is  of  paramount  significance. 

The  Daubechies  (db)  wavelet  functions  (Daubechies,  1988)  have 
been  applied  in  several  areas  with  the  lower  orders  (dbl  to  db20) 
used  most  often  (Rafiee  &  Tse,  2009).  The  few  peer-reviewed  papers 
about  the  application  of  higher  order  db  refer  to  Antonino-Daviu, 
Riera-Guasp,  Eolch,  and  Palomares  (2006)  and  Rafiee  and  Tse  (2009) 
who  implemented  them  for  mechanical  systems. 

This  paper  focuses  on  the  most  similar  wavelet  basis  function 
matched  with  complex  biosignals  such  as  surface  and  intramuscu¬ 
lar  EMG,  EEG,  and  VPA  signals  (Rafiee,  Rafiee,  et  al.,  2009). 

2.  Measures 

2.1.  Surface  and  intramuscular  EMG  signals 

EMG  signals  have  broad  applications  in  various  areas,  especially 
in  prosthetics  and  myoelectric  control  (Asghari  Oskoei  &  Hu,  2007). 
The  experimental  surface  and  intramuscular  EMG  signals  used  in 
this  research  have  been  provided  from  the  Institute  of  Biomedical 
Engineering  at  the  University  of  New  Brunswick  with  a  protocol 
approved  by  the  university’s  Research  Ethics  Board  (Hargrove, 
Englehart,  &  Hudgins,  2007).  Two  different  data  acquisition 
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systems  were  used  to  collect  surface  and  intramuscular  EMG  sig¬ 
nals  (Mermens  et  al.,  1999).  For  surface  EMG  signals,  a  16-electrode 
linear  array  with  interelectrode  spacing  of  2  cm  was  used.  Each 
channel  was  filtered  between  10  and  500  Hz  and  amplified  with 
a  gain  of  2000.  For  intramuscular  EMG,  needles  were  implanted 
in  the  pronator  and  supinator  teres,  flexor  digitorum  sublimas, 
extensor  digitorum  communis,  flexor  and  extensor  carpi  ulnaris. 
These  were  used  to  record  information  regarding  grip,  wrist  flexion 
and  rotation,  and  gross  movement.  These  six  channels  of  data  were 
Altered  between  10  and  3000  Hz  and  also  amplified  with  a  gain  of 
2000.  These  were  recorded  in  six  subjects  while  they  performed  10 
hand  movements  for  5  s  each,  followed  by  a  2  min  resting  period. 
All  subjects  denied  fatigue  during  these  exercises.  The  location  of 
surface  and  needle  electrodes  is  depicted  in  Fig.  1  in  a  cross  section 
of  the  forearm.  The  motions  includes  forearm  pronation,  forearm 


Surface  Electrodes 


Fig.  1.  A  cross  section  of  the  upper  forearm  to  illustrate  the  locations  of  1 6  surface 
electrodes  and  six  needle  electrodes.  Source:  Hargrove,  Englehart,  &  Hudgins,  2007, 
with  permission. 


supination,  wrist  flexion,  wrist  extension,  wrist  abduction,  wrist 
adduction,  key  grip,  chuck  grip,  hand  open,  and  a  rest  state. 

2.2.  EEC  signals 

EEG  signals,  one  of  the  most  complicated  biomedical  signals,  are 
the  variations  of  electrical  potential  in  the  cortex  caused  by  the 
neuronal  activity  reflected  in  electrical  potentials  at  the  scalp. 
EEG  offers  high  time-resolution  for  changes  in  mental  and  physical 
activity  occurring  in  the  brain  and  has  been  an  investigative  tool  in 
such  disparate  areas  as  neuroprosthetics,  affective  psychopathol¬ 
ogy,  diagnosis  of  nervous  diseases,  and  cognitive  models  of  learn¬ 
ing.  To  illustrate  the  difference  between  EEG  and  EMG  signals, 
their  frequency  contents  are  depicted  using  power  spectrum  den¬ 
sity  (see  Figs.  2  and  3). 

Neuroscan  STIM  software  (Compumedics,  Inc.)  was  used  to  col¬ 
lect  EEG  signals,  present  digitized  emotional  photographs,  and  col¬ 
lect  physiological  data.  The  EEG  signals  were  recorded  from  three 
monopolar  Ag-AgCl  electrodes  which  were  placed  over  three  mid¬ 
line  sites  (Pz,  POz,  and  Oz)  for  the  purpose  of  recording  visual 
evoked  potentials  (see  Fig.  4).  These  locations  were  chosen  to  rep¬ 
resent  visual  cortex  and  provide  redundancy.  All  three-channel 
analogue  EEG  signals  were  converted  to  digital  format  through 
an  A/D  converter  with  a  sampling  rate  of  300  Hz,  and  then  ampli- 
fled  by  5000  using  a  Sensorium,  Inc.  EPA-6  bioamplifler.  The  sig¬ 
nals  were  then  Altered  using  a  high-pass  Alter  at  10  Hz  (12  dB/ 
Octave)  and  a  low-pass  Alter  at  30  Hz  (eighth  order  elliptic). 
Impedance  was  maintained  below  10  kQ  by  thorough  skin  prepa¬ 
ration,  including  abrasion.  EEG  signals  recorded  in  this  research 
have  the  applications  to  investigate  the  relationship  of  emotion 
and  attention  to  sexual  stimuli  and  participants’  sexual  desire  lev¬ 
els  (Prause,  Janssen,  &  Hetrick,  2007).  Participants  were  seated  in  a 
chair  and  viewed  standardized  photographs  that  varied  systemat¬ 
ically  in  their  emotional  content  (International  Affective  Picture 
System;  Center  for  the  Study  of  Emotion  and  Attention,  1995).  Each 
stimulus  was  presented  for  6  s  with  a  variable  (M  =  13  s)  inter-trial 
interval.  For  the  current  study,  only  the  data  recorded  from  one 
subject  was  used.  While  spectral  density  can  vary  due  to  individual 
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Fig.  2.  Power  spectrum  density  (V^/Hz)  of  surface  EMG  signals  of  10  hand  motions  recorded  from  one  of  the  16  channels  of  the  data  acquisition  system. 
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Fig.  3.  Power  spectrum  density  (V^/Hz)  of  EEC  signals  recorded  from  one  of  the 
three  channels  of  the  data  acquisition  system. 


differences  and  cognitive-affective  state,  the  underlying  constant 
shape  of  EEG  signals  was  of  primary  importance  in  this  study 
and  is  not  expected  to  vary  between  subjects. 

2.3.  VPA  signals 

VPA  is  one  of  the  most  common  measure  for  female  sexuality 
and  the  application  of  VPA  studies  is  in  a  broad  variety  of  gynecol¬ 
ogy,  such  as  female  sexual  arousal  (Laan,  Everaerd,  &  Evers,  1995), 
sexual  function  (Rosen  et  al.,  2000),  sexual  dysfunction  (Basson  et 
al.,  2004).  The  vaginal  photoplethysmograph  monitors  the  changes 
in  backscattered  light  in  the  vaginal  canal  to  reflect  sexual  arousal 
(Prause  et  al.,  2005).  An  embedded  light  source,  usually  infrared, 
generates  a  light  signal  that  is  reflected  back  to  a  receiving  photo¬ 
cell.  The  received  signal  is  interpreted  as  an  index  of  vasoconges- 
tion,  although  it  is  likely  to  reflect  several  poorly-characterized 
physiological  processes  in  the  vagina  (Prause  &  Janssen,  2005). 
The  signal  pulses  with  heartbeats,  which  typically  are  around  60 
BPM  in  the  laboratory,  and  slow  waves  concordant  with  breathing 
rate  are  evident  in  many  participants,  which  may  be  influenced  by 
vaginal  canal  length. 

Two  signals  are  typically  extracted:  The  first  is  the  DC  signal, 
which  provides  an  index  of  the  total  amount  of  blood.  The  second 
is  the  AC  signal,  abbreviated  as  VPA,  which  reflects  phasic  changes 
in  the  vascular  walls  that  result  from  pressure  changes  within  the 
vessels.  Both  signals  have  been  found  to  be  sensitive  to  responses 
to  erotic  stimulation  (Geer,  Morokoff,  &  Greenwood,  1974).  How¬ 
ever,  the  construct  validity  of  VPA  is  better  established  (Laan  et 


3 

al.,  1995)  and  is  used  in  this  study.  VPA  was  collected  using  the 
Biopac  (Model  MPlOO)  data  acquisition  system.  The  signal  is  first 
band-pass  Altered  between  0.5  and  30  Hz.  The  sampling  rate  was 
fixed  at  80  Hz. 

Using  PSD,  the  frequency  content  of  VPA  signals  are  depicted  in 
Pig.  5  for  one  specific  subject.  Low-frequency  VPA  from  20  subjects 
was  recorded  in  six  conditions.  Each  subject  was  tested  watching  a 
neutral  movie  followed  by  an  erotic  movie  with  normal  blood  alco¬ 
hol  levels  (BAL),  0.025  BAL,  and  0.08  BAL. 

3.  Mother  wavelet  selection 

Wavelet  (Daubechies,  1991)  is  a  capable  transform  with  a  flex¬ 
ible  resolution  in  both  time-  and  frequency-domains,  which  can 
mainly  be  divided  into  discrete  and  continuous  forms;  the  former 
is  faster  because  of  low  computational  time,  but  the  continuous 
type  is  more  efficient  and  reliable  because  it  maintains  all  informa¬ 
tion  without  down-sampling.  Continuous  wavelet  transform  of  a 
signal  s(t)  g  L^(dl)  can  be  defined  as 

=  {s(t)Mt))  (1) 

where  ( )  means  the  inner  product  of  the  signal  and  ij/  g  1^(91)  \  {0} 
which  is  usually  termed  the  mother  wavelet  function.  The  mother 
wavelet  function  must  satisfy  the  admissibility  condition: 

=  (2) 

and  the  ratio  of  cojcoo  is  the  scale  factor.  The  mother  wavelet  is  as¬ 
sumed  to  be  centered  at  time  zero  and  to  oscillate  at  frequency  coq. 
Essentially,  Eq.  (1)  can  be  interpreted  as  a  decomposition  of  the  sig¬ 
nal  s(f')  into  a  family  of  shifted  and  dilated  wavelets  ij/liojl 
cooXt'  -  01-  The  wavelet  basis  function  i/^[(cu/cuo)(t'  -  f)]  has  vari¬ 
able  width  with  consideration  to  co  at  each  time  t,  and  is  wide  for 
small  CO  and  narrow  for  large  co.  By  shifting  co(f')  at  fixed  parameter 
CO,  the  (cu/cuo)-scale  mechanisms  in  the  time  response  s(f )  can  be 
extracted  and  localized.  Alternatively,  by  dilating  co{t)  at  a  fixed  t, 
all  of  the  multiscale  events  of  s(t')  at  t  can  be  analyzed  according 
to  the  scale  parameter  {cojcoo). 

In  terms  of  frequency,  low  frequencies  (high  scales)  correspond 
to  global  information  of  a  signal  (that  usually  spans  the  entire  sig¬ 
nal),  whereas  high  frequencies  (low  scales)  correspond  to  detailed 
information.  In  small  scales,  a  temporally  localized  analysis  is 
done;  as  the  scale  increases,  the  breadth  of  the  wavelet  function  in¬ 
creases,  resulting  in  analysis  with  less  time  resolution  but  greater 
frequency  resolution.  The  wavelet  functions  are  band-pass  in  nat¬ 
ure,  thus  partitioning  the  frequency  axis.  In  fact,  a  fundamental 
property  of  wavelet  functions  is  that  c  =  A/// where  A/ is  a  measure 
of  the  bandwidth, /is  the  center  frequency  of  the  pass-band,  and  c 
is  a  constant.  The  wavelet  functions  may  therefore  be  viewed  as  a 
bank  of  analysis  Alters  with  a  constant  relative  pass-band. 


Fig.  4.  Channel  locations  in  EEG  signals. 
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Fig.  5.  Power  spectrum  density  (V^/Hz)  of  VPA  recorded  in  six  classes  (one  specific  subject). 


The  CWT  results  in  continuous  wavelet  coefficients  (CWC), 
which  illustrate  how  well  a  wavelet  function  correlates  with  a  spe¬ 
cific  signal.  If  the  signal  has  a  major  frequency  component  corre¬ 
sponding  to  a  particular  scale,  then  the  wavelet  at  this  scale  is 
similar  to  the  signal  at  the  location  where  this  frequency  compo¬ 
nent  occurs,  regardless  of  its  amplitudes  and  phases.  Correlation 
is  one  of  the  most  common  statistical  measures,  and  describes 
the  degree  of  linear  dependence  between  two  variables  in  terms 
of  a  coefficient  between  -1  and  +1.  The  closer  the  coefficient  is 
to  either  -1  or  +1,  the  stronger  the  correlation  between  the  two 
variables.  The  negative  or  positive  sign  of  the  coefficient  indicates 
the  direction  of  the  linear  dependence.  The  coefficient  0  implies 
that  the  two  variables  are  completely  linearly  independent  of  each 
other.  px.y,  the  correlation  between  two  random  variables  x  and  y 
with  expected  values  px  and  jiy  and  standard  deviations  Gx  and 
Gy  is  defined  as: 

^  cov(x,y)  ^  E({x  -  n^)(y  -  jXy)) 

where  E  stands  for  expected  value  of  the  variable  and  cov  stands  for 
covariance.  As  E(x)  =  px,  E(y)  =  Py  and  g^(x)  =  E(x^)  -  T^(x), 
cr^(y)  =  E(y^)  -  E^(y),  pxy  can  be  defined  as: 

p,  £(xy)-£(x)£(y) 

^E(x^)-E\x)^E(y^)-E^(y) 

In  this  research,  the  outcome  of  the  correlation  between  signal 
and  wavelet  basis  function  (CWC)  has  been  established  as  the  basis 
for  comparing  selected  mother  wavelet  functions.  Consequently, 


to  find  the  most  similar  mother  wavelet  to  biosignals,  mother 
wavelets  from  different  families  including  Haar,  Daubechies  (db), 
Symlet,  Coiflet,  Gaussian,  Morlet,  complex  Morlet,  Mexican  hat, 
bio-orthogonal,  reverse  bio-orthogonal,  Meyer,  discrete  approxima¬ 
tion  of  Meyer,  complex  Gaussian,  Shannon,  and  frequency  B-spline 
families  have  been  analyzed  based  on  CWC  and  using  the  following 
algorithm: 

1 .  Signal  segmentation:  EMG,  EEG,  VPA  signals  were  segmented  to 
the  256-points,  500-points,  960-points  (12  s)  windows,  respec¬ 
tively  as  shown  in  Eigs.  6  and  7  for  EMG  and  VPA. 

2.  One  class  of  recorded  data  is  selected  from  one  channel  for  one 
subject  for  each  type  of  biosignal.  The  number  of  subjects  is  20, 
6,  and  1  for  VPA,  EMG,  and  EEG,  respectively.  There  are  1, 16,  6, 
and  3  channels  for  recording  the  signals  for  VPA,  surface  EMG, 
intramuscular  EMG,  and  EEG,  respectively. 

3.  One  mother  wavelet  function  is  selected  from  324  candidates. 
In  the  fourth  decomposition  level,  CWC  of  the  segmented  sig¬ 
nals  were  calculated  (2^  numbers  for  each  segmented  signal). 

4.  Absolute  value  of  CWC  in  each  scale  (2^  scales)  was  determined 
using  324  mother  wavelets  in  a  segmented  signal  for  each  of  the 
10  hand  motions  for  EMG,  as  well  as  each  of  three  specific  chan¬ 
nels  for  EEG.  Next,  the  sum  of  this  value  in  all  2^  scales  was 
determined  for  20  EMG  segmented  signals  (signals  with  the 
length  of  256  points),  50  EEG  segmented  signals  (signals  with 
the  length  of  500  points),  and  15  VPA  segmented  signals  (sig¬ 
nals  with  the  length  of  960  points).  Their  average  was  calcu¬ 
lated  for  each  type  of  signal  and  called  the  evaluation 
criterion  (EC)  for  simplicity  and  to  find  the  most  similar  mother 
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Fig.  6.  Segmented  surface  EMG  signals  in  a  256-points  window  from  one  subject  performing  10  different  hand  motions. 


Fig.  7.  One  segmented  VPA  in  a  960-points  window  recorded  from  6  different  classes  (X-axis  equals  to  12  s). 


function.  Fig.  8  shows  the  decision-making  flow  chart  to  deter¬ 
mine  the  most  similar  mother  wavelet  function  towards 
biosignals. 

5.  Steps  2-4  are  repeated  until  all  gathered  data  is  analyzed. 

In  this  research,  after  running  the  algorithm,  the  results  are 
shown  that  from  Daubechies  family,  db44  is  the  most  similar  func¬ 
tion  for  all  case  studies.  Daubechies’s  functions  are  orthonormal 
functions.  For  any  integer  r,  the  orthonormal  basis  function 
(Daubechies,  1988)  for  L^(91)  will  be  determined  from  the  follow¬ 
ing  equation: 

=  j,keZ  (5) 

where  the  function  (pr{x)  in  L^(R)  has  the  property  that 
{(Pr(x  -  k)lk  e  Zj  is  an  orthonormal  sequence  in  L^(R).j  is  the  scaling 
index,  k  is  the  shifting  index  and  r  is  the  filter  index. 

fj,  at  scale  2~\  of  a  function /e  L^{R)  will  be  defined  as  follows: 


k 

The  details  or  fluctuations  are  determined  by: 

dj(x)=fj^,{x)-fj{x).  (7) 

To  analyze  these  details  at  a  certain  scale,  the  orthonormal  basis 
function,  ijjr,  with  similar  characteristics  to  those  of  above-men¬ 
tioned  (prix)  has  been  defined,  (prix)  and  called  the  father 
wavelet  and  the  mother  wavelet  functions,  respectively,  are  the 
wavelet  prototype  functions  required  by  the  wavelet  analysis. 
Wavelets  such  as  those  defined  in  Eq.  (5)  are  generated  from  the 
father  or  the  mother  wavelet  by  changing  scale  and  translation 
in  time  (Liang  &  Que,  2009). 

Daubechies’  orthonormal  basis  has  the  following  charac¬ 
teristics: 

•  cOr  has  the  compact  support  interval  [0, 2r+  1]. 

•  COr  has  about  r/5  continuous  derivatives. 
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Fig.  8.  Searching  algorithm  to  find  the  most  similar  mother  wavelet  based  on  evaluation  criterion  (for  biosignals). 


•  IZo  lArMrix  =  j:“„x''iA,(x)dx  =  0. 

Daubechies’  wavelets  provide  appropriate  results  in  signal  pro¬ 
cessing  techniques  due  to  the  above-mentioned  properties.  A 
wavelet  function  with  compact  support  can  be  implemented  easily 
by  finite  length  filters.  Moreover,  the  compact  support  enables  spa¬ 
tial  domain  localization.  Since  the  wavelet  basis  functions  have 
continuous  derivatives,  they  decompose  a  continuous  function 
more  efficiently  while  avoiding  edge  artifacts.  Since  the  mother 
wavelets  are  used  to  characterize  details  in  a  signal,  they  should 
have  a  zero  integral  so  that  the  trend  information  is  stored  in  the 
coefficients  obtained  by  the  father  wavelet.  A  Daubechies’  wavelet 
representation  of  a  function  is  a  linear  combination  of  the  wavelet 
basis  functions.  Daubechies’  wavelet  transforms  are  usually  imple¬ 
mented  numerically  via  quadratic  mirror  filters.  Multiresolution 
analysis  of  the  trend  and  fluctuation  of  a  function  is  implemented 
by  convolving  it  with  a  low-pass  filter  and  a  high-pass  filter  that 
are  versions  of  the  same  wavelet. 

As  shown  in  biosignals,  the  signal  with  a  sharp  spike  is  properly 
analyzed  by  Daubechies’  wavelets,  because  much  less  energy  (or 
trend)  is  stored  in  the  high-pass  bands.  Hence,  Daubechies’  wave¬ 


lets  are  ideally  suited  for  natural  signals.  In  general,  Daubechies’ 
wavelets  with  long-length  filters  give  more  appropriate  energy 
concentration  than  those  with  short-length  filters.  Therefore,  the 
mentioned  reason  supports  the  use  of  EC  to  find  the  most  similar 
function  to  biosignals.  Besides,  as  illustrated  in  Fig.  9,  db44  is  the 
only  Daubechies  function  with  near-symmetric  characteristic  as 
well  as  having  sharp  spike  that  would  be  matched  with  natural 
signals. 


4.  Results  and  discussion 

The  result  shows  that,  among  all  wavelet  families  considered  in 
Tables  1 A-2B  (Appendix  A),  Daubechies  44  (db  44)  provides  a  bet¬ 
ter  fit  to  the  tested  biosignals.  Figs.  10-12  show  the  EC  across 
mother  wavelet  candidates  for  surface  EMG,  EEC,  and  VPA  signals, 
respectively.  For  example,  in  Fig.  10,  all  classes  of  EMG  (for  10  dif¬ 
ferent  hand  motions)  have  a  peak  whose  amplitude  is  greater  than 
those  calculated  by  the  other  candidate  mother  wavelets.  The  peak 
represents  the  largest  EC  which  is  calculated  by  db44.  The  same 
pattern  was  achieved  for  other  biosignals.  The  difference  between 
db44  and  the  other  323  wavelet  functions  towards  biosignals  is 
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Fig.  9.  High-order  Daubechies  functions. 


Forearm  Pronation 

f clb44 
^ - >-db45 

< 

1 

f  db44  Forearm  Supination 

• - >-db45 

Wrist  Flexion 

f - ^  db44 

f  > 

II 

< 

1 

f  >•  db44  Wrist  Extension 

. - >db45 

..  - 3..^ 

• - ^^db44 

1  ^  Wrist  Abduction 

P - >db45 

1  • 

>  db44 

. - >  db45 

• 

• - ^  db44  Relax 

- >  db45 

....  Chuck  Grip 

f - db44 

• - >  db45 

l| 

l| 

l| 

f — >db44 
|» - >  db45 

r - >db44  Spread  Fingers 

- >db45 

Mother  wavelet  functions 


Fig.  10.  Evaluation  criterion  (no  unit)  across  mother  wavelet  candidate  for  surface  EMG  signals  recorded  from  one  channels  of  data  acquisition  system  for  10  hand  motions. 


noticeable.  This  would  be  due  to  the  shape  of  db  functions,  which 
do  not  change  dramatically  in  low-order  Daubechies.  Therefore, 
low  order  Daubechies  have  similar  performance  to  the  biosignal. 


However,  in  higher  order,  the  difference  of  functions’  shape  be¬ 
tween  two  adjacent  db  functions  is  more  distinct  (see  Fig.  9).  In 
Fig.  13,  the  trend  of  Daubechies  family  and  EC  was  magnified  for 
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Fig.  11.  Evaluation  criterion  (no  unit)  across  324  mother  wavelet  candidates  for 
EEG  signals  across  three  channels  (Pz,  POz,  Oz). 


X  10^ 


Fig.  12.  Evaluation  criterion  (no  unit)  vs.  mother  wavelets  for  VPA  signals  recorded 
from  one  subject. 


Intramuscular  EMG  signals.  As  shown,  the  EC  increases  slightly  in 
low-order  db  and  decreases  slightly  for  high-order  db.  This  demon¬ 
strates  that  Daubechies  functions  do  not  behave  dramatically  dif¬ 
ferent  on  the  biosignals,  while  ranging  from  dbl  to  db43.  It  also 
highlights  the  likely  limitation  of  the  mostly  lower  order  Daube¬ 
chies  that  typically  are  used  in  prior  research.  The  trend  changes 
dramatically  for  db44,  which  cannot  be  seen  in  Eig.  13  due  to  scal¬ 
ing  restrictions. 

db44  and  db45  are  the  most  similar  functions  as  the  other  322 
functions  have  pronouncedly  poorer  performance  (similarity). 
Closer  examination  of  the  evaluation  criterion  (see  Eigs.  12  and 
14)  for  VPA  and  intramuscular  EMG  reveals  some  variability  of  fit 
amongst  other  function  families.  To  demonstrate  the  difference  be¬ 
tween  db44  and  the  other  functions,  the  continuous  wavelet  coef¬ 
ficients  of  one  of  the  segmented  unit  signals  using  db44  has  been 


Fig.  13.  Trend  of  Daubechies  family  vs.  evaluation  criterion  in  Intramuscular  EMG 
signals  for  two  motions. 


two  motions 


Fig.  14.  Evaluation  criterion  (no  unit)  vs.  mother  wavelets  for  intramuscular  EMG 
signals  recorded  from  one  of  the  six  channels  of  data  acquisition  system. 

compared  to  those  calculated  with  the  Morlet  function,  which 
has  been  used  frequently  in  previous  research  (see  Eigs.  15  and 
16,  see  Eig.  17  for  decomposition  scale)  (e.g.  Saravanan,  Kumar 
Siddabattuni,  &  Ramachandran,  2008).  The  difference  between 
the  values  of  the  CWC  (Y-axis)  calculated  by  db44  is  much  higher 
than  those  calculated  by  Morlet  function.  Moreover,  periodic  sinu¬ 
soidal  trends  also  are  obvious  using  the  db44.  This  is  a  very  desir¬ 
able  feature,  because  it  means  that  periodic  behavior  can  be 
extracted  from  biological  signals  using  db44  function.  This  might 
be  useful  for  preprocessing  biological  signals. 

Some  other  complex  mother  wavelets  (in  addition  to  db44  and 
db45)  show  high  similarity  to  EEG  and  VPA  signals  (e.g.  see  Pig.  12). 
After  db44  and  db45,  EEG  signals  also  display  some  similarity  to 
bior  3.1  and  other  complex  mother  wavelets  unlike  the  EMG.  How¬ 
ever,  these  differences  appear  minor  and  appear  due  mostly  to 
complex  functions  with  different  wavelet  center  frequency.  The 
center  frequency  varies  simply  with  the  frequency  contents  of 
the  signals. 
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Fig.  15.  CWC  of  a  segmented  surface  EMG  signal  calculated  using  Morlet  and  Db44  in  one  specific  scale.  (Title:  scale  -  see  Fig.  17). 
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Mother  Wavelet:  db44 
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Fig.  16.  CWC  of  a  segmented  EEC  signal  calculated  using  Morlet  and  Db44  in  one  specific  scale.  (Title:  scale  -  see  Fig.  17). 


Fig.  17.  Decomposition  tree  and  the  level  of  decomposition  (Rafiee  et  al.,  2010). 
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Table  lA 

Studied  wavelet  families  in  this  research  (Rafiee  et  al.,  2010). 


No. 

Family  (short  form) 

Order 

1 

Haar  (dbl) 

db  1 

2-45 

Daubechies(db) 

db  2-db  45 

46-50 

Coiflet  (coif) 

coif  1-coif  5 

51 

Morlet  (Mori) 

morl 

52-147 

Complex  Morlet  (cmor  Fb-Fc)^ 

Included  Table  IB 

148 

Discrete  Meyer  (dmey) 

dmey 

149 

Meyer  (meyr) 

meyr 

150 

Mexican  Hat  (mexh) 

mexh 

151-200 

Shannon  (Shan  Fb-Fc)^ 

Included  Table  IB 

201-260 

Frequency  B-Spline  (fbsp  M-Fb-  Fc)^ 

Included  Table  IB 

261-267 

Gaussian  (gaus) 

gaus  1-gaus  7 

268-275 

Complex  Gaussian  (cgau) 

cgau  1-cgau  8 

276-290 

Biorthogonal  (bior  Nr.Nd)'’ 

Included  Table  IB 

291-305 

Reverse  Biorthogonal  (rbio  Nr.Nd)'’ 

Included  Table  IB 

306-324 

Symlet  (sym) 

sym  2-sym  20 

^  Fb  is  a  bandwidth  parameter,  Fc  is  a  wavelet  center  frequency,  and  M  is  an 
integer  order  parameter. 

’’Nr  and  Nd  are  orders:  r  for  reconstruction/d  for  decomposition. 


5.  Conclusions 

In  summary,  db44  appears  to  be  the  most  similar  function  to 
EMG,  EEG,  and  VPA  signals  among  324  mother  wavelet  functions. 
Symmetric  mother  wavelets  have  been  shown  more  proper  results 
with  biosignals  in  prior  research.  Daubechies  are  orthogonal  com¬ 
pact  support  functions  and  are  not  symmetric.  However,  db44  pos¬ 
sesses  a  near-symmetric  attribute  (see  Eig.  9)  that  well-matched 
the  biosignals.  Most  biosignals  possess  sharp  spikes  that  could  be 
appropriately  analyzed  using  Daubechies’  wavelets  to  reflect  sharp, 
asymmetric  spikes  seen  in  these  signals.  These  features  of  db44 
suggest  that  it  would  be  effective  for  many  biosignal  processing 
methods  based  on  the  resemblance  of  the  signal  and  mother  wave¬ 
let  function. 

The  similarity  between  signal  and  mother  wavelet  function  is 
not  always  proper  for  signal  processing  based  on  wavelet  trans¬ 
form  and  it  is  just  appropriate  for  those  wavelet-based  processing 
methods  based  on  the  resemblance  between  signals  and  mother 
functions. 


Table  IB 

Studied  wavelet  families  in  detail  (Rafiee  et  al.,  2010). 


No 

Wave 

No 

Wave 

No 

Wave 

No 

Wave 

No 

Wave 

52 

1-1.5 

100 

3-1.1 

148 

dmey 

196 

2-0.6 

244 

2-0.2-0.4 

53 

1-1 

101 

3-1.2 

149 

meyr 

197 

2-0.7 

245 

2-0.2-0.5 

54 

1-0.5 

102 

3-1.3 

150 

mexh 

198 

2-0.8 

246 

2-0.2-0.6 

55 

1-0.3 

103 

3-1.4 

151 

O.l-O.l 

199 

2-0.9 

247 

2-0.2-0.7 

56 

1-0.2 

104 

3-1.5 

152 

0.1-0.2 

200 

1-1 

248 

2-0.2-0.8 

57 

1-0.1 

105 

3-1.6 

153 

0.1-0.3 

201 

1-0.1 -0.1 

249 

2-0.2-0.9 

58 

1-0.05 

106 

3-1.8 

154 

0.1-0.4 

202 

1-0.1 -0.2 

250 

2-0.2-1 

59 

1-0.02 

107 

3-1.9 

155 

0.1-0.5 

203 

1-0.1 -0.3 

251 

3-0.2-0.1 

60 

1-0.01 

108 

3-2 

156 

0.1-0.6 

204 

1-0.1 -0.4 

252 

3-0.2-0.2 

61 

2-0.1 

109 

3-2.1 

157 

0.1-0.7 

205 

1-0.1 -0.5 

253 

3-0.2-0.3 

62 

2-0.2 

110 

3-2.2 

158 

p 

p 

bo 

206 

1-0.1 -0.6 

254 

3-0.2-0.4 

63 

2-0.3 

111 

3-2.3 

159 

0.1-0.9 

207 

1-0.1 -0.7 

255 

3-0.2-0.5 

64 

2-0.4 

112 

3-2.4 

160 

0.1-1 

208 

1-0.1 -0.8 

256 

3-0.2-0.6 

65 

2-0.5 

113 

3-2.5 

161 

0.2-0.1 

209 

1-0.1 -0.9 

257 

3-0.2-0.7 

66 

2-0.6 

114 

3-2.6 

162 

0.2-0.2 

210 

l-O.l-l 

258 

3-0.2-0.8 

67 

2-0.7 

115 

3-2.7 

163 

0.2-0.3 

211 

2-0.1-0.1 
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Table  2A 

Wavelet  families  and  their  specifications. 


Property 

Haar 

Db 

Coif 

Mori 

Cmor 

Dmey 

Meyr 

Mexh 

Continuous  wavelet  transform 

v-' 

Discrete  wavelet  transform 

Complex  CWT 

Compact  supported  orthogonal 

v-' 

Compact  supported  biorthogonal 

Orthogonal  analysis 

Biorthogonal  analysis 

v-' 

Symmetry 

Near  symmetry 

Asymmetry 

Explicit  expression 

Table  2B 

Wavelet  families  and  their  specifications. 


Property 

Shan 

Fbsp 

Gaus 

Cgau 

Bior 

Rbio 

Sym 

Continuous  wavelet  transform 

Discrete  wavelet  transform 

Complex  CWT 

Compact  supported  orthogonal 

Compact  supported  biorthogonal 
Orthogonal  analysis 

Biorthogonal  analysis 

Symmetry 

Near  symmetry 

Asymmetry 

v-' 

v-' 

Explicit  expression 

For  splines 

For  splines 
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This  paper  presents  a  new  technique  for  feature  extraction  of  forearm  electromyographic  (EMG)  signals 
using  a  proposed  mother  wavelet  matrix  (MWM).  A  MWM  including  45  potential  mother  wavelets  is  sug¬ 
gested  to  help  the  classification  of  surface  and  intramuscular  EMG  signals  recorded  from  multiple  loca¬ 
tions  on  the  upper  forearm  for  ten  hand  motions.  Also,  a  surface  electrode  matrix  (SEM)  and  a  needle 
electrode  matrix  (NEM)  are  suggested  to  select  the  proper  sensors  for  each  pair  of  motions.  For  this  pur¬ 
pose,  EMG  signals  were  recorded  from  sixteen  locations  on  the  forearms  of  six  subjects  in  ten  hand 
motion  classes.  The  main  goal  in  classification  is  to  define  a  proper  feature  vector  able  to  generate  accept¬ 
able  differences  among  the  classes.  The  MWM  includes  the  mother  wavelets  which  make  the  highest  dif¬ 
ference  between  two  particular  classes. 

Six  statistical  feature  vectors  were  compared  using  the  continuous  form  of  wavelet  packet  transform. 
The  mother  wavelet  functions  are  selected  with  the  aim  of  optimum  classification  between  two  classes 
using  one  of  the  feature  vectors.  The  locations  where  the  satisfactory  signals  are  captured  are  selected 
from  several  mounted  electrodes.  Finally,  three  ten-by-ten  symmetric  MWM,  SEM,  and  NEM  represent 
the  proper  mother  wavelet  function  and  the  surface  and  intramuscular  selection  for  recording  the  ten 
hand  motions. 

Published  by  Elsevier  Ltd. 


1.  Introduction 

Classification  and  identification  of  biosignals  (e.g.  electromyo¬ 
graphic  (EMG)  (e.g.  Farina,  Merletti,  &  Enoka,  2004;  Merletti  &  Lo 
Conte,  1997;  Rasheed,  Stashuk,  &  Kamel,  2008)  is  still  a  challenge 
in  several  areas.  EMG  signals  are  complex  due  to  the  non-station- 
ary  characteristics  and  subject  dependency  of  the  signals  (Aschero 
&  Gizdulich,  2009).  EMG  signals  are  generally  divided  into  two 
main  groups:  surface  and  needle  EMG  signals.  Surface  EMG  signals 
have  attracted  remarkable  attention  in  the  design  and  manufactur¬ 
ing  of  artificial  limbs  (e.g.  Fukuda,  Tsuji,  Kaneko,  &  Otsuka,  2003; 
Silvestro  Micera,  Sabatini,  Dario,  &  Rossi,  1999).  EMG  classification 
is  a  complicated  task  since  several  parameters  may  effect  the  EMG 
signals,  e.g.  motor  unit  action  potential  (MUAP)  (e.g.  Kallenberg, 
Preece,  Nester,  &  Mermens,  2009),  muscle  fatigue  (e.g.  Vukova, 
Vydevska-Chichova,  &  Radicheva,  2008),  and  force  (Clancy, 
Bertolina,  Merletti,  &  Farina,  2008).  Two  difficulties  in  EMG  signal 
classification  for  prosthetic  applications  are  the  selection  of 
electrode  locations  on  the  forearm  and  the  extraction  of  a  feature 
vector  able  to  classify  several  motions,  since  the  EMG  signals  are 
subject  dependent.  This  research  addresses  these  challenges  in 
forearm  EMG  signals,  which  is  applicable  to  the  manufacturing  of 
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prosthetic  hands.  However,  this  research  would  not  be  able  to  ad¬ 
dress  the  other  significant  parameters,  such  as  force,  fatigue,  and  so 
forth  for  this  application  (e.g.  Disselhorst-Klug,  Schmitz-Rode,  & 
Rau,  2009;  Koike  &  Kawato,  1995;  Liu,  Herzog,  &  Savelberg,  1999). 

To  name  a  few  examples  of  prior  research.  Park  &  Lee  (1998) 
presented  a  fuzzy-based  decision-making  system  to  classify  six 
motions  of  the  six  subjects,  including  elbow  flexion  and  extension, 
wrist  pronation  and  supination,  and  in  and  out  humeral  rotation. 
Englehart,  Hudgins,  Parker,  &  Stevenson  (1999)  compared  fre¬ 
quency  domain  and  time-frequency  methods  to  preprocess  EMG 
signals  and  introduced  wavelet  packet  transform  with  satisfactory 
results.  Englehart,  Hudgins,  &  Parker  (2001)  applied  the  combina¬ 
tion  of  wavelet  packet  and  principal  component  analysis  to  extract 
suitable  features  from  myoelectric  signals  to  classify  six  classes  of 
hand  motions.  Englehart  &  Hudgins  (2003)  also  developed  a  wave¬ 
let-based  system  to  control  myoelectric  signals  of  four  classes  of 
hand  motions  with  high  accuracy,  low  response  time,  and  a  user 
interface  control  system  in  2003.  Lowery,  Stoykov,  Taflove,  & 
Kuiken  (2002)  presented  a  finite  element  method  (FEM)  model  to 
investigate  the  effect  of  skin,  muscle,  fat,  and  bone  tissue  on  simu¬ 
lated  surface  electromyographic  (EMG)  signals  and  demonstrated 
that  all  aforementioned  materials  have  an  effect  on  EMG  signals. 
Gazzoni,  Farina,  &  Merletti  (2004)  proposed  an  ANN-based 
automatic  detection  and  identification  system  to  pinpoint  motor 
unit  action  potentials  using  wavelet  transform  and  artificial  neural 
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Fig.  1.  A  cross  section  of  the  upper  forearm  to  illustrate  the  locations  of  16  surface 
electrodes  and  six  needle  electrodes  (Hargrove  et  al.,  2007,  with  permission). 


network  in  specific  case  studies.  Sebelius  et  al.  (2005)  introduced 
an  ANN-based  intelligent  system  to  classify  seven  hand  move¬ 
ments  for  limited  subjects. 

In  this  research,  a  statistical-based  feature  extraction  system  is 
presented  for  nine  hand  motions  plus  a  rest  state,  including  key 
grip  and  chuck  grip,  two  motions  known  for  their  difficulty  in 
classification. 

2.  Surface  and  intramuscular  EMG  signals 

In  this  research,  both  measures  of  forearm  EMG  signals  have 
been  collected  and  processed,  although  the  major  goal  is  surface 
EMG  signal  analysis,  which  is  applicable  to  prosthetics.  The  exper¬ 
imental  surface  and  intramuscular  EMG  signals  used  in  this  re¬ 
search  have  been  provided  by  the  Institute  of  Biomedical 
Engineering  at  the  University  of  New  Brunswick  with  a  protocol 
approved  by  the  University’s  Research  Ethics  Board  (Hargrove, 


Englehart,  &  Hudgins,  2007).  Two  different  data  acquisition  sys¬ 
tems  were  used  to  collect  surface  and  intramuscular  EMG  signals 
(Hermens  et  al.,  1999).  Eor  surface  EMG  signals,  a  16-electrode  lin¬ 
ear  array  with  interelectrode  spacing  of  2  cm  was  used  (see  Eig.  1 ). 
Each  channel  was  filtered  between  10  and  500  Hz  and  amplified 
with  a  gain  of  two  thousand.  Erequency  information  of  surface 
EMG  is  shown  in  Eig.  2  for  one  subject  using  power  spectrum  den¬ 
sity  (PSD).  Eor  intramuscular  EMG,  needles  were  implanted  in  the 
pronator  and  supinator  teres,  flexor  digitorum  sublimas,  extensor 
digitorum  communis,  and  flexor  and  extensor  carpi  ulnaris.  These 
measures  were  used  to  record  time-domain  signals  regarding  grip, 
wrist  flexion  and  rotation,  and  gross  movement.  These  six  channels 
of  data  were  also  Altered  and  amplified  (see  Eig.  1 ).  These  were  re¬ 
corded  in  six  subjects  while  they  performed  the  ten  hand  move¬ 
ments  for  5  s  each,  with  a  2  min  resting  period  after  each 
exercise.  The  tests  were  repeated  for  each  subject,  resulting  in 
10  s  of  EMG  signals  per  person  for  each  motion.  The  subjects  de¬ 
nied  feeling  fatigued  during  these  exercises.  The  studied  hand  mo¬ 
tions  includes  forearm  pronation  (EP),  forearm  supination  (PS), 
wrist  flexion  (WE),  wrist  extension  (WE),  wrist  abduction  (WAB), 
wrist  adduction  (WAD),  key  grip  (KG),  chuck  grip  (CG),  spread  An¬ 
gers  (SP),  and  a  rest  state  (RS). 


3.  Wavelet  transform 

Wavelet  transform  is  being  used  in  broad  areas  of  biosignal  pro¬ 
cessing  (e.g.  Beck  et  al.,  2005;  Cvetkovic,  Ubeyli,  &  Cosic,  2008; 
Hostens,  Seghers,  Spaepen,  &  Ramon,  2004;  Kurt,  Sezgin,  Akin, 
Kirbas,  &  Bayram,  2009;  Rafiee,  Rafiee,  Prause,  &  Schoen,  2009; 
Subasi,  2005;  Tscharner,  2008;  von  Tscharner,  2000;  Rafiee,  Rafiee, 
&  Michaelsen,  2009).  Wavelet  transform  (Daubechies,  1991)  is 
generally  divided  into  either  a  discrete  and  or  continuous  form 
(Unser  &  Aldroubi,  1996).  The  continuous  wavelet  transform 
(CWT)  of  a  signal  s(t)  is  defined  as  the  integral  of  the  product  be¬ 
tween  the  signal  s(t)  and  the  daughter  wavelets,  which  are  the  time 
translation  and  scale  expansion/compression  versions  of  a  mother 
wavelet  function  i/^(t).  Equivalent  to  a  scalar  production,  this  calcu¬ 
lation  generates  continuous  wavelet  coefficients  CWC  (a,b),  which 


100  200  300  400  100  200  300  400 

Frequency  (Hz) 


Fig.  2.  Power  spectrum  density  (PSD)  of  surface  EMG  signals  of  ten  hand  motions  recorded  from  one  of  the  16  channels  of  the  data  acquisition  system. 
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determine  the  similarity  between  the  signal  and  the  daughter 
wavelets  located  at  position  b  (time  shifting  factor)  and  positive 
scale  a: 

(,) 

where  *  stands  for  complex  conjugation  and  xj/  e  L^{R)\{0}.  In  the 
frequency  domain,  Eq.  (1)  is  expressed  as: 

f{CWC(a,  b)}  =  VaW*{a.CD)S{(D),  (2) 

where  FfCWC  (a,ib)},  and  5(cl>)  stand  for  the  Fourier  trans¬ 

forms  of  the  continuous  wavelet  coefficients  CWC  (a,b),  the  signal 
s(t),  and  the  mother  wavelet  function  ij/  (f),  respectively.  Eq.  (2) 
shows  that  a  mother  wavelet  function  is  a  band-pass  filter  in  the 
frequency  domain,  and  the  use  of  CWC  identifies  the  local  features 
of  the  signal.  According  to  the  theory  of  Fourier  transform,  the  cen¬ 
ter  frequency  of  the  mother  wavelet  W  (aco)  is  defined  asFo/a,  given 
that  the  center  frequency  of  the  ^{co)  is  Fq.  Consequently,  extrac¬ 
tion  of  frequency  contents  from  the  signal  is  possible  in  different 
scales.  In  the  windowed  Fourier  transform,  the  frequency  resolution 
is  constant  and  depends  on  the  width  of  window.  However,  wavelet 
transform  offers  a  rich  analysis  for  a  wide  variety  of  window  widths 
as  the  function  of  a.  Use  of  a  wide  variety  of  mother  wavelet  func¬ 
tions,  which  must  satisfy  the  admissibility  condition  C^,  is  another 
advantage  of  wavelet  analysis: 


J-oo  OJ 

Cxjj  is  satisfied  if  the  mean  value  of  the  mother  wavelet  function 
is  equal  to  zero  and  \jj[t)  decays  to  zero  rapidly  when  t  ->  ±00.  If  the 
mother  wavelet  satisfies  the  above  condition  as  well  as  orthogonal¬ 
ity,  the  signal  can  be  reconstructed  from  wavelet  coefficients. 

Unlike  DWT,  CWT  operates  at  any  scale  and  is  continuous  in 
terms  of  shifting.  In  the  calculation  of  CWC,  the  mother  wavelet 
is  shifted  smoothly  throughout  the  analyzed  signal/function  and 
gives  rich  time-frequency  information.  The  main  drawback  of 
CWT  is  that  the  computation  is  time-consuming.  For  signals  with 
low  signal  to  noise  ratio,  CWT  could  work  better  than  DWT  because 
DWT  down-sampling  of  the  signals  can  lead  to  the  loss  of  signifi¬ 
cant  information.  Wavelet  decomposition  of  the  signals  is  also  di¬ 
vided  into  two  main  branches:  pyramid  and  packet 
decompositions.  In  both  methods,  signals  are  divided  into  approx¬ 
imation  (low  frequencies)  and  detail  (high  frequencies)  in  the  first 
level.  In  the  pyramid  decomposition,  after  the  first  level,  only 
approximations  are  permitted  to  be  decomposed  through  higher 
levels.  However,  in  the  packet  decomposition  both  approximation 
and  detail  are  decomposed  into  further  levels.  Therefore,  packet 
decomposition  offers  rich  contents  of  signals.  For  EMG  signals, 
the  significant  frequency  contents  are  achieved  in  high  scales.  Con¬ 
tinuous  wavelet  transform,  which  means  continuous  shifting 
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Fig.  3.  Feature  extraction  algorithm. 
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Fig.  4.  Segmented  surface  EMG  in  a  256-points  window  from  one  subject  performing  10  hand  motions. 


through  time,  is  used  with  packet  decomposition  in  this  research. 
Therefore,  CWT  converts  a  one-dimensional  signal  s(t)  into  a  ma¬ 
trix  of  CWC  (a,b)  as  follows: 


CWC(a,h) 


T-  N-1 

lA’ 


\n-i)Ts 

a 


s(nTs), 


(4) 


where  i  =  0,1,2,. .  .,N,  Ts  and  N  stand  for  sampling  time  and  the 
number  of  samples,  respectively. 

In  classification,  feature  vector  is  defined  as  a  compressed, 
meaningful  vector/matrix  possessing  the  significant  information 
of  different  classes.  In  this  research,  CWC  is  used  for  the  calculation 
of  feature  vectors  for  EMG  signals.  The  CWC  of  the  signal,  itself,  is 
not  appropriate  as  a  feature  vector  because  it  is  computationally 
expensive.  Hence,  further  processing  is  needed  in  order  to  define 
a  precise  and  compressed  feature  vector,  which  is  explained  in 
the  next  section. 


4.  Mother  wavelet  matrix  and  sensor  selection 

Selection  of  the  mother  wavelet  function,  a  challenge  in  wavelet 
transform,  was  studied  in  this  research  by  introducing  MWM.  Prior 
contributions  on  mother  wavelet  functions  can  be  found  in  litera¬ 
ture  (e.g.  Brechet,  Lucas,  Doncarli,  &  Farina,  2007;  Farina,  do 
Nascimento,  Lucas,  &  Doncarli,  2007,  2008;  Lucas,  Gaufriau, 
Pascual,  Doncarli,  &  Farina,  2008;  Rafiee  &  Tse,  2009). 

Two  points  regarding  the  application  of  mother  functions  are 
discussed  here.  The  first  concern  is  the  selection  of  proper  mother 
wavelet  function  since  the  application  of  mother  wavelets  is  prob¬ 
lem-dependent.  Applicable  mother  wavelet  functions  in  EMG  sig¬ 
nal  processing  could  vary  depending  on  the  parameters  of  the 
problem  at  hand.  If  the  technique  is  based  on  the  similarity  of 
the  signal  to  the  mother  function,  then  the  most  important  factor 
is  the  amplitude  of  the  wavelet  coefficient  across  the  signals.  The 
mother  functions  similar  to  the  signal  are  not  suitable  for  all  wave- 
let-based  approaches.  A  clear  example  is  the  wide  application  of 


Fig.  5.  Decomposition  tree  and  the  level  of  decomposition. 
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the  Haar  function,  which  is  dissimilar  to  the  signals  but  has  been 
introduced  as  a  relatively  efficient  function  in  several  studies 
(Subramani,  Sahu,  &  Verma,  2006).  In  wavelet-based  classification 
systems  the  mother  wavelet  functions  are  related  to  the  problem 
parameters  rather  than  the  shape  of  signals,  unless  the  method 
was  established  based  on  signal  similarity.  Another  issue  in  EMG 
signal  classification  is  the  optimal  sensor  selection.  Applicable  sen¬ 
sor  selection  depends  on  the  problem  as  well.  For  example,  optimal 
selection  of  sensors  for  prosthetic  hands  to  classify  six  motions  is 
different  from  those  for  eight  motions.  To  reduce  the  computa¬ 
tional  time  for  real-time  control  of  a  prosthetic  hand,  the  optimal 
electrodes  to  be  chosen  are  presented  for  the  ten  motions  classifi¬ 
cation  by  introducing  surface  electrode  matrix  (SEM)  and  needle 
electrode  matrix  (NEM)  in  this  research. 

First,  the  feature  vector  is  defined  based  on  the  following  steps 
(see  flowchart  in  Fig.  3): 

1.  Signal  segmentation:  in  this  research,  surface  and  intramuscular 
EMG  signals  were  separately  classified  for  ten  hand  motions, 
although  intramuscular  EMG  signals  may  not  be  applicable  to 
prosthetics.  However,  comparisons  between  surface  EMG  classifi¬ 
cation  and  intramuscular  EMG  classification  may  be  helpful.  After 
recording  EMG  signals  by  means  of  sixteen  electrodes  for  surface 
and  six  electrodes  for  intramuscular  EMG,  the  raw  signals  were 
segmented  into  the  256-point  windows  (Hargrove  et  al.,  2007) 
as  shown  in  Fig.  4  for  surface  EMG  signals.  For  simplicity,  a  signal 
with  a  length  of  256  points  is  called  the  segmented  signal.  There¬ 
fore,  a  matrix  of  segmented  signals  (a  1 6  x  256  matrix  for  surface 
and  a  6  X  256  matrix  for  intramuscular  EMG)  can  be  one  input  for 
the  control  system  of  prosthetic  hand.  As  mentioned,  recorded 
EMG  signals  of  six  subjects  were  studied.  For  all  ten  motions,  sur¬ 
face  and  intramuscular  EMG  signals  were  recorded  in  two  sepa¬ 
rate  5-s  exercises  for  each  of  six  subjects  (40  segmented  signals 
for  each  subject/each  hand  motion  were  obtained). 

2.  In  the  fourth  decomposition  level  (see  Fig.  5),  continuous  wave¬ 
let  coefficients  of  the  segmented  signals  (CWC-SS)  were  calcu¬ 
lated  (2^scales  for  each  segmented  unit  signal). 

3.  The  average  of  the  absolute  value  of  the  segmented  signals 
(1  X  256  vector)  were  calculated  for  each  segmented  signal 
and  titled  ‘weight’  ( W)  to  construct  the  feature  vector  as  follows: 


(5) 

i=l 

where  N  is  the  number  of  datapoints  in  each  segmented  signal 
(256  in  this  research). 

4.  The  calculation  of  feature  vectors  -  six  feature  vectors  are  stud¬ 
ied  in  this  research: 

(^)  Weighted  sum  of  absolute  value  of  CWC-SS  (SA)  is  calcu¬ 
lated  as  the  sum  of  the  absolute  value  of  CWC-SS  multi¬ 
plied  by  the  average  of  the  absolute  value  of  the 
segmented  signals  (weight). 

SA(a, 5,  b)  =  wJ^g|CWC(a, 5,  (6) 

where  Ois  is  the  scale  related  to  (4, 15)  in  the  decomposition  tree 
(see  Fig.  5).  Scale  selection  is  another  important  issue  in  wavelet 
analysis.  Decomposing  the  signals  into  higher  scales  leads  to  a 
greater  focus  on  the  frequency  domain  (Rafiee  &  Tse,  2009).  Nev¬ 
ertheless,  computational  time  in  CWT  is  of  paramount  signifi¬ 
cance,  and  going  through  high  scales  makes  the  computations 
for  the  real-time  control  system  of  the  prosthetic  hand  difficult. 
In  this  research,  the  fourth  level  of  decomposition  has  been  con¬ 
sidered  the  reasonable  level.  Based  on  trial-and-error,  Uis  repre¬ 
sented  larger  wavelet  coefficients,  and  subsequently  the 
daughter  wavelet  at  this  scale  is  more  similar  to  both  classes  of 
EMG  signals,  which,  at  that  scale,  leads  to  a  greater  difference  in 
the  wavelet  coefficient  from  one  motion  to  another. 

(^)  Weighted  standard  deviation  of  CWC-SS  (SD)  is  calculated 
as  the  standard  deviation  of  CWC-SS  multiplied  by  the  aver¬ 
age  of  the  absolute  value  of  the  segmented  signals  (weight). 


5D(ai5,h)  = 


\  g(CWC„(ai5,b)  -CWC(ai5,b))' 


(7) 


where: 


CWC(ai5,b) 


1 

N 


^avc„(ai5,b) 


(8) 


Fig.  6.  Schematic  of  mother  wavelet  matrix  (MWM)  (Rafiee  et  al.,  2009). 
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Fig.  7a.  Extracted  features  from  surface  EMG  of  one  specific  subject  (sensor  13,  scale  (4,15). 


CM 


Fig.  7b.  CM  feature  extracted  from  surface  EMG  of  one  specific  subject  (sensor  13,  scale  (4,15). 
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Fig.  8a.  Mother  wavelet  matrix  for  surface  EMG  signals. 
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Fig.  8b.  Mother  wavelet  matrix  for  intramuscular  EMG  signals. 


y/  Weighted  variance  of  CWC-SS  (VR)  is  calculated  as  the 
variance  of  CWC-SS  multiplied  by  weight,  as  the  last  steps 
for  SD  and  SA  are  defined. 

y/  Weighted  fourth  central  moment  of  CWC-SS  (CM)  is  cal¬ 
culated  as  the  fourth  central  moment  of  CWC-SS  multi¬ 
plied  by  weight.  The  basic  formula  is  not  included  for 
simplicity. 

y/  Weighted  skewness  of  CWC-SS  (SK)  is  calculated  as  the 
skewness  of  CWC-SS  multiplied  by  weight. 
y/  Weighted  kurtosis  of  CWC-SS  (KU)  is  calculated  as  the 
kurtosis  of  CWC-SS  multiplied  by  weight. 

5.  All  these  features  are  normalized  to  make  the  calculations  con¬ 
sistent.  SA  feature  was  one  of  the  features  showing  better  clas¬ 
sification  performance  for  both  surface  and  intramuscular  EMG 
signals  comparing  to  the  others.  Therefore,  SA  was  considered 
the  main  feature  to  define  the  mother  wavelet  matrix.  Sche¬ 
matic  of  MWM  is  shown  in  Fig.  6.  In  this  figure,  the  horizon¬ 
tal/vertical  numbers  (1,2,... ,10)  corresponds  to  the  motions: 
forearm  pronation,  forearm  supination,  wrist  flexion,  wrist 
extension,  wrist  abduction,  wrist  adduction,  rest  state,  chuck 
grip,  key  grip  and  spread  fingers,  respectfully. 


After  selection  of  the  feature,  the  following  procedure  is  applied 
to  find  the  MWM,  SEM,  and  NEM: 

For  each  pair  of  motions  the  corresponding  entity  of  MWM  ma¬ 
trix  is  the  function  ijj  that  possesses  the  minimum  value  for  the  cri¬ 
terion,  C{il/): 

yij  =  1 , . . . ,  1 0  and !  9^jMWM(iJ}  =  lA :  mm  ^C(iA)  =  [  g  D,  (lA)^ 

(9) 


where  L  is  the  number  of  the  electrodes,  and  xjj  is  selected  from  a 
pool  of  324  wavelet  basis  function  (see  Tables  lA  and  IB) 


A(^) 


Ri{\l/)  + 

iMK^)-M,-(^)r 


(10) 


The  same  procedure  is  considered  to  calculate  MWM  for  intra¬ 
muscular  EMG  signals.  After  finding  MWM  matrix,  NEM  and  SEM 
matrices  can  be  obtained.  For  each  pair  of  motions,  the  correspond¬ 
ing  entity  of  SEM  matrix  is  the  surface  electrode  number  (see 
Fig.  1 ),  which  has  the  minimum  value  of  D/(i/^)  function  (Eq.  1 0)  cal¬ 
culated  for  corresponding  mother  wavelet  extracted  from  MWM 
matrix.  The  same  procedure  is  repeated  for  EMG  intramuscular  sig¬ 
nals  ending  up  with  NEM  matrix. 


5.  Results  and  discussion 

In  this  research,  six  statistical  features  are  studied  for  surface 
and  intramuscular  EMG  signals  as  shown  in  Fig.  7a  for  one  specific 
scale  recorded  from  a  specific  sensor  attached  to  the  arm  of  one 
subject.  Among  the  features,  SK  and  KU  did  not  show  proper  clas¬ 
sification  for  this  scale/sensor  and  neither  for  the  others 
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Fig.  9a.  Selected  sensors  within  surface  electrode  matrix  (SEM). 


where  Ri(iA)  is  the  range  of  SA  function  for  all  /<  =  1, . .  .,N  =  240  seg¬ 
mented  signals  for  i^^  motion  (N  =  240  since  there  are  six  subjects 
and  40  segmented  signals  for  each  subject): 

Riiij/)  =  \mink{SAik{il/))  -  maXfc(SAi/<(iA))|-  (11) 

In  Eq.  (10),  Miiij/)  is  the  average  value  of  SA  function  for  all 
k=\,...,N  segmented  signals  for  ith  motion: 


/<=! 


where  SAikiij/)  is  the  value  of  SA  function  for  ith  motion  and  kth  seg¬ 
mented  signal  calculated  by  Eq.  (6). 

By  minimizing  the  value  of  C(i/^)  and  therefore  the  value  of  D/ 
{il/)  for  each  pair  of  motions,  the  mother  wavelet  having  the  less 
range  of  feature  values  for  N  segmented  signals  and  more  differ¬ 
ence  between  two  motions  is  selected. 
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Fig.  9b.  Selected  intramuscular  sensors  within  needle  electrode  matrix  (NEM). 
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Table  lA 

Studied  wavelet  families  in  this  research. 


No. 

Family  (short  form) 

Order 

1 

Haar  (dbl) 

db  1 

2-45 

Daubechies  (db) 

db  2-db  45 

46-50 

Coiflet  (coif) 

coif  1-coif  5 

51 

Morlet  (Mori) 

morl 

52-147 

Complex  Morlet  (cmor  Fb-Fc)^ 

Included  Table  IB 

148 

Discrete  Meyer  (dmey) 

dmey 

149 

Meyer  (meyr) 

meyr 

150 

Mexican  Flat  (mexh) 

mexh 

151-200 

Shannon  (Shan  Fb-Fc)^ 

Included  Table  IB 

201-260 

Frequency  B-Spline  (fbsp  M-Fb-Fc)^ 

Included  Table  IB 

261-267 

Gaussian  (gaus) 

gaus  1  to  gaus7 

268-275 

Complex  Gaussian  (cgau) 

cgau  1  to  cgauS 

276-290 

Biorthogonal  (bior  Nr.Nd)'’ 

Included  Table  IB 

291-305 

Reverse  biorthogonal  (rbio  Nr.Nd)'’ 

Included  Table  IB 

306-324 

Symlet  (sym) 

sym  2  to  sym  20 

^  Fb  is  a  bandwidth  parameter,  Fc  is  a  wavelet  center  frequency,  M  is  an  integer 
order  parameter. 

'’Nr  and  Nd  are  orders:  r  for  reconstruction/d  for  decomposition. 


(see  Fig.  7a).  The  other  four  features  can  be  useful  for  forearm  EMG 
signal  classification.  It  is  worth  mentioning  that  CM  feature  shown 
in  Fig.  7a  cannot  visually  show  proper  classification.  However,  by 
zooming  on  the  CM  plot,  more  information  may  be  observed  as 
plotted  in  Fig.  7b. 

Also,  mother  wavelet  matrices  (MWM)  matched  with  our 
experimental  data  is  shown  in  Figs.  8a  and  8b  for  surface  and  intra¬ 
muscular  EMG  signals  respectfully  (see  Appendix  A,  for  function 
detail).  As  it  can  be  seen  from  the  matrix  in  Eig.  8a,  NEM  and 
SEM  have  been  also  depicted  in  Eigs.  9a  and  9b  for  surface  EMG 
dataset  used  in  this  research  for  validation.  The  numbers  in  these 
matrices  are  referred  to  the  sensor  number  shown  in  Eig.  1.  As  it 
can  be  seen  in  NEM  and  SEM,  sensor  number  9,  located  close  to 
extensor  digitorum  communis,  number  13,  located  in  between 
extensor  and  flexor  carpi  ulnaris,  and  number  15,  close  to  flexor 
carpi  ulnaris  offer  more  helpful  information  for  feature  extraction 
of  the  above  mentioned  ten  motions. 

The  advantages  of  the  proposed  technique  can  be  summarized 
as  follows: 


Table  IB 

Studied  wavelet  families  in  detail. 


No 

Wave 

No 

Wave 

No 

Wave 

No 

Wave 

No 

Wave 

52 

1-1.5 

100 

3-1.1 

148 

dmey 

196 

2-0.6 

244 

2-0.2-0.4 

53 

1-1 

101 

3-1.2 

149 

meyr 

197 

2-0.7 

245 

2-0.2-0.5 

54 

1-0.5 

102 

3-1.3 

150 

mexh 

198 

2-0.8 

246 

2-0.2-0.6 

55 

1-0.3 

103 

3-1.4 

151 

O.l-O.l 

199 

2-0.9 

247 

2-0.2-0.7 

56 

1-0.2 

104 

3-1.5 

152 

0.1 -0.2 

200 

1-1 

248 

2-0.2-0.8 

57 

1-0.1 

105 

3-1.6 

153 

0.1 -0.3 

201 

1-0.1 -0.1 

249 

2-0.2-0.9 

58 

1-0.05 

106 

3-1.8 

154 

0.1 -0.4 

202 

1-0.1 -0.2 

250 

2-0.2-1 

59 

1-0.02 

107 

3-1.9 

155 

0.1 -0.5 

203 

1-0.1 -0.3 

251 

3-0.2-0.1 

60 

1-0.01 

108 

3-2 

156 

p 

o 

204 

1-0.1 -0.4 

252 

3-0.2-0.2 

61 

2-0.1 

109 

3-2.1 

157 

0.1 -0.7 

205 

1-0.1 -0.5 

253 

3-0.2-0.3 

62 

2-0.2 

no 

3-2.2 

158 

00 

o 

d 

206 

1-0.1 -0.6 

254 

3-0.2-0.4 

63 

2-0.3 

111 

3-2.3 

159 

0.1 -0.9 

207 

1-0.1 -0.7 

255 

3-0.2-0.5 

64 

2-0.4 

112 

3-2.4 

160 

0.1-1 

208 

1-0.1 -0.8 

256 

3-0.2-0.6 

65 

2-0.5 

113 

3-2.5 

161 

0.2-0.1 

209 

1-0.1 -0.9 

257 

3-0.2-0.7 

66 

2-0.6 

114 

3-2.6 

162 

0.2-0.2 

210 

l-O.l-l 

258 

3-0.2-0.8 

67 

2-0.7 

115 

3-2.7 

163 

0.2-0.3 

211 

2-0.1-0.1 

259 

3-0.2-0.9 

68 

2-0.8 

116 

3-2.8 

164 

0.2-0.4 

212 

2-0.1 -0.2 

260 

3-0.2-1 

69 

2-0.9 

117 

3-2.9 

165 

0.2-0.5 

213 

2-0.1 -0.3 

276 

1.1 

70 

2-1 

118 

3-3 

166 

0.2-0.6 

214 

2-0.1 -0.4 

277 

1.3 

71 

2-1.1 

119 

4-0.1 

167 

0.2-0.7 

215 

2-0.1 -0.5 

278 

1.5 

72 

2-1.2 

120 

4-0.2 

168 

0.2-0.8 

216 

2-0.1 -0.6 

279 

2.2 

73 

2-1.3 

121 

4-0.3 

169 

0.2-0.9 

217 

2-0.1 -0.7 

280 

2.4 

74 

2-1.4 

122 

4-0.4 

170 

0.2-1 

218 

2-0.1 -0.8 

281 

2.6 

75 

2-1.5 

123 

4-0.5 

171 

0.5-0.1 

219 

2-0.1 -0.9 

282 

2.8 

76 

2-1.6 

124 

4-0.6 

172 

0.5-0.2 

220 

2-0.1-1 

283 

3.1 

77 

2-1.8 

125 

4-0.7 

173 

0.5-0.3 

221 

3-0.1-0.1 

284 

3.3 

78 

2-1.9 

126 

4-0.8 

174 

0.5-0.4 

222 

3-0.1 -0.2 

285 

3.5 

79 

2-2 

127 

4-0.9 

175 

0.5-0.5 

223 

3-0.1 -0.3 

286 

3.7 

80 

2-2.1 

128 

4-1 

176 

0.5-0.6 

224 

3-0.1 -0.4 

287 

3.9 

81 

2-2.2 

129 

4-1.1 

177 

0.5-0.7 

225 

3-0.1 -0.5 

288 

4.4 

82 

2-2.3 

130 

4-1.2 

178 

0.5-0.8 

226 

3-0.1 -0.6 

289 

5.5 

83 

2-2.4 

131 

4-1.3 

179 

0.5-0.9 

227 

3-0.1 -0.7 

290 

6.8 

84 

2-2.5 

132 

4-1.4 

180 

0.5-1 

228 

3-0.1 -0.8 

291 

1.1 

85 

2-2.6 

133 

4-1.5 

181 

1-0.1 

229 

3-0.1 -0.9 

292 

1.3 

86 

2-2.7 

134 

4-1.6 

182 

1-0.2 

230 

3-0.1-1 

293 

1.5 

87 

2-2.8 

135 

4-1.8 

183 

1-0.3 

231 

1-0.2-0.1 

294 

2.2 

88 

2-2.9 

136 

4-1.9 

184 

1-0.4 

232 

1-0.2-0.2 

295 

2.4 

89 

2-3 

137 

4-2 

185 

1-0.5 

233 

1-0.2-0.3 

296 

2.6 

90 

3-0.1 

138 

4-2.1 

186 

1-0.6 

234 

1-0.2-0.4 

297 

2.8 

91 

3-0.2 

139 

4-2.2 

187 

1-0.7 

235 

1-0.2-0.5 

298 

3.1 

92 

3-0.3 

140 

4-2.3 

188 

1-0.8 

236 

1-0.2-0.6 

299 

3.3 

93 

3-0.4 

141 

4-2.4 

189 

1-0.9 

237 

1-0.2-0.7 

300 

3.5 

94 

3-0.5 

142 

4-2.5 

190 

1-1 

238 

1-0.2-0.8 

301 

3.7 

95 

3-0.6 

143 

4-2.6 

191 

2-0.1 

239 

1-0.2-0.9 

302 

3.9 

96 

3-0.7 

144 

4-2.7 

192 

2-0.2 

240 

1 -0.2-1 

303 

4.4 

97 

3-0.8 

145 

4-2.8 

193 

2-0.3 

241 

2-0.2-0.1 

304 

5.5 

98 

3-0.9 

146 

4-2.9 

194 

2-0.4 

242 

2-0.2-0.2 

305 

6.8 

99 

3-1 

147 

4-3 

195 

2-0.5 

243 

2-0.2-0.3 
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1.  The  number  of  motions  was  increased  to  ten  hand  motions. 
Chuck  and  key  grips,  which  are  the  complicated  motions  for 
classification  because  of  the  engagements  of  several  in-depth 
muscles  and  complexity  of  the  signals,  were  studied  by  the  pro¬ 
posed  algorithm. 

2.  The  presented  features  would  also  be  appropriate  for  training 
purposes  of  intelligent  classifiers  (e.g.  Micera,  Sabatini,  &  Dario, 
2000;  Pandey  &  Mishra,  2009;  Rafiee  et  al.,  2009;  Xie,  Zheng, 
Guo,  Chen,  &  Shi,  2009)  or  to  determine  rules  for  fuzzy  systems 
(Chan,  Yang,  Lam,  Zhang,  &  Parker,  2000). 

3.  This  method  was  able  to  find  optimal  sensors  for  each  pair  of 
motions  applicable  for  classification  purposes. 

6.  Conclusions 

A  method  was  suggested  to  extract  appropriate  features  for 
forearm  electromyographic  (EMG)  signals  using  a  mother  wavelet 
matrix  (MWM).  After  broad  investigations  on  324  mother  wavelet 
functions,  the  combination  of  some  mother  wavelets  ameliorated 
the  EMG  signal  analysis.  Among  several  installed  electrodes  on 
the  subjects’  forearms,  the  optimal  sensors  appropriate  for  feature 
extraction  were  selected  in  terms  of  surface  electrode  matrix  (SEM) 
and  a  needle  electrode  matrix  (NEM).  Six  statistical  feature  vectors 
were  also  studied  in  this  research. 
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Abstract:  -  Skeletal  muscle  force  and  surface  electromyographic  (sEMG)  signals  are  closely  related.  Hence,  the 
later  can  be  used  for  the  force  estimation.  Usually,  the  location  for  the  sEMG  sensors  is  near  the  respective 
muscle  motor  unit  points.  EMG  signals  generated  by  skeletal  muscles  are  temporal  and  spatially  distributed 
which  results  in  cross  talk  that  is  recorded  by  different  sEMG  sensors.  This  research  focuses  on  modeling 
muscle  dynamics  in  terms  of  sEMG  signals  and  the  generated  muscle  force.  Here,  an  array  of  three  sEMG 
sensors  is  used  to  capture  the  information  of  the  muscle  dynamics  in  terms  of  sEMG  signals  and  generated 
muscle  force.  Optimized  nonlinear  Half-Gaussian  Bayesian  filters  and  a  Chebyshev  type-II  filter  are  used  for 
the  filtration  of  the  sEMG  signals  and  the  muscle  force  signal,  respectively.  A  Genetic  Algorithm  is  used  for  the 
optimization  of  the  filter  parameters.  sEMG  and  skeletal  muscle  force  is  modeled  using  multi  nonlinear  Auto 
Regressive  exogenous  (ARX)  and  Wiener-Hammer  stein  models  with  different  nonlinearity  estimators/classes 
using  System  Identification  (SI)  for  three  sets  of  sensor  data.  An  adaptive  probabilistic  Kullback  Information 
Criterion  (KIC)  for  model  selection  is  applied  to  obtain  the  fusion  based  skeletal  muscle  force  for  each  sensor 
first  and  then  for  the  final  outputs  from  each  sensor.  The  approach  yields  good  skeletal  muscle  force  estimates. 


Key-Words:  -  sEMG,  ARX,  Weiner-Hammer stein,  Prosthetic  hand,  KIC,  System  Identification, 


1  Introduction 

Aftereffects  of  the  loss  of  upper  limbs  are  a 
reduction  of  functionality  and  psychological 
disturbance  for  the  person.  According  to  [1]  there 
are  1.7  million  peoples  with  amputation  in  the 
United  States  and  this  number  is  on  rise  after  the 
Afghanistan  and  Iraq  war  in  2003  [2].  Conversely,  a 
prosthetic  limb  can  considerably  increase  the 
functionality  of  an  amputee  and  benefit  the  person 
in  everyday  life. 

In  the  past,  there  have  been  various  researeh 
works  towards  prosthetie  hand  design,  having 
similar  funetionality  and  appearanee  as  human  hand 
[3-4].  Most  of  these  researeh  works  are  based  on 
eleetromyography  (EMG).  The  EMG  signal  is 
aetivated  and  eontrolled  by  the  eentral  nervous 
system,  whieh  depends  on  the  flow  of  speeifie  ions 
sueh  as  sodium  (Na^),  potassium  (K^)  and  ealeium 
(Ca++). 

An  EMG  signal  reeorded  on  the  surfaee  of  the 
limb  is  expressed  as  an  eleetrie  voltage  ranging 
between  -5  and  +5  mV.  This  method  is  known  as 
surfaee  eleetromyography  (sEMG).  sEMG  is 


utilized  as  an  input  to  the  eontroller  to  realize  the 
movements  of  the  prosthesis  and  foree  eontrol  [5-6]. 
Past  researeh  results  show  that  EMG  signal 
amplitude  generally  inereases  with  skeletal  musele 
foree.  However,  this  relationship  is  not  always  rigid; 
various  faetors  affeet  this  relationship.  EMG  signals 
are  a  result  of  the  varying  motor  unit  reemitments, 
erosstalk,  and  bioehemieal  interaetion  within  the 
museular  fibres.  This  makes  EMG  signals  random, 
eomplex  and  dynamie  in  nature  and  the  eontrol  of 
the  prosthesis  diffieult.  Moreover,  it  ehanges 
eontinuously  due  to  the  onset  and  progression  of 
musele  fatigue  whieh  results  beeause  of  eontinuous 
high  frequeney  stimulation  or  beeause  of  titanie 
stimulation  [7].  Synehronization  of  aetive  motor 
units  along  the  musele  fibres,  and  a  deerease  in 
eonduetion  veloeity  are  refleeted  in  the  EMG  signal 
as  an  inerease  of  amplitude  in  time  domain  and  a 
deerease  of  medium  frequeney  in  frequeney  domain 
[7].  All  these  faetors  make  the  relationship  between 
EMG  and  foree  nonlinear.  Correet  interpretation  of 
EMG  signal  is  vital  to  aehieve  preeise  motion  and 
foree  eontrol  of  prosthesis. 
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Fig.  1:  The  Flow  Chart  for  Skeletal  Muscle  Force  Estimation. 


The  present  work  presents  a  novel  approach  to 
estimate  skeletal  muscle  force  using  an  adaptive 
multi-sensor  data  fusion  algorithm  with  hybrid 
nonlinear  ARX  and  Wiener-Hammerstein  models. 
Here,  an  array  of  three  sEMG  sensors  is  used  to 
capture  the  information  of  muscle  dynamics  in 
terms  of  sEMG  signals.  The  recorded  sEMG  signals 
are  filtered  utilizing  optimized  nonlinear  Half- 
Gaussian  Bayesian  filter  parameters,  and  the 
skeletal  muscle  force  signal  is  filtered  by  using  a 
Chebyshev  type-II  filter.  A  simple  Genetic 
Algorithm  code  is  used  to  optimize  the  Bayesian 
filter  parameters.  Using  an  input/output  approach, 
the  EMG  signal  measured  at  the  skin  surface  is 
considered  as  input  to  the  skeletal  muscle,  whereas 
the  resulting  hand/finger  force  constitutes  the 
output.  Multi  nonlinear  ARX  and  Wiener- 
Hammerstein  models  with  different  nonlinearity 


estimators/classes  are  obtained  using  SI  for  three 
sets  of  sensor  data  obtained  from  the  vicinity  of  a 
single  motor  unit.  Different  nonlinearity 
estimators/classes  are  used  for  nonlinear  modeling 
as  they  capture  the  dynamics  of  the  system 
differently.  The  outputs  of  estimated  nonlinear 
models  are  fused  with  a  probabilistic  Kullback 
Information  Criterion  (KIC)  for  model  selection  and 
an  adaptive  probability  of  KIC.  First,  the  outputs  are 
fused  for  the  same  sensor  and  for  different  models 
and  then  the  final  outputs  from  each  sensor.  The 
final  fused  output  of  three  sensors  provides  good 
skeletal  muscle  force  estimates. 

Fig.  1  shows  the  flow  chart  for  skeletal  muscle 
force  estimation.  This  paper  is  structured  as  follows. 
First,  the  experimental  set-up,  pre-processing  and 
filter  parameter  optimization  for  sEMG  signals  are 
discussed.  Second,  nonlinear  ARX  and  Wiener- 
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Fig.  2:  Experimental  Set-Up. 


(a)  Raw  Skeletal  Musele  Foree  Signal 


2  4  6  8  10  12 

Time  (60.35  sees)  x  io' 

(b)  Chebyshev  Type  -  II  Filtered  Foree  Signal 


2  4  6  8  10  12 

Time  (60.35  sees)  x  io' 


Fig.  3:  (a)  Raw  and  (b)  Chebyshev  Type-II  Filtered  Skeletal  Muscle  Force  Signals. 


FFammerstein  modeling  is  covered.  Third,  the  fusion 
of  various  nonlinear  model  outputs  using  KIC  and 
adaptive  probability  of  KIC  is  covered.  Finally,  the 
results,  discussion  and  future  work  are  provided 
followed  by  a  conclusion  to  summarize  the 
importance  of  this  work. 


2  Experimental  Set-Up  and  Pre- 
Processing 

The  experimental  set-up  is  shown  in  Fig.  2.  Both 
sEMG  and  muscle  force  signals  were  acquired 
simultaneously  using  Lab  VIEW™  at  a  sampling 
rate  of  2000  Hz.  The  sEMG  data  capturing  was 
aided  by  a  DELSYS®  Bagnoli-16  EMG  system 
with  DE-2.1  differential  EMG  sensors.  The 
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Rectified  EMG  for  Motor  Point  Sensor 


Half  Gaussian  Filtered  EMG  for  Motor  Point  Sensor 


Fig.  4(a):  Rectified  EMG  and  Half-Gaussian  Filtered  EMG  Signal  for  Motor  Point  Sensor. 


Rectified  EMG  for  Ring  1  Sensor 


Fig.  4(b):  Rectified  EMG  and  Half-Gaussian  Filtered  EMG  Signal  for  Ring  1  Sensor. 
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Rectified  EMG  for  Ring  2  Sensor 


Half  Gaussian  Filtered  EMG  for  Ring  2  Sensor 


2  4  6  8  10  12 

Time  (60.35  Seconds)  x  10^ 


Fig.  4(c):  Rectified  EMG  and  Half-Gaussian  Filtered  EMG  Signal  for  Ring  2  Sensor. 


corresponding  force  data  was  captured  using 
Interlink  Electronics  FSR  0.5”  circular  force  sensor. 
One  sEMG  sensor  was  placed  on  the  motor  point  of 
the  ring  finger  and  two  adjacent  to  the  motor  point 
of  a  healthy  subject.  Prior  to  placing  the  sEMG 
sensors,  the  skin  surface  of  the  subject  was  prepared 
according  to  International  Society  of 
Electrophysiology  and  Kinesiology  (ISEK) 
protocols.  According  to  previous  research,  the 
Bayesian  based  filtering  method  yields  the  most 
suitable  sEMG  signals  [8].  The  nonlinear  filter 
significantly  reduces  noise  and  extracts  a  signal  that 
best  describes  EMG  signals  and  may  permit 
effective  use  in  prosthetic  control.  An  instantaneous 
conditional  probability  density  P(EMG\x)  provides 
the  resulting  EMG  for  the  latent  driving  signal  x  [8]. 
The  model  for  the  conditional  probability  of  the 
rectified  EMG  signal  =  lEMGl  is  used  in  this 
current  estimation  algorithm.  EMG  signals  are 
usually  described  as  amplitude-modulated  zero 
mean  Gaussian  noise  sequence  [9].  For  the  rectified 
EMG  signal,  the  “Half-Gaussian  measurement 
model”  in  [8]  is  given  by  Equation  (1). 

Piemglx)  =  >.  (1) 


The  EMG  signal  is  modeled  for  the  conditional 
probability  of  the  rectified  EMG  signal  as  a  filtered 
random  process  with  random  rate.  The  likelihood 
function  for  the  rate  evolves  in  time  according  to  a 
Fokker-Planck  partial  differential  equation  [8].  The 
discrete  time  Fokker-Planck  Equation  is  given  by 
equation  (2). 

p{x,  t  ^  p{x  -  t  -  1)  +  (1  -  2  *  a)  * 
p{x,  t  —  1)  +  a  *  p(x  +  t  —  1)  +  ^  +  (1  —  * 

V{x.t-V).  (2) 

Here,  a  and  P  are  two  free  parameters,  a  is  the 
expected  rate  of  gradual  drift  in  the  signal,  and  P  is 
the  expected  rate  of  sudden  shifts  in  the  signal.  The 
unknown  driving  signal  x  is  discretized  into  bins  of 
width  £.  These  two  free  parameters  of  the  non-linear 
Half-Gaussian  filter  model  are  optimized  for  the 
acquired  EMG  data  using  elitism  based  GA.  GA 
belongs  to  a  class  of  optimization  algorithms  that 
are  based  on  observing  nature  and  its  corresponding 
processes  to  imitate  solving  complex  problems, 
most  often  optimization  or  estimation  problems,  see 
[10-12].  A  Chebyshev  type  II  low  pass  filter  with  a 
550  Hz  pass  frequency  is  used  to  filter  the  force 
signal.  Fig.  3  depicts  the  raw  and  Chebyshev  type-II 
low  pass  filtered  force  signals.  Fig.  4(a),  (b)  and  (c) 
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show  the  rectified  EMG  and  Half-Gaussian  Filtered 
EMG  signal  for  three  sensors. 


3  Nonlinear  ARX  and  Wiener- 
Hammerstein  Modeling 

In  this  paper,  we  are  using  nonlinear  ARX  and 
Wiener-Hammerstein  models  with  different 
nonlinearity  estimators/classes  to  model  three 
sEMG  sensors  data  as  input  and  skeletal  muscle 
force  data  as  output.  The  nonlinear  ARX  model  uses 
a  parallel  combination  of  nonlinear  and  linear 
blocks  [13]. 

Fig.  5  shows  the  nonlinear  ARX  model  structure. 
The  nonlinear  ARX  model  uses  regressors  as 
variables  for  nonlinear  and  linear  functions. 
Regressors  are  functions  of  measured  input-output 
data  [13].  The  predicted  output  y(t)  of  a  nonlinear 
model  at  time  t  is  given  by  the  general  Equation  (3): 

y(t)  =  F(x(t))  (3) 

where  x(t)  represents  the  regressors,  F  is  a 
nonlinear  regressor  command,  which  is  estimated  by 
nonlinearity  estimators/classes  [13].  As  shown  in 
Fig.  5,  the  command  F  can  include  both  linear  and 
nonlinear  functions  of  x(t).  Equation  (4)  gives  the 
description  of  F. 

FM  =  T.k=i  -  Yk))  (4) 

where  k  is  the  unit  nonlinear  command,  d  is  the 
number  of  nonlinearity  units,  and  aj^,  and  are 
the  parameters  of  the  nonlinearity  estimators/classes 
[13]. 

The  Wiener-Hammerstein  model  uses  one  or  two 
static  nonlinear  blocks  in  series  with  a  linear  block. 
Structural  representation  of  a  nonlinear  Wiener- 
Hammerstein  is  shown  in  Fig.  6  [13]. 

The  general  Equations  (5),  (6),  and  (7)  can 
describe  the  Wiener-Hammerstein  structure  [13]. 


w(t)  =  /(u(t)) 

(5) 

II 

(6) 

y(t)  =  h(x(t)). 

(7) 

where  u{t)  and  y(t)  are  input  and  output  of  the 
system,  respectively,  /  and  h  are  nonlinear 
functions,  which  corresponds  to  input  and  output 
nonlinearity,  respectively,  w(t)  and  x(t)  are 
internal  variables,  where  w(t)  has  the  same 
dimensions  as  u(t)  and  x(t)  has  the  same 
dimensions  as  y(t),  and  B(q)  and  F(q)  corresponds 
to  the  linear  dynamic  block,  these  are  polynomials 
in  the  backward  shift  operator. 

The  nonlinearity  classes  used  in  this  work  are 
Wavenet,  Treepartition,  Sigmoidnet,  Pwlinear, 
Saturation,  and  Deadzone.  For  motor  point  and 
ringl  sensors,  three  nonlinear  ARX  and  four 


nonlinear  Wiener-Hammerstein  models  with 

different  nonlinearity  estimators/classes  are 

obtained.  For  ring2  sensor,  three  nonlinear  ARX  and 
five  nonlinear  Wiener-Hammerstein  models  with 
different  nonlinearity  estimators/classes  are 

obtained.  Tables  1,  2  and  3  gives  the  nonlinearity 
estimators/classes  for  different  sensors  and  their 
corresponding  model  fit  values. 


Fig.  5:  Nonlinear  ARX  Model  Structure. 


Input  u(t) 


Output  y  (t) 


Fig.  6:  Nonlinear  Wiener-Hammerstein  Model 
Structure. 


4  Data  Fusion  and  Adaptive  KIC 
Probability 

Data  fusion  of  multiple  outputs  of  nonlinear  ARX 
and  Wiener-Hammerstein  models  is  done  by 
assigning  a  particular  probability  to  each  individual 
model  [14].  First,  the  fusion  algorithm  is  applied  to 
the  outputs  of  different  nonlinear  ARX  and  Wiener- 
Hammerstein  models  for  each  sensor  obtained  using 
different  nonlinearity  estimators.  Second,  the  fusion 
algorithm  is  again  applied  to  the  final  fusion  based 
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Table  1:  Different  Nonlinearity  Estimators  and  Model  Fit  Values  for  Motor  Point  Sensor. 


S.No. 

Model 

Nonlinearity  Class 

Model  Fit 

1. 

nlarxl 

Wavenet 

24.78  % 

2. 

nlarxZ 

Treepartiton 

40.46  % 

3. 

nlarxS 

Sigmoidnet 

48.75  % 

4. 

nlhwZ 

Wavenet 

32.38  % 

5. 

nlhwS 

Pwlinear 

26.27  % 

6. 

nlhwA 

Saturation 

55.16% 

7. 

nlhwS 

Deadzone 

42.45  % 

Table  2:  Different  Nonlinearity  Estimators  and  Model  Fit  Values  for  Ringl  Sensor. 


S.No. 

Model 

Nonlinearity  Class 

Model  Fit 

1. 

nlar  x31 

Wavenet 

-60.76  % 

2. 

nlar  x32 

Treepartiton 

-52.64  % 

3. 

nlarx33 

Sigmoidnet 

-39.36  % 

4. 

nlhw31 

Pwlinear 

31.06% 

5. 

nlhw32 

Sigmoidnet 

10.05  % 

6. 

nlhw33 

Saturation 

31.57% 

7. 

nlhw3S 

Wavenet 

32.36  % 

Table  3:  Different  Nonlinearity  Estimators  and  Model  Fit  Values  for  Ring2  Sensor. 


S.No. 

Model 

Nonlinearity  Class 

Model  Fit 

1. 

nlar  x21 

Wavenet 

-25.12  % 

2. 

nlarx22 

Treepartiton 

-22.31  % 

3. 

nlar  x23 

Sigmoidnet 

-33.65  % 

4. 

nlhw21 

Pwlinear 

34.69  % 

5. 

nlhw22 

Sigmoidnet 

34.76  % 

6. 

nlhw23 

Saturation 

33.3  % 

7. 

nlhw2A 

Deadzone 

34.94  % 

8. 

nlhw2S 

Wavenet 

34.89  % 

outputs  of  each  sensor;  this  gives  good  force 

estimate.  SI  model  fit  value  gives  the  probability  for 

[|7— f  11 
1  —  -J  *  100. 

The  model  selection  criterion  used  in  this  paper  is 
KIC.  The  sum  of  two  directed  divergences,  which  is 
the  measure  of  the  models  dissimilarity,  is  known  as 
Kullback’s  symmetric  or  J-divergence  [15],  as  given 
by  Equation  (8). 


^  ^  n  (Pi  +  l)n 

KIC(,pO^-\ogRi+^‘^\  \ 
Z  n  —  Pi  —  Z 


nip  +  gin), 


(8) 


where  g(n)  =  n  *  log(n/2). 


The  following  fusion  algorithm  as  given  by  [14]  is 
applied  for  data  fusion  of  the  outputs  of  different 
nonlinear  ARX  and  Wiener-Hammer  stein  models: 

1)  Identify  models  M2,  using  sEMG 

data  (u)  as  input  and  force  data  (T)  as  output, 
for  k  number  of  sensors  collecting  data 
simultaneously. 

2)  Compute  the  residual  square  norm 


Y- 

ll>^- 

where  0/  = 

r,  and 

r 

Ip 

y-l 

^p-1 

...  ul 

0  = 

^p+i 

^p+1 

Ip 

...  ul 

3“^ 

<-1  1 

n-2 

...  ul_p 
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Fig.  7:  Data  Fusion  and  Adaptive  KIC  Probability. 


3)  Calculate  the  model  criteria  coefficient  using 
Equation  (8). 

4)  Compute  the  model  probability  p(Mj|Z)  = 

e-h 

—r — z/-?  where  I  is  model  selection  criterion, 

T.J=ie 

i.e.  KICipi). 

5)  Compute  the  fused  model  output  Yf  = 

Y.Uvm2)Yi. 

6)  Compute  the  overall  model  from  Yf  and  force 
data. 

Here  all  the  computation  from  step  2)  to  6)  is 
adaptive  i.e.  the  residual  square  norm,  KIC(pi), 
model  probability  p(Mj|Z),  and  fused  model  output 
Yf  are  being  updated  with  time  or  for  each  data 
point.  Fig.  7  shows  the  flow  chart  for  fusion  of 
outputs  and  adaptive  probability  of  KIC. 


5  Results,  Discussion  and  Future 
Work 

This  section  deals  with  the  results,  discussion  and 
future  work.  The  following  plots  show  the  nonlinear 


(ARX  and  Wiener-Hammerstein)  model  and 
adaptive  fusion  algorithm  based  estimated  force 
output  for  each  sensor  first  and  then  finally 
combined  adaptive  fusion  based  output  for  all  three 
sensors.  Fig.  8  shows  the  overlapping  plot  of  the 
original  and  adaptive  fusion  based  force  output  for 
the  motor  point  sensor.  The  output  is  the  result  of 
the  adaptive  fusion  algorithm  on  three  nonlinear 
ARX  and  four  nonlinear  Wiener-Hammerstein 
models  for  the  motor  point  sensor  signal.  Fig.  9 
shows  the  overlapping  plot  of  the  original  and 
adaptive  fusion  based  force  output  for  ringl  sensor. 
This  output  is  the  result  of  adaptive  fusion  algorithm 
of  three  nonlinear  ARX  and  four  nonlinear  Wiener- 
Hammerstein  models  for  ringl  sensor  signal.  Fig.  10 
shows  the  overlapping  plot  of  the  original  and 
adaptive  fusion  based  force  output  for  ring2  sensor. 
This  output  is  the  result  of  adaptive  fusion  algorithm 
on  three  nonlinear  ARX  and  five  nonlinear  Wiener- 
Hammerstein  models  for  ring2  sensor  signal.  Fig.  11 
shows  the  overlapping  plot  of  the  original  and  final 
combined  adaptive  fusion  based  force  output  for 
motor  point,  ringl  and  ring2  sensors.  The  output  is 
the  result  of  adaptive  fusion  algorithm  on  the  final 
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Original  Force  and  NL-ARX  -  NL-HW-2-3-4-5  Models  Fused  Output  -  Sensor  Motor  Point 


Time  xio^ 

Fig.  8:  Original  and  Fusion  Based  Output  for  Motor  Point  Sensor. 


Original  Force  and  NL-ARX  -  NL-HW  -  Models  Fused  Force  Output  -  Ringl  Sensor 


Fig.  9:  Original  and  Fusion  Based  Output  for  Ringl  Sensor. 
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Original  Force  and  NLARX  -  NIrHW  Models  Fused  Output  -  Ring2  Sensor 


Time  xio‘ 

Fig.  10:  Original  and  Fusion  Based  Output  for  Ring2  Sensor. 


Original  Force  and  NL-ARX  -  NL-HW  Models  Output  -  MotorPoint  -  Ringl  -  Ring2  Sensors 
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Fig.  1 1 :  Final  Plot  -  Original  and  Fusion  Based  Output  for  All  Three  Sensors. 
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Error  Plot  ■  Original  and  Best  Model  Simulated  Output  for  Mo  tor  Point  Sensor 


Fig.  12:  Error  Plot  -  Original  and  Best-Estimated  Model  Output  for  Motor  Point  Sensor. 


Final  Error  Plot  ■  Original  andFused  Output -MotorPoint.Ringl  andRing2  Sensors 


Fig.  13:  Final  Error  Plot  -  Original  and  Fusion  Based  Output  for  Motor  Point,  Ringl  and  Ring2  Sensors. 
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outputs  of  three  sensors  i.e.  motor  point,  ringl  and 
ring2  as  shown  in  Fig.  8  to  10.  Fig.  11  shows  the 
best  skeletal  musele  foree  estimate,  whieh  is  the 
result  of  the  multi  nonlinear  ARX  and  Wiener- 
Hammerstein  models  and  an  adaptive  hybrid  data 
fusion  on  these  nonlinear  models.  Fig.  12  shows  the 
error  plot  of  the  original  and  best-estimated  model 
output  for  the  motor  point  sensor. 

Fig.  13  shows  the  error  plot  of  original  and  final 
multi  nonlinear  modeled  and  adaptive  hybrid  data 
fusion  based  foree  estimate  (results  from  three 
sensors,  nonlinear  modeling  and  adaptive  data 
fusion  algorithm).  If  we  eompare  Fig.  12  and  13,  it 
is  very  elear  and  eonspieuous  that  the  error  has 
deereased  remarkably  and  is  very  elose  to  zero. 

Future  work  will  foeus  on  the  improvement  of 
the  data  eolleetion  teehniques  and  experimental  set¬ 
up.  By  using  the  eombination  of  linear  and 
nonlinear  modeling,  and  adaptive  hybrid  data 
fusion,  the  skeletal  musele  foree  estimate  ean  be 
improved  further.  Furthermore,  the  authors  believe 
that  by  using  different  model  seleetion  eriteria  sueh 
as  Akaike  Information  Criterion  (AIC),  Kullbaek 
Information  Criterion  (KIC)  and  the  Bayesian 
Information  Criterion  (BIC)  together  to  obtain  final 
skeletal  musele  foree  estimate  will  give  improved 
results. 


6  Conclusions 

sEMG  and  foree  data  aequired  using  three  EMG  and 
one  eommon  FSR  foree  sensor  is  modeled  using 
nonlinear  SI.  Using  different  nonlinearity 
estimators/elasses,  multi  nonlinear  ARX  and 
Wiener-Hammerstein  models  are  obtained  for  eaeh 
sensor.  First,  the  outputs  of  different  models  for 
eaeh  sensor  are  fused  with  a  data  fusion  algorithm 
and  an  adaptive  KIC  probability.  Finally,  the  fused 
outputs  from  eaeh  sensor  are  again  fused  with  same 
algorithm  and  adaptive  KIC  probability.  The  final 
estimated  foree  using  this  teehnique  gives  the  best 
estimate.  The  presented  approaeh  ean  be  utilized  for 
eontrolling  prosthetie  hands  [16]. 
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Abstract — This  paper  presents  an  intelligent  adaptive 
neuro-fuzzy  inference  system  (ANFIS)  based  fuzzy  Mamdani 
controller  for  a  multifingered  prosthetic  hand.  The  objective 
of  the  controller  is  to  move  the  finger  joint  angles  along  pre¬ 
determined  paths  representing  a  grasping  motion.  The 
initiation  of  the  grasping  task  is  evaluated  via  EMG-entropy 
data,  measured  at  the  forearm  of  the  prosthetic  user.  In 
addition  to  the  motion  control,  the  finger  force  is  regulated 
with  a  Fuzzy  logic  controller.  Simulation  results  indicate 
good  performance  of  the  proposed  controller.  Results  show 
that  the  outputs  follow  the  hand/finger  force  and  given 
reference  trajectory  closely. 


I.  INTRODUCTION 

The  design  of  a  prosthetic  hand  is  challenging  because 
of  sensing,  classification,  mechanical,  electrical,  control 
and  cosmetic  issues.  Creating  a  best  solution  to  the  user  is 
a  big  concern  in  the  design  of  each  limb  prosthesis.  Degree 
of  amputation,  residual  of  motor  points  for  different 
fingers,  and  the  needs  and  abilities  of  the  user  have  to  be 
addressed.  Certain  degree  of  adaptation  is  required  for 
each  user.  A  high  degree  of  customization  is  required  as 
per  the  specifics  of  different  users  because  each  has 
different  gender,  size,  side,  and  degree  of  loss.  All  these 
differences  cause  the  complexity  and  challenges  in 
assembly  and  fitting  [1]. 

In  the  traditional  design,  each  joint  has  separate 
mechanical  substitute  and  requirements.  Since  a  single 
controller  operates  the  entire  prosthesis,  the  controller  has 
a  critical  role  to  play.  Depending  on  the  degree  of 
amputation,  there  are  limited  numbers  of  control  signals 
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available.  Therefore,  designing  an  efficient  control 
strategy  based  on  these  limited  inputs  for  the  maximum 
operating  range  is  a  challenging  task  [1]. 

Similar  to  artificial  neural  networks  (ANNs),  fuzzy 
inference  systems  (FISs)  are  excellent  tools  to  design 
human-made  systems  that  can  deal  with  the  information 
processing  like  a  human  brain  [2,  3]. 

First,  using  a  set  of  membership  functions  (MF),  the 
fuzzy  system,  fuzzifies  inputs  to  values  at  interval  [0,  1], 
and  then  it  is  inferred  by  fuzzy  logic  through  rules  in  the 
form  of  IF-THEN.  Mamdani  fuzzy  model  uses  linguistic 
models  bases  on  the  collection  of  IF-THEN  rules.  The 
Mamdani  model’s  fuzzy  rule  is  given  by  Equation  (1). 

= 

If  Xi  A[  and  X2  is  A2  ■■■  i^  then  is  B\ 

(1) 

where  R\l  =  1,2, denotes  the  fuzzy  rule, 
Xj(j  =  1,2,  ...,n)  is  the  n^^  input,  is  the  output  of  the 

fuzzy  rule  and  i42^  ■■■  =  1,2, ...,/)  are 

fuzzy  membership  functions  [3,4]. 

In  this  method,  a  nonlinear  system  is  approximated 
using  several  linear  systems  by  decomposing  the  entire 
input  space  into  several  partial  fuzzy  spaces  and  assigning 
a  linear  equation  to  each  output.  Sugeno-type  systems  are 
more  suitable  to  give  a  precise  solution  whereas  Mamdani- 
type  systems  are  best  suited  to  obtain  a  good  linguistic 
interpretability  [3,4]. 

The  EMG  signal  originates  because  of  the 
neuromuscular  activity  in  the  body.  Surface 
electromyographic  (sEMG)  signals  are  captured 
noninvasively  and  give  access  to  physiological  processes 
responsible  for  the  contraction  of  muscles.  sEMG  signal  is 
complicated  and  dynamic  in  nature.  Apart  from  instrument 
characteristics,  physiological  factors  and  anatomical 
properties  also  affects  sEMG  signal,  which  makes  it 
change  from  person  to  person.  Presently,  sEMG  signals 
are  the  most  common  input  for  the  design  of  a  controller 
for  prosthetic  hand  and  are  in  use  since  1948  [5].  In  past 
several  EMG-based  algorithms  have  been  developed  and 
used  to  enhance  the  functionality  and  usability  of 
prosthetic  hands  [5].  Large  number  of  degrees  of  freedom, 
and  highly  nonlinear  coupled  dynamics  make  the  control 
of  multi-fingered  robotic  hand  complicated  [6].  In  addition 
to  the  position  control,  the  tactile  sensing  and  force  control 
is  also  required;  this  makes  it  a  more  complex  problem. 
There  has  been  active  research  in  the  area  of  position  and 
force  control  of  a  robotic  hand,  the  typical  approach  is 
hybrid  position  and  force  control  given  by  [7]. 


A  method  based  on  support  vector  machines  is 
proposed  in  [9].  This  method  can  detect  the  opening  and 
closing  actions  of  the  human  thumb,  index  and  other 
fingers,  which  are  recorded  using  EMG.  The  method  was 
tested  and  used  for  the  control  of  the  DLR  four-finger 
hand  II  [10].  Another  method  given  in  [11]  is  called  as 
Tendon-activated  pneumatic  (TAP)  control.  TAP  hand 
claims  a  natural  degree  of  control  on  force,  duration,  and 
coordination  of  multiple  finger  movements.  An  ANFIS 
based  intelligent  approach  that  integrates  a  real-time 
learning  scheme  to  identify  hand  motion  commands  is 
proposed  in  [8].  The  common  assumption  that  the 
instantaneous  value  of  the  myoelectric  signal  contains  no 
information  is  the  bases  for  most  of  the  commercial 
myoelectric  control  systems.  Generally,  users  are  trained 
to  stimulate  the  muscle  for  a  constant  level  of  activation 
and  the  prostheses  are  tuned  according  to  these  EMG 
values.  Since,  the  active  modification  of  recruitment  and 
firing  patterns  needed  to  sustain  a  contraction,  so  very 
little  temporal  structure  are  present  in  steady-state  EMG 
signal  [12].  The  parameters  like  variance,  mean  absolute 
value  or  Fourier  spectrum,  median  frequency  can  be  used 
to  quantify  the  amplitude  of  EMG  signal,  but  usually  not 
sufficient  to  distinguish  between  more  than  two  classes  of 
movement. 

We  are  using  the  entropy  values  as  inputs  to  design  an 
ANFIS  based  fuzzy  controller  for  a  prosthetic  hand.  In 
physical  sense,  entropy  is  related  to  the  amount  of 
‘disorder’  in  the  system  and  is  proportional  to  the 
logarithm  of  the  number  of  microstates  available  to  a 
thermodynamic  system.  Shannon  and  Weaver  in  [13]  gave 
the  concept  of  entropy  for  information  theory.  Later  on 
Johnson  and  Shore  in  [14]  used  entropy  for  the  power 
spectrum  of  a  signal.  For  instance,  a  signal  has  an  entropy 
value  of  zero  if  its  sequential  values  are  alternate  of  one 
fixed  magnitude  and  then  of  another  fixed  magnitude.  A 
signal  with  zero  entropy  value  is  completely  regular  and 
very  predictable.  In  contrast,  a  signal  has  higher  entropy  if 
a  random  number  generator  generates  its  sequential 
values.  Using  entropy,  we  can  visually  distinguish  a 
regular  signal  from  an  irregular  one.  Entropy  is 
independent  of  absolute  scales  and  can  be  computes  by 
various  methods  like  approximate  entropy  [15,  16]  or 
Shannon  entropy  [13,  16,  17]  in  time  domain  and  spectral 
entropy  [13,  14,  18,  19]  in  frequency  domain. 

In  this  paper,  an  ANFIS  based  Mamdani  controller  is 
designed  for  prosthetic  hand  to  control  the  grasping  action. 
From  11  healthy  subjects  hand/finger  force  and  sEMG 
signals  were  captured  for  index,  middle  and  ring  fingers 
after  detecting  the  respective  motor  points  using  a  muscle 
stimulator.  Two  experiments  were  conducted  for  each 
subject  for  grasping  a  stress  ball  using  power  grip.  Entropy 
values  are  computed  for  each  signal  and  each  person.  The 
non-normalized  Shannon  entropy  is  given  by  Equation  (2). 

E(s)  = -Y.isf  *\og(sf).  (2) 

where  5  is  the  signal  and  5j  the  coefficients  of  5  in  an 
orthonormal  basis. 


Using  these  entropy  values  as  input  a  Mamdani 
controller  is  designed.  Figure  1  shows  the  flowchart  of 
grasping  action  for  human  hand. 


Figure  1 :  Flowchart  of  Grasping  Action  for  Human 
Hand. 


II.  Experimental  Set-Up  and  Data  Capturing 

Motor  point  locations  for  ring,  middle,  and  index 
finger  were  detected  using  muscle  stimulator.  Three 
sensors  were  placed  for  three  motor  points  of  ring,  middle 
and  index  finger.  Prior  to  placing  the  EMG  sensors,  the 
skin  surface  of  the  subject  was  prepared  according  to 
International  Society  of  Electrophysiology  and 
Kinesiology  (ISEK)  protocols.  Two  experiments  for  the 
power  grip  of  dominant  hand  of  the  subject  were 
conducted  for  ten  subjects  and  EMG  signals  for  all  three 
sensors  were  acquired  simultaneously  using  DELSYS® 
Bagnoli-16  EMG  system  with  DE-2.1  differential  EMG 
sensors.  The  corresponding  force  data  was  captured  using 
NI  ELVIS  with  Interlink  Electronics  FSR  0.5”  circular 
force  sensor  and  Lab  VIEW^^  8.2  at  a  sampling  rate  of 
2000  Hz.  The  experimental  set-up  is  shown  in  Figure  2. 


CPU 

Figure  2:  Experimental  Set-Up. 


III.  Proposed  Design 

In  this  proposed  design,  entropy  is  taken  as  the  threshold 
value  to  initiate  the  motion  by  the  fuzzy  controller.  The 
entropy  values  are  extracted  from  the  EMG  signals  of  the 
index,  middle  and  ring  fingers  respectively  when  a  power 
grip  is  done.  Table  1  shows  the  entropy  values  for  the 
EMG  data  taken  for  11  different  subjects.  Ringi  and 
Middle  1  in  the  Table  1  correspond  to  the  entropy  of  the 
respective  finger  right  next  to  its  motor  point  location. 
Table  2  gives  the  threshold  values.  The  threshold  values 
are  calculated  as  the  difference  between  the  mean  and 
twice  the  standard  deviation.  The  reason  for  taking  the 
difference  as  the  threshold  value  is,  that  the  controller 
should  be  initiated  even  if  the  sensors  are  misplaced  from 
the  motor  units  or  to  eliminate  the  problems  that  are 
caused  by  the  difficulty  in  identification  of  motor  units  in 
some  cases. 

Table  1:  Entropy  values  of  EMG  Signal  for  Different 
Eingers. 


Index 

Ring 

Middle 

Ring! 

Middlei 

2.9792 

2.9271 

2.1554 

2.3994 

1.6711 

2.6783 

3.0008 

1.9376 

2.3947 

1.5346 

3.4943 

2.9556 

3.0277 

2.9568 

2.6673 

3.679 

3.1714 

2.9268 

3.1175 

3.0581 

3.2110 

2.7015 

1.9228 

2.7997 

1.2993 

2.8451 

2.9429 

1.9555 

3.0541 

1.1095 

1.4653 

1.5559 

3.7151 

2.4827 

1.6919 

1.9371 

1.4639 

3.6648 

3.2785 

1.7955 

2.7399 

3.7132 

3.0820 

3.0425 

2.3929 

2.5421 

3.5961 

2.8593 

2.6782 

2.2040 

Table  2:  Threshold  values  for  Index,  Ring  and  Middle 
Einger  EMG  Signal. 


Index 

Ring 

Middle 

1.3724 

1.5176 

1.522 

In  this  proposed  design,  entropy  values  are  used  to 
establish  a  threshold  value  for  initiation  of  finger  motion. 
The  fuzzy  logic  determines  the  correlation  between  the 
entropy  and  the  corresponding  force.  The  Mamdani  type 
fuzzy  logic  is  used  to  in  this  design.  The  fuzzy  logic 
implemented  in  this  design  has  four  inputs  and  two 
outputs.  The  inputs  for  the  fuzzy  logic  are  the  threshold 
values  for  individual  finger  (index,  ring  and  middle)  and 
the  entropy  values.  The  output  of  the  fuzzy  logic  are  the 
control  signals  to  initiate  the  motion  based  on  the 
threshold  values  and  the  control  signal  for  the  force  based 
on  the  entropy  values.  Eigure  3  shows  the  entire  rule  base 
for  the  developed  fuzzy  logic. 

In  the  Eigure  3,  columns  1,  2,  3  represent  the  rules  for 
the  sigmoidal  membership  function  of  input  (i.e.)  index, 
middle  and  ring  fingers  respectively  and  the  corresponding 
threshold  values. 


Eigure  3:  Rules  for  Euzzy  Logic. 


The  sigmoidal  function  enables  the  initiation  of 
movement  for  an  entropy  value,  which  is  greater  than  or 
equal  to  threshold  value  of  individual  fingers.  4*  and  6* 
columns  give  the  rule  base  for  the  correlation  of  entropy 
with  the  corresponding  force.  The  entropy  range  into  three 
levels  classifies  the  force. 


The  rules  for  the  proposed  fuzzy  controller  are  given 
below: 

1.  If  I,  is  4,  Ml  is  Mf,  Ri  is  R^-  then  the  control  signal 
is  power  grip  close. 

2.  If  4  is  not  4,  is  not  and  Ri  is  not  then 
control  signal  is  power  grip  open. 

3.  If/,  is  4  then  control  signal  is  index  finger  close. 

4.  If/,  is  not  4  then  control  signal  is  index  finger 
open. 

5.  If  Mj  is  Mf  then  control  signal  is  middle  finger 
close. 

6.  If  Mj  is  not  Mf  then  control  signal  is  middle 
finger  open 

7.  If  Rj  is  Rf  then  control  signal  is  ring  finger  close. 

8.  If  Ri  is  not  Rf  then  control  signal  is  ring  finger 
open. 

9.  If  entropy  is  low,  then  control  signal  is  low  force. 

10.  If  entropy  is  medium,  then  the  control  signal  is 
medium  force. 

11.  If  entropy  is  high,  then  the  control  signal  is  high 
force. 


In  the  above  rules  4^  ^i,  Ri  are  the  input  entropy  values 
and  4^  Rf  are  the  threshold  values  for  individual 
index,  middle  and  ring  fingers  respectively. 

In  conventional  work,  ANNs  was  used  to  detect  the 
recognition  of  human  motor  and  to  control  the  prosthetic 
robotic  hand/arm  in  several  groups.  Eor  instance,  Eukuda 
et  al.  achieved  the  EMG  control  of  the  prosthetic  hand  by 
using  the  probabilistic  NN  controller  120] . 


and  62 . 

After  the  initiation  of  movement  and  the  force 
definition  from  the  fuzzy  logic  the  path  planning  is  done 
by  ANFIS.  Inverse  kinematics  is  proposed  to  achieve  the 
mechatronic  design  of  the  arm.  This  contributes  to  a  two- 
joint  robotic  arm  with  the  two  angles,  61  is  the  angle 
between  the  reference  and  the  first  joint,  and  62  the  angle 
between  the  first  arm  and  the  second  joint.  Figure  4 
illustrates  the  two-joint  robotic  arm  with  the  two  angles, 
61  and  62 . 

Based  on  the  input-output  data,  this  learning  algorithm 
tunes  the  membership  of  fuzzy  inference  systems.  In  this 
paper,  the  input-output  data  refers  to  the  coordinate  angles, 
which  act  as  input  to  ANFIS.  The  learning  algorithm 
makes  the  ANFIS  to  map  the  coordinates  to  the  angles  in 
its  training  process.  The  trained  ANFIS  network  is  learned 
to  map  the  input  and  output  and  is  ready  to  be  deployed  in 
the  large  control  system  solution  at  the  end  of  the  training 
process.  In  this  proposed  design,  the  first  joint  is  limited  to 
its  rotation  and  is  between  zero  to  90  degrees.  Similarly, 
the  second  joint  has  the  limited  rotation,  between  zero  to 
180  degrees. 


Figure  5 :  X,  Y-  coordinates  Generated  for  All  Possible  61 
and  62  Values. 

Figure  5  shows  X,  Y-  data  points  generated  by  cycling 
through  different  combinations  of  61  and  62  and  deducing 
X  and  y  coordinated  for  each.  The  ANFIS  networks  should 
be  able  to  predict  the  angles  they  have  to  be  trained  with 
sample  input-output  data.  The  first  ANFIS  network  is 
trained  with  X  and  Y  coordinates  as  input  and 
corresponding  61  value  as  output.  This  input-output  data  is 


used  to  train  the  first  ANFIS  network.  Similarly,  the 
second  ANFIS  network  is  trained  with  X  and  Y 
coordinates  as  input  and  corresponding  62  values  as 
output.  After  the  completion  of  the  training  process,  the 
ANFIS  networks  are  learned  to  approximate  the  angles 
(61,  62)  as  a  function  of  coordinates  (x,  y).  The  fuzzy 
approach  in  ANFIS  enables  the  approximation  of  the 
angles  for  the  coordinates  that  are  similar  but  not  exactly, 
the  same  as  it  was  trained.  The  two  ANFIS  networks  are 
capable  of  approximating  angles  for  the  coordinates  that 
lies  between  two  points  that  were  included  in  the  data  set. 
This  allows  controller  to  move  the  arm  smoothly  in  the 
allowed  space.  61  and  62  values  can  be  deduced 
mathematically  from  the  x  and  y  coordinates  using  inverse 
kinematics  formulae.  Using  this  mathematically  deduced 
61  and  62  values  the  two  ANFIS  networks  are  validated. 
The  inverse  kinematics  formulae  are  given  in  Equations 
(3)  to  (8). 


ki  =  -\- 12  *  C2.  (3) 

^2  ~  ^2  *  *^2*  (^) 

Old  =  tan“^2(T,X)  -  tan“^(A:2, /ci).  (5) 

C2  =  +  V^-  ll  -  ii)/(2  *  k  *  k)-  (6) 

S2  =  V(1  -  c|)-  (7) 

02^  =  tan  1  2(s2,C2).  (8) 


X  and  Y  are  the  transformed  domain  specified  by  vectors  x 
and  y  into  arrays.  li  and  I2  are  length  of  arm  1  and  arm  2 
respectively. 


Figure  6:  Surface  Plot  for  Entropy  and  Its  Corresponding 
Force. 


Figure  7:  Surface  Plot  for  the  Threshold  Values  for 
Individual  Fingers  and  the  Control  Signal  for  Initiation  of 
Motion. 


Figures  6,  7  shows  the  surface  plots  of  the  developed 
fuzzy  logic.  Figure  6  deduces  the  relationship  between  the 
entropy  and  force.  The  force  is  a  function  that  correlates 


with  the  entropy  classification.  Therefore,  the  fuzzy  logic 
achieves  the  control  for  the  initiation  of  motion  and  force 
corresponding  to  entropy. 


IV.  Results 


Figure  9:  Force  Correlation 

Force  correlation  with  the  entropy  of  the  EMG  signal 
is  achieved  by  the  classification  of  entropy  into  three  sets 
(i.e.)  high,  medium  and  low.  Figure  9  shows  the  controller 
force  that  is  correlated  with  the  entropy  values.  It  also 
exhibits  the  trend  with  the  original  force  data  measured 
from  the  FSR  while  performing  the  power  grip.  The 
amplification  of  the  force  is  also  achieved. 

After  initiating  the  finger  movements  by  the  fuzzy 
inference  system  based  on  the  threshold  values,  the  ANFIS 
output  follows  the  given  reference  trajectory.  The 
reference  data  is  generated  by  applying  a  bell  shaped 
membership  function  to  the  inverse  kinematics  equations. 
The  output  of  the  ANFIS  for  eleven  training  data  sets  to 
track  the  reference  data  generated  is  shown  in  Figure  10.  It 
follows  the  same  path  as  the  reference  data.  Figure  11 
shows  the  variation  of  the  difference  between  the 
generated  reference  data  and  the  ANFIS  output  data.  From 
this  figure  it  is  evident  that  the  controller  is  fast  since  the 
error  is  nullified  quickly.  The  training  for  the  ANFIS 
network  is  done  in  such  a  way  that  the  error  converges  to 
zero  over  time.  OiD  and  62D  are  the  deduced  6  values 
and  are  calculated  by  using  the  inverse  kinematics.  O^P 
and  92P  are  predicted  from  the  ANFIS.  Figure  12  shows 
the  difference  between  the  deduced  and  predicted  values. 
The  errors  are  small,  which  indicates  that  ANFIS  predicts 
the  6  values  close  to  deduced  ones. 


Figure  10:  Validation  of  ANFIS  Output. 


Time  (Micro  secs) 


Figure  1 1 :  Difference  between  Reference  Data  and  ANFIS 
Output  Data. 


Figure  13:  Path  Tracking  by  ANFIS  Controller. 


The  path  tracking  of  the  ANFIS  to  follow  an  object  in 
the  workspace  is  demonstrated  in  Figure  12.  The  object  in 
the  figure  is  the  reference  trajectory.  The  tip  of  the  second 
joint  moves  along  the  trajectory.  If  the  object  is  moved  to 
some  other  location  in  the  workspace,  the  tip  of  the  second 
joint  tracks  the  change  and  moves  along  the  new 
trajectory.  Hence,  the  proposed  controller  initiates  the 
motion  through  the  fuzzy  logic  with  correlation  for  force 
and  the  path  planning  is  achieved  by  the  ANFIS. 


X 


V.  Conclusion  And  Future  Work 

An  ANFIS  based  fuzzy  controller  is  designed  for  a 
prosthetic  hand.  Controlled  output  follows  the  given 
reference  trajectory  very  closely,  at  the  same  time  the  error 
between  the  deduced  and  predicted  angles  are  very  small. 
This  justifies  the  accuracy  of  ANFIS  designed  fuzzy 
controller.  The  designed  controller  can  also  track  the 
change  of  the  reference  trajectory  in  the  workspace  and 
moves  the  link  to  the  new  trajectory.  In  addition  to  the 
position,  the  correlation  for  force  is  achieved  by  the  fuzzy 
logic.  In  the  future  work  we  are  planning  to  implement 
model-based  position  and  force  estimation  and  then  the 
controller  design  for  position  and  force  control. 
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Abstract —  Extracting  or  estimating  skeletal  hand/finger 
forces  using  surface  electro  myographic  (sEMG)  signals  poses 
many  challenges  due  to  cross-talk,  noise,  and  a  temporal  and 
spatially  modulated  signal  characteristics.  Normal  sEMG 
measurements  are  based  on  single  sensor  data.  In  this  paper, 
array  sensors  are  used  along  with  a  proposed  sensor  fusion 
scheme  that  result  in  a  simple  Multi-Input-Single-Output 
(MISO)  transfer  function.  Experimental  data  is  used  along  with 
system  identification  to  find  this  MISO  system.  A  Genetic 
Algorithm  (GA)  approach  is  employed  to  optimize  the 
characteristics  of  the  MISO  system.  The  proposed  fusion-based 
approach  is  tested  experimentally  and  indicates  improvement 
in  finger/hand  force  estimation. 

L  Introduction 

The  number  of  people  with  missing  limbs  due  to  combat 
and  non-combat  operations  in  the  United  States  is  over  1 .2 
million  according  to  [1].  The  recent  wars  in  Afghanistan  and 
Iraq  substantially  increased  the  number  of  amputees.  To  date 
there  are  no  prosthetic  devices  available  at  an  affordable  cost 
and  with  the  full  functionality  of  a  human  hand.  The  need 
for  such  a  device  in  these  days  is  becoming  more  important. 
There  are  multiple  types  of  hand  prostheses.  One  of  these 
types  is  based  on  measuring  sEMG  signals  to  initiate  the 
actuation  of  the  robotic  hand.  In  this  paper,  surface  based 
EMG  sensors  are  used  in  order  to  avoid  invasive  methods  of 
measuring  EMG  signals  [2].  The  major  problem  in  capturing 
the  sEMG  signal  is  cross-talk  from  different  motor  units.  As 
a  muscle  contracts  several  motor  units  fire  simultaneously 
and  hence  make  up  the  EMG  signal  [3]. 
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The  number  of  motor  units  in  individual  muscles  varies 
from  person  to  person  and  muscle  fatigue  begins  at  the  onset 
of  contraction  and  is  ongoing  throughout  (i.e.)  time  to 
contraction  failure  or  reduction  in  force  generating  capacity 
of  the  muscle.  The  EMG  signal  passes  through  several  layers 
of  tissues  before  reaching  the  skin  surface  [3].  This 
contributes  to  noise  and  interference  in  signal  acquisition. 
The  randomness  of  the  EMG  signal  is  an  added  difficulty  in 
studying  it.  All  of  these  factors  make  it  rather  complex  to 
discriminate  the  content  of  the  EMG  signal  against  noise  and 
interference.  Identification  of  the  content  of  the  EMG  signal 
should  focus  on  the  amplitude,  frequency  and  amplitude- 
frequency  content  using  distinct  methods.  Since  the  signal  is 
amplitude  modulated  and  time  dependent,  it  is  therefore 
spatially  and  temporally  frequency  encoded  [4]. 

An  approach  to  distinguish  the  onset  of  muscle 
contraction  was  introduced  by  Merlo  et  al.  [5].  In  their  study, 
the  sEMG  sensors  collect  the  action  potential  of  individual 
motor  units  which  are  in  turn  identified  by  using  a 
continuous  wavelet  transform.  Accuracy  of  determining  the 
intended  force  from  the  EMG  signal  is  improved  by  using  an 
array  sensor.  Array  sensors  use  multi-channel  EMG 
electrodes  embedded  into  a  small  surface  area  in  order  to 
capture  the  electrical  muscle  activity  from  a  set  of  muscles 
fibers  at  the  skin  level.  The  EMG  sensor  array  approach 
produces  a  micro  level  and  a  macro  level  sensor  network  by 
utilizing  several  array  sensors  at  different  skin  locations  of 
the  forearm.  An  array  of  micro  sensors  with  the  objective  to 
extract  signals  from  one  motor  unit  corresponds  to  the  micro 
level.  The  main  objective  of  this  arrangement  is  to  use 
redundant  data  to  infer  the  hand  motion  by  including  cross¬ 
talk.  Also,  a  multi-channel  methodology  is  proposed  where 
elements  of  the  sensor  array  is  discarded  based  on  the 
quality  of  the  signal  [6].  A  simple  sensor  fusion  scheme  to 
improve  the  estimated  hand/fmger  force  from  measured 
sEMG  data  based  on  Bayesian  approaches  was  given  [7]. 

In  the  following,  Genetic  Algorithm  (GA)  is  used  to 
accomplish  the  sensor  fusion  algorithm  [8].  Briefly,  GA’s 
are  evolutionary  algorithms  that  simulate  Darwin’s  survival 
of  the  fittest  principle.  The  initial  population  of  candidate 
solutions  is  randomly  generated  and  represented  as 
chromosomes  in  the  form  of  genes.  These  chromosomes  are 
evaluated  based  on  an  objective  function  and  ranked  in  terms 
of  its  fitness.  A  subset  of  the  next  generation  of  candidate 
solutions  is  selected  based  on  their  performance  with  the 
objective  function.  The  remaining  set  of  the  new  generation 
is  generated  by  a  mating  process,  where  the  best  performing 
candidate  solution  comprise  the  subset  of  the  parents.  In 


addition  to  the  mating  process,  a  mutation  rate  is  also 
embedded  in  the  generation  of  the  new  population.  The 
mutation  rate  enables  the  search  for  the  optimum  solution  to 
overcome  local  minimums  and  locate  the  global  minimum. 
This  process  of  selection,  mating,  and  mutation  is  repeated  a 
number  of  times  until  the  best  performing  candidate  solution 
converges  to  some  stationary  value.  GA’s  have  the 
capability  of  overcoming  local  minima,  some  additional 
advantages  of  a  genetic  algorithm  are  the  ease  with  which 
large  numbers  of  parameters  can  be  handled,  the  fact  that 
they  do  not  require  the  traditional  approach  of  taking 
derivatives,  the  fact  that  they  result  in  a  set  of  optimum 
candidate  solutions  rather  than  a  single  candidate  solution, 
and  that  they  work  well  with  experimental  data  as  well  as 
simulated  data. 

The  approach  presented  in  this  paper  is  based  on 
extracting  useful  information  from  all  sensors  in  the  array. 
To  infer  the  intended  motion  from  the  sensor  array,  we 
propose  to  use  an  optimized  non-linear  filter.  Optimization 
techniques  are  used  as  filters  to  fuse  the  EMG  data  from 
different  sensors.  The  fusion  process  is  done  in  the 
frequency  domain. 

The  paper  is  structured  as  follows.  The  experimental  set 
up  is  given  in  Section  II  and  Section  III  provides  background 
on  sensor  fusion.  Section  IV  details  the  results  and 
discussion  and  in  the  last  section  some  conclusions  are 
provided. 

II.  Experimental  set-up 

Experiments  were  carried  out  on  a  healthy  male  subject  in 
order  to  collect  EMG  data  from  all  the  sensors 
corresponding  to  each  individual  motor  unit.  The 
mcheppuotor  points  of  the  subject  and  the  appropriated 
EMG  electrode  attachment  points  were  identified  by  using  a 
wet  probe  point  muscle  stimulator  (Rich-Mar  Corporation, 
model  number  HV  1100.).  For  capturing  the  EMG  data  from 
the  skin  surface,  a  Delsys,  Bagnoli-16  channel  EMG,  DS- 
160,  S/N-1 116  system  is  used.  This  capturing  system  has  the 
capability  of  internally  amplifying  and  reducing  the  acquired 
noise.  Pronged  DE  2.1  differential  surface  electrodes  are 
used.  For  recording  EMG  at  the  forearm  superficial 
musculature  (flexor  digitorum  superficialis)  electrodes  are 
placed  to  extract  EMG  signals.  The  force  data  is  measured 
by  a  force  sensitive  resistor  (FSR).  The  data  acquisition  is 
set  to  a  sampling  rate  of  2000  samples  per  second  for  force 
and  EMG  signal  data. 

III.  Sesnor  Fusion  Background 

The  sensor  fusion  process  deals  with  association, 
correlation  and  estimation  of  data  from  multiple  sensors.  A 
data  fusion  technique,  by  combining  the  data  from  different 
sensors,  enables  one  to  achieve  more  specific  inferences 
about  the  measured  data.  The  sEMG  sensors  pick  up  the 
cross-talk  from  muscle  fibers  adjacent  to  motor  units.  In  [7], 
sensor  fusion  was  done  in  the  time  domain,  by  taking  sEMG 
as  input  and  force  signal  as  the  output.  They  used 


combinations  of  different  filters  (Butterworth,  Chebyshev, 
Exponential  and  Half-Gaussian  filters)  and  different 
information  criteria  based  on  Akaike  (AIC),  Bayesian  (BIG), 
and  Kull-back  (KIC)  and  concluded  that  the  KIC  criterion 
with  Half  Gaussian  filtering  gives  the  best  EMG-Force 
model  fit. 

In  the  present  case,  sensor  fusion  is  done  in  the  frequency 
domain  for  the  sEMG  data.  Figure  1  depicts  the  flow 
diagram  of  the  proposed  fusion  technique  using  a  simple 
elitism  based  GA.  The  data  from  the  three  sensors  around 
the  individual  motor  unit  are  fused  by  first  rectifying  the 
data  and  then  filtering  it  using  a  Half-Gaussian  filter.  The 
sEMG  data  u^,U2,  and  from  the  three  sensors  and  their 
corresponding  force  signal  is  used  to  identify  a  dynamical 
relationship  between  the  sEMG  signals  and  the  force  signals 
using  System  Identification  (SI).  In  this  proposed  fusion 
algorithm,  SI  is  achieved  by  utilizing  an  Output  Error  (OE) 
model  first  for  each  individual  data  set  [9].  The  OE  model 
structure  is  given  as  follows: 

y(t)  =  (1) 

where  B,  and  F  are  the  polynomials,  q  is  shift  operator,  e(t) 
is  output  error,  y(t)  is  system  output,  u  is  input,  nk  is  the 
system  delay  and  t  is  time  index. 

The  corresponding  continuous-time  model  is  given  by  the 
transfer  function. 

rCc'\  =  =  bnbS^^'^~^^bnb-iS^'^'’~^^+-+bi 

F(S)  s"/+/„^5"/-1+-+A  • 

Similar  to  the  discrete -time  case  the  orders  of  the 
numerator  and  denominator  are  determined  by  nb  and  nf. 
For  multi-input  systems,  nb  and  nf  are  row  vectors.  b,f  are 
the  coefficients  of  the  numerator  and  denominator 
polynomials  respectively. 

Based  on  the  poles  of  the  three  individual  identified  OE 
models,  corresponding  to  each  sensor,  a  MISO  transfer 
function  (//)  is  constructed.  While  the  denominators  of  the 
respective  individual  transfer  functions  (corresponding  to 
each  OE  model)  are  transferred  over  to  the  new  MISO 
transfer  function,  the  corresponding  zeros  are  found  through 
the  use  of  a  GA.  Generally  GA’s  can  find  global  optimum 
points  if  elitism  is  used  and  sufficient  number  of  generations 
are  allowed  in  the  algorithm.  This  optimization  algorithm  is 
rather  computationally  expensive,  but  since  there  was  not  a 
computational  time  requirement,  one  is  free  to  use  GA  rather 
than  other  intelligent  based  algorithms.  Chromosomes  are 
constructed  by  designating  each  zero  of  a  numerator  as  a 
gene.  Since  a  discrete  time  model  is  utilized,  the  search  area 
is  limited  to  the  unit  circle  (and  the  resulting  MISO  model  is 
decreased  to  be  minimum  phase).  The  number  of  potential 
zeros  was  set  to  the  order  of  the  corresponding  denominator 
because  the  number  of  zeros  is  at  most  the  number  of  poles 
(for  a  causal  system,  can’t  predict  the  future).  The  objective 


function  was  set  as  the  error  squared  of  the  resulting  MISO  validation  data  sets.  The  output  of  the  fused  model  exhibits 

system  (//)  (see  appendix)  and  the  recorded  force  signal.  an  82%  fit  with  the  actual  force  signal. 

Here  H  is  given  as, 
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where  Z’s  and  P’s  are  the  zeros  and  poles  respectively  of 
individual  transfer  function  and  n  is  the  order  of  the  system. 
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Figure  1:  Flow  Diagram. 


IV.  Results  And  Discussion 


The  actual  force  signal  from  the  FSR  sensor  is  filtered 
using  a  Chebyshev  Type  II  high  pass  filter  followed  by  a  low 
pass  filter.  The  EMG  signal  is  rectified  and  filtered  using  a 
Half-Gaussian  filter  to  minimize  the  noise  content.  The  filter 
parameters  for  the  Half-Gaussian  filter  are  selected  in  such  a 
way  that  the  effective  EMG  signal  frequency  content  is  no 
more  than  500  Hz,  according  to  the  ISEK  standards  [10]. 
Figure  2  shows  the  results  of  the  fusion  based  force  Y 
plotted  against  actual  measured  force.  The  predicted  force 
matches  the  actual  force  characteristics  well.  Figure  3  shows 
the  estimated  force  output,  for  the  individual  OE  models 
which  were  used  to  construct  the  fusion  model  and  the  actual 
measured  force.  It  is  apparent  that  the  individual  force 
estimates  from  each  OE  model  do  not  track  the  actual  force 
as  well  as  the  estimated  force  from  the  fused  model  H.  In 
particular,  the  magnitudes  are  substantially  different.  While 
not  the  most  optimal  identification  was  determined,  the 
improvement  indicated  by  the  fused  model  output  compared 
to  the  individual  OE  outputs  is  significant.  The  output  of  the 
fused  model  fits  with  peaks  of  the  original  force  data. 
Several  validation  tests  for  the  fused  model  are  done  by 
feeding  new  data  sets  to  the  MISO  transfer  function  (//). 

Figure  4  and  5  shows  the  plot  between  the  actual  force 
data  and  the  predicted  force  data  for  two  representative 
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Figure  2  :  Final  Fused  Force  Vs.  Actual  Force. 
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Figure  3:  Estimated  Force  Output  for  Individual  OE  Model 
and  the  Actual  Measured  Force. 


Figure  4:  Validation  Plot  for  Data  Set-I. 
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Figure  5:  Validation  Plot  for  Data  Set-II. 


Figure  6:  Comparison  between  Actual,  Fusion  Based  and 
Single  OE  Model  Output  Force. 

In  order  to  visualize  the  improvement  achieved  with 
regard  to  the  form  of  the  predicted  force,  Figure  6  is 
generated  to  depict  the  actual  force  measured  compared  to 
the  output  of  the  fused  model  (predicted  force)  and  the 
predicted  force  from  one  of  the  OE  models  used  to  construct 
the  fused  model.  The  amplitudes  were  modulated  in  order  to 
show  the  different  shapes  of  the  wave  forms.  It  is  apparent 
that  the  fused  model  output  matches  the  measured  finger 
force  better  than  an  individual  OE  force  estimate.  While 
there  are  some  additional  higher  frequency  terms  in  the 
estimated  finger  force,  the  general  trend  and  lower 
frequencies  are  well  matched.  The  higher  frequency 
elements  are  necessary  parts  of  the  MISO  model  since  finger 
forces  can  change  rather  quickly,  as  indicated  in  Figure  2. 

V.  Conclusion 

Although  better  individual  models  can  be  inferred  using 
SI  under  perfect  conditions,  the  proposed  fusion  algorithm 
improves  the  predicted  force  estimate  consistency.  The 
fusion  algorithm  results  in  a  single  MISO  transfer  function. 
Cross  talk  can  be  reduced  by  using  filtering  and  in  this  work 
a  Half-Gaussian  filter  is  used.  This  also  enables  the 
smoothing  of  the  fused  signal.  Several  validation  data  sets 
were  used  to  test  the  proposed  fusion  algorithm.  Compared 
to  single  OE  model,  the  proposed  fusion-based  force  model 


is  in  good  agreement  with  that  of  the  actual  force.  Future 
work  will  address  the  optimization  of  the  SI  and  the 
associated  experimental  conditions  in  order  to  arrive  at 
better  individual  OE  models.  Also  the  optimization  of  the 
poles  and  the  number  of  zeros  will  be  undertaken  in  order  to 
obtain  a  minimum  realization  of  the  MISO  system.  In 
addition,  the  MISO  system  is  an  ideal  structure  to 
incorporate  dynamics  related  to  muscle  fatigue,  which  will 
be  addressed  in  future  work. 

Appendix 

The  resulting  MISO  transfer  function  H  is  constructed  as. 
From  Ui  to  output, 

5^-3.8435^  +  7.7295^-10.785^  +  10.65^-7.4175^  +  3.6035^-0.97955  +  0.1192 
sS-4.028s^  +  6.325s6-4.121s5-1.545s^+5.87s3-5.433s2+2.28s-0.3496 

From  U2  to  output, 

S^-  4.339s’'+9.005s^-  12.425^  +  12.22s'^-  8.117s^  +  3.427s2-  0.9134  5  +  0.1424 
5^  -  4.028  +  6.325  5®  -  4.121  5^  -  1.545  +  5.87  -  5.433  +  2.28  S  -  0.3496 

From  U3  to  output, 

-  3.522  5^  +  6.655  -  8.864  +  8.183  -  5.365  +  2.423  -  0.557  5  +  0.09585 

58  -  4.028  5^  +  6.325  S®  -  4.1215^  -  1.545  +  5.87  5^  -  5.433  5^  +  2.28  5  -  0.3496 
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Abstract  -  Skeletal  muscle  force  can  be  estimated  using 
surface  electromyographic  (sEMG)  signals.  Usually,  the 
surface  location  for  the  sensors  is  near  the  respective  muscle 
motor  unit  points.  Skeletal  muscles  generate  a  spatial  EMG 
signal,  which  causes  cross  talk  between  different  sEMG  signal 
sensors.  In  this  study,  an  array  of  three  sEMG  sensors  is  used 
to  capture  the  information  of  muscle  dynamics  in  terms  of 
sEMG  signals.  The  recorded  sEMG  signals  are  filtered 
utilizing  optimized  nonlinear  Half-Gaussian  Bayesian  filters 
parameters,  and  the  muscle  force  signal  using  a  Chebyshev 
type-II  filter.  The  filter  optimization  is  accomplished  using 
Genetic  Algorithms.  Three  discrete  time  state-space  muscle 
fatigue  models  are  obtained  using  system  identification  and 
modal  transformation  for  three  sets  of  sensors  for  single 
motor  unit.  The  outputs  of  these  three  muscle  fatigue  models 
are  fused  with  a  probabilistic  Kullback  Information  Criterion 
(KIC)  for  model  selection.  The  final  fused  output  is  estimated 
with  an  adaptive  probability  of  KIC,  which  provides 
improved  force  estimates. 


1.  Introduction 

National  Limb  Loss  Information  Center  [I]  reported  in 
2002  that  1.2  million  people  live  with  amputations.  Since 
then,  this  number  is  increasing  due  to  ongoing  wars  in  Iraq 
and  Afghanistan.  However,  prostheses  can  significantly 
improve  the  lives  for  these  people. 

Recent  research  efforts  have  been  active  towards 
creating  surface  electromyographic  (sEMG)  based 
prosthetics  for  hand  amputees.  The  recorded  sEMG  signal 
is  used  as  an  input  to  activate  the  prosthesis.  The  central 
nervous  system  activates  and  controls  the  EMG  signals 
which  depend  on  the  flow  of  specific  ions  including 
sodium  {Na'^),  potassium  (K^)  and  calcium  (Ca^^) 
resulting  in  the  action  potentials  in  nerves  and  their 
respective  skeletal  muscle  fibres.  A  potential  difference 
develops  across  neuronal  membranes  because  of  this  ion 
exchange  and  this  can  be  measured  as  an  electrical  voltage 
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change  [2].  sEMG  signals  are  collected  from  the  skin  as  an 
electric  voltage  ranging  between  -5  and  +5  mV.  The 
control  of  the  myoelectric-based  prosthesis  is  difficult 
because  of  the  dynamic  nature  of  the  EMG  signal  [1]  due 
to  varying  motor  unit  recruitment,  crosstalk,  and 
biochemical  interaction  within  the  muscular  fibres.  In 
addition,  sEMG  changes  continuously  due  to  the  onset  and 
progression  of  muscle  fatigue  [1]. 

Muscle  fatigue  is  complex  in  nature  and  results  in 
failure  to  maintain  the  required  force  level  [3].  Reasons  for 
fatigue  can  be  the  peripheral  changes  at  the  muscle  level  or 
an  inadequate  output  from  the  central  nervous  system  to 
stimulate  motoneurons  [3].  The  amount  of  force  generated, 
duration  of  each  contraction,  and  the  rest  period  between 
two  contractions  has  a  direct  influence  on  the  muscle 
fatigue  rate  [4].  Muscle  fibre-type  distribution  [5],  nerve 
conduction  velocity  of  fatiguing  muscles,  or  even  factors 
within  the  central  nervous  system  (CNS)  affect  EMG 
signals  [6].  EMG  analysis  is  a  well-accepted  method  for 
muscle  fatigue  assessment  [6]. 

In  1977,  L.  Lindstrom,  R.  Kadefors  and  1.  Petersen 
developed  a  method  that  measures  the  localized  muscle 
fatigue  based  on  the  power  spectrum  analysis  using 
myoelectric  signals  [7].  This  approach  permits  real-time 
investigations  and  can  yield  statistically  based  criteria  for 
the  occurrence  of  fatigue.  Rate  of  fatigue  development  and 
changes  in  muscle  action  potential  conduction  velocity 
were  used  to  interpret  the  findings  [7].  Additional 
recruitment  of  motor  units,  synchronization  of  active  motor 
units  along  the  muscle  fibres,  and  a  decrease  in  conduction 
velocity  are  reflected  in  the  EMG  signal  as  an  increase  of 
amplitude  in  time  domain  and  a  decrease  of  medium 
frequency  in  frequency  domain  [8]. 

The  joint  analysis  method  using  EMG  amplitude  and 
spectrum  (JASA)  allows  distinguishing  between  the 
difference  of  fatigue-induced  and  force  related  EMG 
changes.  Simultaneous  changes  in  the  EMG  amplitude  and 
spectrum  are  considered  in  the  JASA  approach  [9].  The 
JASA  principle  states  that  muscle  force  decreases  because 
of  the  decrease  in  EMG  amplitude  [9].  Fatigue  can  occur 
because  of  continuous  high  frequency  stimulation  or 
because  of  titanic  stimulation.  The  Flow  Chart  of  the  work 
in  this  paper  is  shown  in  Figure  1 . 

This  paper  addresses  the  issue  of  skeletal  muscle 
fatigue  that  is  a  dynamic  phenomenon.  The  modeling  is 
based  on  system  identification,  where  mathematical 
relations  are  inferred  from  experimental  data.  The  data 
consists  of  sEMG  signals  and  hand/fmger  force  generated 
by  healthy  subjects.  The  recorded  three-sEMG  signals  are 
filtered  using  nonlinear  Half-Gaussian  Bayesian  filters 


with  optimized  filter  parameters,  whereas  the  skeletal 
muscle  force  signal  is  pre-processed  using  a  Chebyshev 
type-II  filter  [1,  10]. 


Figure  1 :  The  Flow  Chart  of  the  Work  in  this  Paper. 


A  simple  Genetic  Algorithm  code  is  used  to  optimize 
the  Bayesian  filter  parameters.  Using  an  input/output 
approach,  the  EMG  signal  is  the  input  to  the  skeletal 
muscle,  and  the  produced  hand/fmger  force  constitutes  the 
output.  Three  discrete  time  state-space  models  are  obtained 
using  system  identification  and  modal  transformation  for 
three  sets  of  sensors.  One  sensor  is  placed  at  the  motor  unit 
of  the  ring  finger  of  the  dominant  hand  and  two  sensors  are 
located  in  its  vicinity  as  shown  in  Figure  2.  The  extracted 
models  from  the  data  sets  are  fused  with  a  probabilistic 
Kullback  Information  Criterion  (KIC)  for  model  selection. 
The  final  fused  output  is  estimated  with  an  adaptive 
probability  of  KIC  that  gives  an  improved  skeletal  muscle 
force  estimates. 

II.  Experimental  set-up  and  pre-processing 
Both  sEMG  and  muscle  force  signals  were  acquired 
simultaneously  using  Lab  VIEW™  8.2  at  a  sampling  rate  of 
2000  Hz.  The  sEMG  data  capturing  was  aided  by  a 
DELSYS®  Bagnoli-16  EMG  system  with  DE-2.1 
differential  EMG  sensors.  The  corresponding  force  data 
was  captured  using  NI  ELVIS  with  Interlink  Electronics 
FSR  0.5”  circular  force  sensor.  The  experimental  set-up  is 
shown  in  Figure  2.  One  sEMG  sensor  was  placed  on  the 


motor  point  of  ring  finger  and  two  adjacent  to  the  motor 
point  of  a  healthy  subject.  Prior  to  placing  the  sEMG 
sensors,  the  skin  surface  of  the  subject  was  prepared 
according  to  International  Society  of  Electrophysiology 
and  Kinesiology  (ISEK)  protocols. 


Figure  2:  Experimental  Set-Up. 


The  EMG  signal  is  modeled  for  the  conditional 
probability  of  the  rectified  EMG  signal  as  a  filtered 
random  process  with  random  rate.  The  likelihood  function 
for  the  rate  evolves  in  time  according  to  a  Fokker-Planck 
partial  differential  Equation  [10].  Here,  a  and  fS  are  two 
free  parameters,  a  is  the  expected  rate  of  gradual  drift  in 
the  signal,  and  fS  is  the  expected  rate  of  sudden  shifts  in  the 
signal.  These  two  free  parameters  of  the  non-linear  “Half- 
Gaussian  filter  model”  are  optimized  for  the  acquired  EMG 
data  using  an  elitism  based  Genetic  Algorithm.  A 
Chebyshev  type  II  low  pass  filter  with  a  550  Hz  pass 
frequency  is  used  to  filter  the  force  signal. 

III.  System  identification  and  modal 

TRANSFORMATION 

An  alternative  to  physically  based  mathematical 
modeling  is  data  based  -‘system  identification  (SI)’-  that 
can  be  applied  to  different  systems  where  it  needs 
sufficient  experimental  data  [11].  The  parametric  system 
identification  process  yields  a  dynamical  model  such  as  the 
Auto  Regressive  with  exogenous  input  (ARX)  or  Output 
Error  (OE)  model,  this  model  gives  us  the  system  in 
mathematical  form.  In  this  work,  the  SI  approach  is  used 
with  the  myolelectric  signal  as  the  input  to  the  system  and 
as  the  output  is  the  intended  fmger/hand  force.  In  this 
work,  we  are  using  an  output  error  (OE)  model  structure 
for  the  modeling  of  EMG  and  hand/fmger  force  signals, 
which  has  been  documented  in  the  literature  to  perform 
well  for  EMG  signals  among  linear  parametric  models  [1]. 
Each  OE  model  takes  the  form  of  Equation  (1), 

yit)=j^uit-nk)  +  e(t),  (1) 

where  t  is  time  index,  y(t)  is  output,  u(t  —  rij^)  is  input, 
rij^  is  the  delay,  e(t)  is  the  error,  and  B(q)  and  F(q)  are 
polynomials. 

A  common  OE  model  is  obtained  for  each  sensor  data 
set  using  one  set  of  model  parameters  (polynomial  order). 
The  OE  models  then  are  converted  into  a  state-space 
formulation.  By  doing  this,  the  identification  properties  of 


the  OE  model  formulation  are  preserved  and  represented  in 
the  state-space  form.  A  modal  form  is  computed  by  using 
state-space  matrices  and  following  transformation: 

A  =  T-\  n  =  T-^B,  r  =  CT,  (2) 

where  T  is  the  matrix  composed  of  the  eigenvectors  of  A, 
A,  n  and  F  are  corresponding  transformations  for  matrix 
A,  B,  and  C.  Matrix  D  came  out  to  be  a  zero  matrix  for  the 
cases  treated  in  this  work.  Equation  (2)  refers  to  the 
continuous  representation  of  the  identified  models.  Using 
the  modal  form  representation  for  each  corresponding  data 
set,  the  influence  of  fatigue  can  be  observed  by  charting 
the  modal  coefficients  in  time  for  each  matrix.  For 
example,  the  coefficients  contained  in  the  transformed 
matrix  A  can  be  plotted  in  the  complex  ^-plane.  This 
tracking  can  then  be  used  as  the  basis  for  constructing 
polynomials  that  connect  each  element  of  each  matrix  in 
time  with  the  corresponding  time  stamp.  Hence,  a  fatigue 
model  in  state-space  description  is  constructed,  where  the 
input  is  the  recorded  EMG  signal  and  the  output  the 
expected  force  generated  by  the  hand  motion  all  as  a 
function  of  time. 


4)  Compute  the  model  probability  p(Mi\Z)  =  — — rjr, 

^j=i^  ^ 

where  I  is  model  selection  criterion,  i.e.  KIC(pi). 

5)  Compute  the  fused  model  output  Yf  = 

6)  Compute  the  overall  OE  model  from  and  force  data. 

Here  all  the  computation  from  step  2)  to  step  6)  is  adaptive 
i.e.  the  residual  square  norm,  KIC(pi),  model  probability 
p(Mi  |Z),  and  fused  model  output  are  being  updated  with 
time  or  for  each  data  point. 

V.  Results,  conclusion  and  luture  work 

Based  on  previous  research  results  and  after  trying 
different  model  orders  for  sEMG/Force  data,  an  optimal 
model  order  of  =  2,nf  =  2,nj^  =  1  is  used  in  this 
work.  Equation  (4),  (5),  and  (6)  give  three  resulting 
discrete  time  state-space  sEMG-Force-Fatigue  models  for 
motor  point  sensor,  sensor- 1  and  sensor-2  respectively. 
Xm(h  +  1)  =  A^XmW  +  B^EMGmW; 

YmW  =  C^x^Qi)  +  D^EMG^Qi).  (4) 


IV.  Fusion  of  outputs  and  adaptive  probability 

OFKIC 

Multiple  model  fusion  is  done  by  assigning  a  particular 
probability  to  each  individual  model  [12].  These  models 
are  obtained  using  SI  for  three  sEMG  sensors  for  single 
motor  unit.  SI  model  fit  value  is  used  to  compute  the 
probability  for  each  model.  The  fit  value  is  given  by 

[ir-f  n 

1  —  - — —\  *  100.  The  model  selection  criterion  used  in 

\Y-Y\\ 

this  paper  is  Kullback  information  criterion  (KIC),  which 
is  an  asymmetric  measure.  The  sum  of  two  directed 
divergences,  which  is  the  measure  of  the  models 
dissimilarity,  is  known  as  Kullback’s  symmetric  or  J- 
divergence  [13],  as  given  by  Equation  (3). 

KICipd=^\ogRi  +  ^^^-mp{^)  +  g(n).  (3) 

where  g(ji)  =  n  *  log  (nf2). 

Following  fusion  technique  is  applied  for  sEMG  - 
force  identification  models,  which  is  based  on  [12]. 

1)  Identify  OE  models  M^,  M2,  using  sEMG  data 

(u)  as  input  and  force  data  (T)  as  output,  for  kl  number  of 
sensors  collecting  data  simultaneously. 

2)  Compute  the  residual  square  norm 

R;  =  ||y-<t>i0;||'  =  ||y-f||', 

where  0^  =  and 
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3)  Calculate  the  model  criteria  coefficient  using  Equation 

(3). 


x^(h  +  1)  =  A^Xi(h)  +  B^EMGi(h); 

fi(/i)  =  CiXi(/i)  +  D^EMG^(h).  (5) 

X2(h  +  1)  =  A2X2Q1)  +  B2EMG2(h); 

Y2  (/i)  =  G2X2  (/i)  +  D2EMG2  (/i).  (6) 


In  these  case  matrices  0^,0^,  and  D2  are  zero  matrices, 
whereas  matrices  Am,  Bm, 
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function  of  time  and  the  elements  of  matrices  and 

Cl  are  constants  for  this  particular  data  set.  The  time 
variables  Ufni  (t'),  (f)'  ^ml  ^ml  Cf)'  ^ml 

a2i(t)’a22(t),b2i(t),b22(t),C2i(t),  and  C22(t)  are  given 
by  quadratic  polynomials  obtained  by  curve  fitting  the 
tracked  modal  transformed  coefficients.  These  time 
variables  are  given  as; 


timiCO  =  0.00026t2  -  0.033f  -  11; 

^mzCO  =  -O.OOlSt^  +  0.24t  —  33; 

~  — 0.002t^  +  0.33t  +  42; 
bm2(t)  =  -0.0017t2  +  0.33t  +  25; 

Cmi(t)  =  (3-2  *  lO-^t^  -  (4.2  *  10-^)t  +  0.71; 
CmiiO  =  (4.6  *  10-®)t2  -  (5.8  *  10-®)t  -  0.71; 
aiiit)  =  -(1.2  *  10-5)t2  +  0.0013t  -  0.47; 
a22(t)  =  O.OOlt^  -  0.037t  -  35; 

^2i(0  =  (6.4  *  10-®)t2  -  O.OOlt  +  0.3; 
f>22(t)  =  0.0023f2  -  0.12t  -  75; 


C2i(t)  =  —(1.8  *  10  +  (6.4  *  10  ^)t  +  0.71;  and 

C22(t)  =  -(2.1  *  10-^)t2  +  (2.4  *  10-^)t  -  0.71. 
Elements  of  matrices  and  are  constants  for  this 

particular  data  set,  they  are  given  as: 

ail  =  —0.0159;  ai2  =  —43.1883;  hn  =  0.0090; 
hi2  =  -72.1875;  Cn  =  0.7147;  and  Ci2  =  -0.7071. 

The  discrete  models  have  a  sampling  time  ofdt  =  0.0005 
seconds.  The  duration  of  the  final  estimated  and  fused 
output  for  three  sensors  is  37.36  seconds.  Figure  3  depicts 
the  probability  and  10^^  degree  curve  fitting  for  motor 
point,  ring2  and  ringl  sensor  signals. 


Tine  (37.36  secs) 
Probabilin’  Riigl  Sensor  Signal 


Time  {37  J6  tecs)  x  to* 

Figure  3:  10^^  Degree  Curve  Fitting  -  Probability  Motor, 
Ring2  and  Ringl  Sensor  Signals. 
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Figure  4:  Measured  Output  Vs.  Estimated  Fused  Output 
with  Adaptive  Probability. 


Validation  Plot  -  Measured  Output  Vs,  Estimated  Fused  Output  With  Adaptive  Probability 
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Figure  5:  Validation  Plot  -  Measured  Vs.  Estimated  Fused 
Output  with  Adaptive  Probability. 


Figure  4  and  Figure  5  shows  the  measured  and 
estimated  fused  output,  depending  on  the  error  between  the 
two  later  follows  the  measured  signal  very  closely.  This 
approach  identifies  a  fused  fatigue  model  and  estimates  an 
adaptive  probability  based  output  that  follows  the 
measured  output  very  closely.  The  outcome  of  this  research 
can  be  used  to  estimate  the  skeletal  muscle  force  of  a 
human  hand  for  prosthetic  hand  design,  application  and 
improvement. 

In  future  work  improvement  of  the  data  collection 
techniques  and  sEMG  sensor  design,  may  lead  to  improved 
force  estimation. 
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ABSTRACT 

Surface  Electromyographic  (sEMG)  signals  have  been 
exploited  for  almost  a  century,  for  various  clinical  and 
engineering  applications.  One  of  the  most  compelling  and 
altruistic  applications  being,  control  of  prosthetic  devices.  The 
study  conducted  here  looks  at  the  modeling  of  the  force  and 
sEMG  signals,  using  nonlinear  Hammers tein- Weiner  System 
Identification  techniques.  This  study  involved  modeling  of  sEMG 
and  corresponding  force  data  to  establish  a  relation  which  can 
mimic  the  actual  force  characteristics  for  a  few  particular  hand 
motions.  Analysis  of  the  sEMG  signals,  obtained  from  specific 
Motor  Unit  locations  corresponding  to  the  index,  middle  and  ring 
finger,  and  the  force  data  led  to  the  following  deductions;  a)  Each 
motor  unit  location  has  to  be  treated  as  a  separate  system,  (i.e. 
extrapolation  of  models  for  dijferent  fingers  cannot  be  done)  b) 
Fatigue  influences  the  Hammerstein-Wiener  model  parameters 
and  any  control  algorithm  for  implementing  the  force  regimen 
will  have  to  be  adaptive  in  nature  to  compensate  for  the  changes 
in  the  sEMG  signal  and  c)The  results  also  manifest  the 
importance  of  the  design  of  the  experiments  that  need  to  be 
adopted  to  comprehensively  model  sEMG  and  force. 

NOMENCLATURE 

Bj  i(s),  Fj/s)  Polynomials  in  the  linear  block. 

bi,  Ci  Coefficients  of  polynomials  (Hammerstein  Model) . 

fn  Objective  function  (PSO). 

giO  Input  nonlinearity  function  (Hammerstein  Model). 

g( •)  Static  nonlinear  function. 


h()  Output  nonlinearity  function. 

n  h  Number  of  zeros  plus  one. 

n  f  Number  of  poles. 

n  k  Delay  from  the  input  to  the  output  in  terms  of  the  number 
of  samples. 

u(t)  Input  to  a  system. 

v(t),  w(t)  Internal  variables. 

x(t)  Input  nonlinearity  (Hammerstein  Model). 

y(t)  Output  of  a  system. 

y(t)  Predicted  or  estimated  output. 

z(t)  Output  linear  block  (Wiener  Model). 

xj  {t)  The  component  position  of  the particle  in  time  t. 

xi^^estQ-^  The  local  best  position  of  the particle  in  generation  t. 

^pgbestQ.^^  The  global  best  position  of  the particle  in  generation 

t. 

vi  {t)  The  component  velocity  of  the  particle  in  time  t. 

t  time. 

H  Physical  parameters  of  non-linear  function  g(*). 
a  Expected  rate  of  gradual  drift. 

P  Expected  rate  of  sudden  shifts  in  surface  EMG. 
s  Tolerance. 

6  Finite  dimensional  vector  used  to  parameterize  the 

mapping. 


INTRODUCTION 

In  spite  of  all  the  advances  made  in  the  field  of  biomedical 
engineering  and  in  the  study  of  biological  signals,  we  still 
oftentimes  find  ourselves  coming  up  short  in  understanding  the 
complexities  of  the  human  body.  One  such  field  is  rehabilitation 
engineering.  The  biological  signal  of  interest  here  is  the  Surface 
Electromyogram  signal  (sEMG).  We  have  come  a  long  way  since 
the  first  ever  study  conducted  on  EMG  signals  by  H.  Piper  in 
1912,  [1].  About  50%  of  the  people  who  need  upper  extremity 
prosthetics  do  not  use  them,  [2]  which  puts  into  perspective  the 
research  in  this  area  needs  to  focus  on.  The  ideal  scenario  would 
be  to  mimic  the  real  human  hand  with  all  its  functionality  and 
dexterity  employing  sEMG  signals.  This  goal  is  still  far  from 
being  realized  as  of  today.  EMG  signals  have  been  used  for  quite 
some  time  now  in  the  control  of  prosthetic  devices.  Simply  put,  it 
is  analogous  to  having  small  voltage  signals  (in  mV),  with 
information  of  the  specific  desired  objective  which  can  be  used  to 
actuate  motors,  which  translate  the  EMG  information  into  the 
desired  force  dynamics. 

EMG  signals  are  fairly  complex  to  work  with.  In  order  to  have  a 
standardized  method,  on  how  EMG  signals  must  be  recorded  and 
analyzed,  the  International  Society  of  Electromyography  and 
Kinesiology  (ISEK)  has  a  set  of  guidelines  which  are  widely 
accepted.  These  guidelines  for  reporting  EMG  data  are  well 
documented,  [3].  Other  signal  analysis  techniques  generally 
employed  include  low-pass  or  band-pass  filtering;  others  have 
also  employed  notch  filtering  to  remove  power  line  noise,  [4]. 
Whitening  filters  have  also  been  employed  in  order  to  increase  the 
quality  of  the  amplitude  estimates  of  the  surface  EMG  signals, 
[5].  Some  of  the  other  signal  processing  methods  include  using 
Markov  models,  [6]  and  fuzzy  logic  control,  [7]  -  for 
classification  of  EMG,  wavelet  processing,  [8],  and  Bayesian 
estimators,  [9].  Extensive  research  has  also  been  carried  out  in 
obtaining  a  relationship  between  sEMG  and  force  -  for  example, 
linear  and  non-linear  sEMG-Force  by  Wood  et  aL,  [10],  EMG- 
Force  relationships  in  skeletal  muscles  by  Jacquelin  et  ai,  [11], 
where  a  linear  relationship  was  approximately  quantified  for  the 
middle  operating  force  range  during  an  isometric  effort.  They  also 
concluded  that  the  presence  of  any  movement,  the  algebraic 
relations  estimated  were  not  sufficient  to  describe  the  relation. 
Also,  considerable  attention  needs  to  be  given  to  the  data 
acquisition,  the  type  of  electrode,  amplification,  rectification, 
sampling,  noise  filtering  etc.  as  all  these  elements  have  an  impact 
on  the  mathematical  formulation  of  the  sEMG-Force  relation.  The 
effects  of  joint  position,  gravity  and  recruitment  have  been 
studied  by  Solomonow  et  ai,  [12].  The  effects  of  fatigue  on 
EMG-Force  relation  were  investigated  by  Moxham  et  aL,  [13]. 
Studies  investigating  the  fatigue  of  motor  units  in  muscles  that 
control  the  fingers  of  the  hand  were  carried  out  by  Fuglevand  et 
ai,  [14].  This  study  showed  that  fatigue  caused  the  force- 
frequency  relation  to  be  displaced  to  higher  frequencies.  The 
work  reported  in  this  paper  is  focused  on  using  non-linear  System 
Identification  techniques,  to  come  up  with  a  suitable  model  or 
combination  of  models  for  the  sEMG-Force  relation.  Also 


modeling  for  the  effects  of  fatigue  in  the  sEMG-Force  relation  is 
taken  into  consideration  and  a  guideline  is  provided  on  the  type  of 
experiments  that  would  be  most  beneficial  to  encompass  the  large 
number  of  variables  which  affects  the  sEMG  signals  over  time. 
The  results  of  a  number  of  nonlinear  models,  used  for  deducing 
the  sEMG-Force  relationship,  strongly  indicate  the  need  for  an 
adaptive  method  to  be  developed  to  capture  the  dynamics  of  the 
two  signals.  The  results  also  indicate  that  the  modeling  of  the 
sEMG-Force  relation  should  not  be  extrapolated  to  different 
fingers  even  though  the  experiments  performed  were  almost  the 
same  to  obtain  very  similar  force  signal  patterns.  Bayesian  filters 
were  also  used  in  analyzing  the  sEMG  signals  as  they  have  been 
shown  to  be  beneficial  when  using  system  identification,  [15]. 
Particle  Swarm  Optimization  (PSO)  was  used  to  assist  in 
identifying  possible  trends  in  the  Bayesian  filter  parameters  with 
the  onset  of  fatigue. 

THEORETICAL  BACKGROUND 

EMG,  VARIABLES  AFFECTING  sEMG-FORCE  RELATIONSHIP 
&  PREVIOUS  RESEARCH  An  EMG  signal  is  an  electrical  signal 
which  is  generated  in  a  muscle  contraction  and  is  representative 
of  neuromuscular  activity.  sEMG  signals  are  measured  at  motor 
unit  location.  A  motor  unit  (MU)  consists  of  an  a  -motoneuron  in 
the  spinal  cord  and  the  muscle  fiber  it  innervates.  Many  factors 
influence  sEMG  signals,  some  of  which  are;  a)  shape  of  the 
volume  conductor,  b)  the  thickness  of  the  subcutaneous  tissue 
layers,  c)  tissue  inhomogeneities,  d)  distribution  of  the  motor  unit 
territories  in  the  muscle,  e)  size  of  the  motor  unit  territories,  f) 
distribution  and  the  number  of  fibers  in  the  motor  unit  territory,  g) 
length  of  the  fibers,  h)  spread  of  the  endplates  and  tendon 
junctions  within  the  motor  units,  and  i)  spread  of  the  innervations 
zones  and  tendon  regions  among  motor  units.  The  type  of 
detection  system  used  also  plays  an  important  part  in  influencing 
the  sEMG  measurements.  Some  of  the  factors  which  need  to  be 
taken  into  account,  with  the  detection  systems,  are  a)  skin 
electrode  contact  (impedance,  noise),  b)  spatial  filtering  for  signal 
detection,  c)  inter-electrode  distance,  d)  electrode  size  and  shape, 
and  e)  inclination  of  the  detection  system  relative  to  the  muscle 
fiber  orientation,  [16]. 

More  recent  studies  suggest  poor  statistical  trends  between  EMG 
amplitude  and  mean  power  spectral  frequency,  which  indicate 
limitations  in  the  use  of  EMG  descriptors  for  fatigue  assessment, 
[17].  Mortiz  et  al.  found  evidence  which  supports  the  hypothesis 
that  the  EMG  discharge  rate  variability  is  a  major  determinant  of 
the  trends  in  isometric  force  variability  across  the  working  range 
of  a  muscle,  [18].  Studies  also  suggest  that  there  is  not  a 
significant  difference  between  the  EMG-Force  relations  obtained 
using  intramuscular  EMG  (iEMG)  as  compared  to  sEMG,  [19]. 
Extensive  modeling  for  simulating  sEMG  signals,  detected  by 
surface  electrodes,  have  also  been  performed,  [20].  For  the  study 
conducted  here,  the  sEMG  signals  were  filtered  using  a 
Chebyshev  Type  II  high  pass  filter  and  a  Chebyshev  Type  II  low 
pass  filter.  The  sEMG  signals  were  also  filtered  using  a  Bayesian 
Exponential,  and  a  Half-Gaussian  filter  similar  to  the  ones 
described  in,  [21]  and  because  it  has  previously  been  reported  in, 
[15]  to  yield  better  fits  for  non-linear  Hammerstein- Wiener 
modeling. 

Particle  Swarm  Optimization:  In  1995,  a  new  evolutionary 
algorithm  was  developed  by  J.  Kennedy,  a  social  psychologist, 
and  R.  Eberhart,  known  as  Particle  Swarm  Optimization  (PSO). 


This  method  is  computationally  less  expensive  and  has  been  used 
in  this  paper  to  optimize  the  Bayesian  filter  parameters  a  and 
Other  well  established  optimization  algorithms  are;  a)  Genetic 
Algorithm  (GA)  -  inspired  by  biological  evolution,  is  at  its  core, 
survival  of  the  fittest.  The  main  drawback  of  GA  being  that  it  is 
computationally  very  expensive  especially  for  large  search  spaces. 
GA  has  been  paired  with  many  other  search  methods  in  order  to 
improve  its  overall  performance,  b)  Tabu  Search  on  the  other 
hand  -  which  has  a  set  of  tabu  balls  and  promising  balls  or  a  tabu 
list  which  helps  it  to  reduce  the  search  space  is  not  very 
computationally  expensive.  Particle  swarm  optimization  has  a 
simple  procedure;  1)  Defining  the  input  parameters:  This  includes 
the  swarm  size  (number  of  particles  of  the  swarm),  maximum 
number  of  iterations,  the  limiting  velocity  of  the  particles,  the 
upper  and  lower  bounds  of  the  search  space  and  the  stopping 
tolerance.  2)  Initializing  the  position  of  the  particles  -  can  be 
randomly  assigned  using  a  uniform  or  normal  distribution,  [22]. 
3)  Evaluating  the  fitness  function  fn  (objective  function)  for  the 
particle.  This  depends  on  the  cost  function,  e.g.  the  local  best 
and  the  global  best  values  are  compared  and  suitably  updated. 
Moreover,  the  difference  between  /^*  (^)  -  (^  - 1)  ,  i.e.  the 

current  (^)  and  {t  - 1)  is  compared  to  the  tolerance  S  . 
If  |/^*  (0  -  fn  (^  - 1)|  <  ^  ,  then  stop  the  loop;  otherwise  continue. 
Figures  1  and  2  show  the  particles  of  the  PSO  in  the  search  space 
and  the  flow  chart  of  the  algorithm  respectively. 


System  Identification  (SI),  Nonlinear  SI,  Hammers tein- Wiener 
Models:  SI  involves  modeling,  which  is,  developing  a  concept  or 
mathematical  relation  on  how  the  system  variables  are  related. 
Modeling  is  divided  into  three  components:  1)  Accurately 
measuring  a  data  set,  e.g.  the  input  and  output  of  a  system  related 
in  the  time  or  the  frequency  domain.  2)  Defining  a  model 
structure  and  3)  A  rule  by  which  a  model  structure  can  be 
established  from  the  measured  data,  such  as  Least-Squares. 
Looking  closely  at  these  components,  the  measured  data  may  be 
recorded  during  a  specifically  designed  experiment,  so  that  the 
data  carries  maximum  information,  subject  to  any  constraints, 
[23].  Choice  of  a  model  structure  is  one  of  the  most  important  and 
difficult  aspects  of  system  identification.  Here  a  priori  knowledge 
and  engineering  intuition  coupled  with  formal  properties  of  the 
system  will  prove  to  be  invaluable.  Models  of  systems  with  some 
unknown  physical  parameters  can  be  constructed  from  basic 
physical  laws  and  well  established  relations.  These  are  called 
white  box  models.  Models  with  unknown  physical  parameters  and 
a  large  number  of  random  variables,  which  cannot  be 
satisfactorily  represented  by  physical  laws,  are  deduced  using 
black  box  modeling.  The  third  type  of  model  is  a  gray  box  model; 
this  represents  a  compromise  and  a  combination  between  white 
and  gray  box  modeling.  The  third  component  of  modeling  is 
assessment  of  the  model  quality  and  its  ability  to  reproduce  the 
measured  data,  also  known  as  model  validation.  The  process  of 
System  Identification  is  summarized  in  Figure  3.  Modeling  and 
identification  of  nonlinear  systems  is  especially  challenging,  in 
the  sense  that  the  nonlinearity  could  be  in  either  the  input  signal, 
the  output  signal  or  in  both.  If  modeling  of  the  system  is  done 
using  linear  and/or  non-linear  blocks,  to  represent  a  system, 
careful  combination  of  these  need  to  be  formulated.  In  our  study, 
the  input  is  the  sEMG  and  the  output  is  the  corresponding  force 
signal  generated  by  the  human  hand.  The  system  is  the  particular 
subject’s  hand.  The  sEMG  signal  is  affected  by  large  number  of 
variables,  some  of  which  have  been  mentioned  in  the  EMG 
section  of  the  theoretical  background.  The  force  signals  too,  are 


non-linear,  especially  as  time  progresses  and  the  muscle  fatigues. 
It  would  be  very  difficult  and  complicated  to  take  into  account  all 
the  factors  which  plague  these  two  signals. 


FIGURE  1:  PREVIOUS  AND  UPDATED  POSITON  OF  PARTICLES  [22] 


FIGURE  2:  PARTICLE  SWARM  OPTIMIZATION  LOOP 

50  with  the  assumption  that  the  two  signals  are  non-linear;  the 
modeling  for  this  system  can  be  approached  in  a  general  sense.  In 

51  the  model  structure  that  has  been  used  previously  for  capturing 
the  non-linear  input  and  output  system  dynamics  has  been  the 
Hammerstein-Wiener  model.  This  modeling  method  has  not  been 
explored,  previously,  for  modeling  of  sEMG  signals  and  force. 

Hammerstein  models  assume  a  separation  between  the  non¬ 
linearity  and  the  dynamics  of  the  process,  [24].  The  Hammerstein 
structure  consists  of  a  static  non-linear  block  followed  by  a  linear 
dynamic  block.  It  is  described  by  the  following  equations; 

x{t)  =  g{u{t)), 

y{t)  =  bYx{t  - 1)  + . . .  +  byyix{t  -m)-  a^yd  - 1)  - ...  -  aj^y(t  -  m) . 

Hammerstein  models  are  popular  in  the  field  of  control 
engineering  as  it  is  easy  to  compensate  the  non-linear  process 
behavior  by  a  controller  that  implements  the  inverse  static 
nonlinearity  g~\^)  at  its  output  (if  the  inverse  exists).  Another 
advantage  of  this  model  being  that  the  stability  is  determined 
solely  by  the  linear  part  of  the  model.  Any  assumption  of  the 
structure  of  the  process  is  very  restrictive  and  can  be  applied  to 
only  a  limited  class  of  systems.  The  static  nonlinearity  is  usually 
approximated  using  a  polynomial. 


FIGURE  3:  SYSTEM  INDENTIFICATION  LOOP  [22] 


saturation  point  and  saturation  level,  or  in  black-box  terms  such 
as  spline-function  coefficients.  This  defines  gf*,/;) .  If  the  linear 
model  is  given  by  G{q,0) ,  the  predicted  output  model  will  be  in 
the  following  form: 

Kt\0,7i)  =  G{q,e)g{u{t\7i)  .  (6) 

Equation  7  describes  the  Hammerstein- Wiener  model  structure: 
Biiiq) 

Mt)  =  f{{g{t)),  =  y{t)  =  h{x{t)),  (7) 

FjM) 

where,  w{t)  and  b{t)  are  internal  variables,  w{t)  has  the  same 
dimensions  as  u{t) ,  and  x{t)  has  the  same  dimensions  as  y{t) . 


(a) 


(b) 


For  systems  with  multiple  inputs  the  static  nonlinearity  g(^) 
becomes  a  higher  dimensional  function,  say  for/ =  2,  and 
m  =  2  Equation  (1)  becomes; 

2 

x(t)  =  c  Q+c  iu(t)  +  c  2U  (t), 

y(t)  =  Q+biCiu(t -1)  +  b2C Q+b2Ciu(t  -2)  +  (2) 

2  2 

b^c  2U  {t-\)  +  b2C2U  {t -2)  -  a-^y{t -  a2y{t -2). 

The  generalized  Hammerstein  model  is  constructed  by 
summarizing  identical  terms  and  re-parameterizing  the  model  in  a 
manner  that  yields  linear  parameters,  for  example,  /j^c^and 
b^c^  both  represent  offsets  and  can  be  summarized.  This  leads  to 
Equation  (3); 

y{t)  =  6^1  +  - 1)  +  -  2)  + 

(3) 

0/^yit  - 1)  +  O^yit  -  2)  +  (^  - 1)  +  (t  -  2). 

The  Wiener  model  structure  is  the  Hammerstein  model  reversed. 
The  linear  dynamic  block  is  followed  by  a  static  nonlinear  block. 
This  yields  the  equation  given  in  (4) 

x{t)  =  t\u(t  —  +  +  —  —  a[X(f  —  1)  —  ...a[x(f  —  m),  , . > 


Eliminating  x  in  (4)  yields; 

T(0  =  g(biu(t  - 1)  + ...  +  b^u{t  -  m) 

-  {yit  - 1))  - ...  -  a^g^"^  (y(t  -  m)) 


The  combination  of  the  two  is  then,  the  Hammerstein- Wiener 
model,  [25]  as  given  in  Figure  4(a)  Hammerstein  b)  Wiener 
models  and  Figure  5  Hammerstein- Wiener  model.  Consider  the 
Hammerstein  case  where  the  static  nonlinear  function  g(*)  can  be 
parameterized  either  in  terms  of  physical  parameters,  such  as 


FIGURE  4  (A):  A)  HAMMERSTEIN  MODEL,  B)  WIENER  MODEL 


Input 


FIGURE  4  (B):  HAMMERSTEIN-WIENER  MODEL  STRUCTURE 

The  linear  block  is  specified  using  the  terms  -  the  number  of 
zeros  plus  one,  -  the  number  of  poles  and  -  the  delay  from 
the  input  to  the  output  in  terms  of  the  number  of  samples.  The 
commonly  used  nonlinear  estimators  for  Hammerstein-Wiener 
model  are,  a)  Dead  Zone,  b)  Piecewise  Linear,  c)  Saturation,  d) 
Sigmoid  Network,  and  e)  Wavelet  Network,  [26-28]. 

EXPERIMENTAL  SETUP 

The  experiments  were  carried  out  on  a  healthy  male  subject  to 
extract  dynamical  models  describing  the  relationship  between 
sEMG-Force  signals.  The  motor  points  were  located  using  a 
Muscle  Stimulator,  manufactured  by  Rich-Mar  Corporation 
(model  number  HV  1100).  The  motor  locations  of  the  index, 
middle  and  ring  fingers  were  identified  and  chosen  for  the 
experiments.  The  EMG  detection  system  used  was  a  Delsys, 
Bagnoli- 1 6  channel  EMG  (DS- 1 60,  S/N- 1 1 1 6),  which  has  internal 
amplification  and  noise  reduction  technology  built  into  it.  The 
sensors  used  for  measuring  the  surface  EMG  action  potentials  are 
two  pronged  DE  2.1  differential  surface  electrodes.  The  material 
for  the  contacts  of  the  electrode  is  99.9%  pure  silver,  while  the 
contacts  are  10mm  long,  1mm  in  diameter  and  spaced  10mm 
apart.  The  subjects’  skin  was  prepared  before  the  sensors  were 
placed  over  the  motor  point,  hair  around  the  area  was  shaved  and 
an  alcohol  swab  was  used  to  clean  the  skin.  Delsys  Electrode 
Interface  SC-F02-3  was  used  which  promotes  the  quality  of  the 
electrical  connection  between  the  electrode  and  the  skin, 
minimizing  motion  artifacts  and  line  interference.  The  electrodes 


were  placed  along  the  muscle  fibers  (Flexor  Digitorum 
Superficialis)  for  recording  surface  EMG.  The  force  was  recorded 
using  a  force  sensitive  resistor  (FSR)  mounted  on  a  stress  ball. 
The  data  acquisition  for  the  force  and  the  sEMG  signals  was  done 
at  2000  samples  per  second  and  the  NI  DAQ  6024  E  Series 
boards  were  used.  Experiments  were  conducted  for  three  fingers, 
the  index,  middle  and  the  ring  finger.  The  motions  simulated  were 
a)  pad  to  pad  grip  and  b)  a  power  grip,  while  measuring  the  force 
developed  by  individual  fingers.  For  the  ring  finger,  the  motion  to 
generate  the  force  signal  was  randomized  (the  levels  of  force 
amplitude  and  frequency  varied  significantly  over  one  experiment 
and  for  all  six  experiments  carried  out).  This  was  done  in  order  to 
have  poor  correlation  between  the  sEMG-Force  signals  analyzed 
for  various  time  windows.  For  the  index  and  the  ring  finger  four 
experiments  were  conducted  for  each.  The  motion  to  generate  the 
force  signal  was  made  cyclic  in  order  to  have  a  high  correlation 
between  the  sEMG-Force  signals.  Cyclic  motion  was  considered, 
in  this  case,  to  study  the  effects  of  fatigue  as  time  progressed  on 
system  identification  and  the  Hammerstein- Wiener  modeling. 
Data,  for  the  ring  finger  (random  motion),  was  collected  for  30, 
45  and  60  seconds.  Data  for  the  middle  and  index  fingers  was 
collected  for  30  and  45  seconds.  The  subject  performed  a  cyclic 
and  random  series  of  flexions  and  contractions  with  the  ring 
finger  at  constant  and  random  speeds.  The  randomness  -  as 
depicted  in  Figure  5a)  -  was  necessary  in  order  to  ensure  that  the 
system  excited  all  modes.  Figure  5a)  shows  the  output  of  the 
random  motion  raw  sEMG  signal  of  the  ring  finger,  5b) 
Chebyshev  filtered  random  motion  sEMG-Force  signals  (ring 
finger),  5c)  Half-Gaussian  filtered  sEMG,  and  also  the  data.  5d) 
cyclic  sEMG-Force  signals  of  the  middle  finger  and  5e)  cyclic 
sEMG-Force  signals  of  the  index  finger.  The  x-axis  in  the  figures 
is  the  number  of  samples  and  the  y-axis  is  the  amplitude  of  the 
sEMG  and  the  force  signal  in  milli- volts.  During  the  experiment 
all  fingers  were  flexed  in  order  to  generate  the  force  and  sEMG 
signal.  A  result  of  this  there  was  substantial  cross  talk  in  the 
measurement.  This  was  to  simulate  closely,  a  real  life  situation. 
The  fit  values  computed  for  the  models  uses  the  relation  in 
equation,  (8); 

fit  =  100  *  (1  -  norm{y  -  y)  /  norm(y  -  mean(y)))  (8) 


cyclic  case,  experiments  were  conducted  on  the  index  and  the 
middle  finger,  while  the  ring  finger  was  used  for  the  random  case. 
In  all,  for  the  cyclic  case  four  experiments  each  were  conducted 
on  the  index  and  middle  finger  and  the  data  analyzed. 


i 
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FIGURE  5:  A)  RANDOM  RAW  EMG  RING  FINGER,  B)  CHEBYSHEV 
FILTERED  EMG  AND  FORCE  (RING  FINGER,  RANDOM),  C)  HALF- 
GAUSSIAN  FILTERED  EMG  (RING),  D)  CYCLIC  EMG-FORCE 
MIDDLE  FINGER,  E)  CYCLIC  EMG-FORCE  INDEX  FINGER 

The  sEMG  data  was  filtered  using  a  Chebyshev  filter  and  a  Half- 
Gaussian  filter.  Hammerstein-Wiener  models  were  tested  by 
varying  and  ^/values  for  both  the  cases.  The  data  set  was  split 
into  smaller  windows;  an  example  of  the  windows  used  for 
estimation  and  validation  of  the  modeling  is  shown  in  Table  1, 
where  ze  is  the  time  interval  that  was  used  for  the  model 
estimation  and  zv  is  the  time  interval  used  for  model  validation.  A 
small  overlapping  time  window,  with  the  estimated  model  is  used 
for  the  validation  model. 


RESULTS  AND  DISCUSSION 

The  force  signal  was  filtered  using  a  low  pass  Butterworth  filter 
using  a  cutoff  frequency  of  3Hz.  The  sEMG  signal  was  also 
filtered  using  a  Chebyshev  Type  II  high  pass  filter  with  the 
following  filter  parameters,  Fstop=60Hz,  Fpass=70,  Astop=80, 
Apass=l,  match=stopband,  to  remove  any  line  frequencies  and 
followed  by  a  low  pass  Chebyshev  Type  II  high  pass  filter  with 
the  following  filter  parameters,  Fstop=600Hz,  Fpass=650,  Astop=80, 
Apass=l,  niatch=stopband.  This  was  done  since  EMG  signals  have 
an  effective  frequency  content  of  not  more  than  500Hz,  according 
to  the  ISEK  standards,  [3]. 

Cyclic  and  Random  Data  Analysis:  As  mentioned  earlier, 
experiments  were  carried  out  a)  in  a  cyclic  motion,  to  have  a 
cyclic  change  in  the  sEMG  and  force  signal  so  that  the  effects  of 
fatigue  could  be  characterized  and  b)  in  a  random  manner  (with 
fatigue  induced  by  repetition)  to  investigate  how  the 
Hammerstein-Wiener  model  parameters  change  with  time.  For  the 


In  all,  the  total  time  intervals  for  which  models  and  fits  were 
computed  for  the  index  finger  alone,  were  4  (time  intervals  per 
experiment)  x  4(experiments)  x  49  (models  per  window  by 
varying  n^  and  nf)x2  (filtering  methods)  =  1,568  different 
models.  This  was  also  repeated  for  the  middle  finger  (1,568 
different  models).  For  the  random  motion/force  variation 
scenario;  8  (time  intervals  per  experiment)  x  7(experiments)  x  49 
(models  per  window  by  varying  n^  and  nj)  x  2  (filtering  methods) 
X  2  (piecewise  linearity  function,  5  and  10)=  10,976  different 
models  were  analyzed.  The  time  windows  for  the  random  case  are 
double  the  number  of  intervals  for  the  cyclic  case  as  the 
correlation  between  the  signals  is  very  poor.  The  size  of  the 
window  used  for  estimation  and  validation  is  a  very  important 
aspect  to  be  considered  in  SI. 

The  window  size  was  varied  in  order  to  find  the  most  optimum 
case  which  would  result  in  better  modeling  of  the  two  signals.  A 
detailed  analysis  of  the  window  size,  the  signal  contained  in  these 
individual  windows,  and  their  correlation  to  one  another  is 


required  to  be  able  to  standardize  the  modeling  process.  This 
aspect  is  still  uder  investigation. 

TABLE  1:  MODELING  TIME  WINDOWS  CYCLIC  MOTION  (INDEX  AND  MIDDLE 

FINGERS) 


ze  (sec) 

zv  (sec) 

0.5-6.5 

2.5-8.5 

6.5-13.5 

9.5-16.5 

13.5-19.5 

16.5-22.5 

17.0-23.0 

20.0-26.0 

FIGURE  6:  RESULTS  OF  PSO  FOR  SIX  EXPERIMENTS.  AXES  ARE 
ALPHA,  BETA  AND  FIT  VALUES. 

Also,  it  would  not  be  feasible  to  show  all  the  results  of  all  the 
models  here,  but  examples  are  provided  as  to  how  the  modeling 
was  affected  for  the  various  time  intervals  and  motion/force 
variations.  For  the  random  scenario,  PSO  was  used  to  investigate 
a  relation  between  the  filter  parameters  a  and  (3  and  to  investigate 
the  effect  of  fatigue  on  the  model  outputs.  The  results  of  the  PSO 
optimization  are  summarized  in  Figure  6.  The  x  axis  in  the  figures 
are  the  optimized  values  of  a  for  the  three  different  time  intervals 
and  the  y  axis  are  the  optimized  values  P  and  the  z  axis  are  their 
respective  magnitudes.  From  the  results,  it  can  be  concluded  that 
a  values  between  1 .5  to  2.9e-6  and  p  values  between  2.6-3.7e-26 
are  most  likely  to  give  better  fits  for  nonlinear  Hammerstein- 
Wiener  models.  The  model  fits  obtained  initially  with  PSO  were 
randomly  distributed.  The  fit  values  for  experiment  1  are  not  very 
high  (this  could  be  due  to  the  limited  search  space  for  a  and  P)  as 
compared  to  the  other  experiments  for  the  initial  time  windows, 
where  one  would  not  expect  any  fatigue.  But  a  trend  can  be 
observed  that  as  fatigue  sets  in  towards  the  last  time  window 
(later  in  the  experiment  where  the  subject  is  experiencing  fatigue) 
of  almost  all  the  experiments  the  fit  %  dropped,  except  for 
experiments  5  and  6  (not  shown  here)  where  the  fits  were 
relatively  high  about  67%.  This  was  because  the  correlation 
between  the  signals  for  these  two  windows  was  much  higher  than 
the  ones  for  the  other  experiments.  This  could  indicate  that  as 
muscle  fatigue  increases  the  recruitment  of  other  motor  units  was 
similar  and  the  sEMG  obtained  for  experiments  5  and  6  were 
similar.  As  the  muscle  fatigue  increases,  it  directly  deteriorates  the 
input  sEMG  signals  relation  to  force.  This  casts  a  doubt  on  the 
effectiveness  of  the  nonlinear  blocks  in  the  Hammerstein- Wiener 


models  investigated.  From  these  results,  it  could  be  concluded 
that  a  thorough  investigation  into  the  existing  nonlinear  block 
would  be  needed  and  modification  of  the  block  may  be  required 
to  capture  the  dynamics  of  fatigue  and  to  compensate  for  the 
detrimental  effects  it  has  on  modeling  the  sEMG-force  signals. 
Also,  the  nonlinear  block  could  be  substituted  for  any  of  the 
blocks  that  have  been  discussed  in,  [29].  Figure  7  shows  some  of 
the  results  for  the  index  finger  nonlinear  Hammerstein- Wiener 
models  investigated  for  the  experiments.  The  red  plot  is  of  the 
signal  used  for  model  estimation,  the  green  plot  is  of  the  signal 
used  for  validation  of  the  model  and  the  blue  plot  is  of  the  entire 
data  spectrum  for  that  experiment  for  Figure  7  (a)  &  (b).  Figure 
7(c)  shows  the  auto-correlation  of  the  model  residuals  for  the 
output  signal  (force). 
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FIGURE  7:  A)  EMG  INDEX  FINGER  DATA  SPECTRUM,  B)  FREQUENCY 
CONTENT  OF  SIGNALS.  C)  MODEL  RESIDUALS  AND  AUTO-CORRELATION 
AND  CORSS-CORRELATION  OF  SIGNALS,  D)  MODEL  OUTPUTS,  E)  INPUT 
NONLINEARITY,  F)  LINEAR  BLOCK,  G)  OUTPUT  NONLINEARITY,  H) 
CONTOUR  PLOT  OF  MODEL  FITS 


This  figure  also  plots  the  cross-correlation  of  the  various  models 
between  the  input  (sEMG)  and  the  residuals  of  the  output  (force). 


Figure  7  d)  shows  the  results  of  the  measured  and  the  simulated 
model  output  signal,  for  the  particular  time  window.  The  plots 
shown  here  are  for  the  best  fit  scenarios.  For  example,  nlhwl  with 
the  following  model  parameters;  =  2;  n^.  =3  and  =  1 ,  with 

a  piecewise  linearity  function  value  of  5,  gives  a  fit  of  80.5 1%  for 
the  time  window  0.5-8.0sec  window,  which  was  split  into  0. 5-6.0 
and  2.5-8.0for  model  estimation  and  validation. 
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FIGURE  8:  A)  EMG  MIDDLE  INGER  DATA  SPECTRUM,  B)  FREQUENCY 
CONTENT  OF  SIGNALS.  C)  MODEL  RESIDUALS  AND  AUTO-CORRELATION 
AND  CORSS-CORRELATION  OF  SIGNALS,  D)  MODEL  OUTPUTS,  E)  INPUT 
NONLINEARITY,  F)  LINEAR  BLOCK,  G)  OUTPUT  NONLINEARITY,  H) 
CONTOUR  PLOT  OF  MODEL  FITS 


The  model  parameters  were  varied  i.e.  various  (from  2-9),  and 

Uf  (from  3-10)  were  investigated.  7(e),  (f)  and  (g)  are  the  input 

nonlinearities,  the  linear  block  and  the  output  nonlinearity  blocks 
of  the  Hammerstein- Wiener  models.  The  plot  also  shows  the  case 
where  the  simulated  model  failed  for  a  set  of  parameters  (the  line 


in  the  input  non-linearity  which  goes  across  the  others).  In  the 
linear  block  plot  there  are  a  few  lines  which  have  a  very  large 
deviation  from  the  others;  these  too  are  the  cases  where  the 
modeling  resulted  in  poor  fit  values.  Figure  9  shows  a  distribution 
of  the  fit  values  for  the  various  model  parameters  for  a  single  time 
window. 


FIGURE  9:  DISTRIBUTION  OF  MODEL  PARAMETRS  AND  THE  FIT 
VALUES  (ONE  TIME  WINDOW) 


CONCLUSION 

From  the  experiments  and  the  Hammerstein- Wiener  modeling  it 
can  be  concluded  that,  a)  the  Hammerstein- Wiener  models  do 
capture  the  dynamics  of  the  sEMG-Force  data  very  well  for  all  the 
three  fingers  tested  (in  the  range  of  65  to  82%  model  fits).  This 
statement  holds  true  for  all  the  initial  time  windows  in  the 
experiments.  But  the  model  fits  deteriorate  (between  17-25%)  as 
fatigue  in  the  muscle  increases.  In  order,  to  capture  and  to  account 
for  the  changes  in  the  sEMG-force  signals  due  to  fatigue,  further 
investigation  will  be  needed  into  the  non-linear  block  of  the 
model  structure.  Also,  the  size  of  the  windows  chosen  for 
estimation  and  validation  needs  to  have  a  fairly  high  degree  of 
correlation.  For  the  random  motion  case,  where  the  force  was 
varied  randomly,  added  analysis  of  the  frequency  and  amplitude 
of  the  two  signals  was  needed.  The  selection  of  the  size  of  the 
window  could  be  automated  using  correlation  coefficients,  b)  The 
Half-Gaussian  filtering  of  the  sEMG  signal,  used  for  modeling, 
yielded  slightly  better  results  than  the  Chebyshev  filtering  of 
sEMG  (about  7-12%  more),  c)  A  change  in  the  piecewise  linearity 
function  in  the  Hammerstein- Wiener  modeling  did  also  have  a 
significant  effect  on  the  model  fit  value.  Though  a  clear  trend 
could  not  be  seen  from  the  results,  an  adaptive  optimization 
scheme  if  applied  could  help  in  studying  the  effect  of  this 
parameter  on  the  model  fits,  d)  Although  the  PSO  did  not  offer 
concrete  results  about  the  effect  of  fatigue  on  the  filter  parameters 
a  and  it  did  throw  some  light  on  the  direction  in  which  the 
search  space  for  these  parameters  needs  to  be  further  investigated, 
which  could  assist  in  modeling  the  sEMG-force  signals, 
especially  with  muscle  fatigue. 
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Abstract 

Genetic  Algorithm  (GA)  is  biologically  motivated 
evolutionary  computation  technique  used  both  as 
search  methods  for  solving  problems  and  for 
modelling  evolutionary  systems.  GA  has  been  used  in  a 
wide  variety  of  optimization  tasks,  including  numerical 
optimization  and  combinatorial  optimization  problems 
such  as  circuit  design  and  job  shop  scheduling. 
Although  there  are  many  problems  for  which  the 
genetic  algorithm  can  evolve  a  good  solution  in 
reasonable  time,  there  are  also  problems  for  which  it 
is  inappropriate  like  the  one  in  which  it  is  important  to 
find  the  exact  global  optimum  and  if  the  number  of 
iteration  increases  then  that  makes  the  algorithm  to 
take  long  time.  In  this  work,  we  are  using  GA  to 
optimize  the  parameters  of  nonlinear  Bayesian  Filters 
for  electromyographic  (EMG)  signal.  OpenMP  is  a 
parallel  programming  model  for  shared  memory  and 
distributed  shared  memory  multiprocessors.  We  are 
using  OpenMP  on  four  processors  to  improve  the  time 
of  GA  optimization  for  Bayesian  Filter  parameters. 

Keywords:  OpenMP,  Matlab®,  MPI,  EMG,  GA, 
Gene,  Mother  Chromosome,  Father  Chromosome, 
Pairing  Operator,  Mating  Operator,  Mutation, 
Population  Size. 

1.  Introduction 

Principles  of  natural  selection  and  genetics  has  been 
used  to  deduce  some  efficient  search  algorithms,  GA  is 
one  of  them.  GA  is  used  in  different  fields  to  obtain 
solutions  to  different  problems,  e.g.  engineering, 
science,  business  and  economics  [1,  2].  Some  of  the 


applications  of  GA  are  in  automotive  design, 
engineering  design,  robotics,  evolvable  hardware, 
optimized  telecommunication  routing,  joke  and  pun 
generation,  bio-mimetic  invention,  traffic  and 
shipment  routing,  computer  gaming,  encryption  and 
code  breaking,  computer-aided  molecular  design,  gene 
expression  profiling,  optimizing  chemical  kinetic 
analysis,  finance  and  investment  strategies,  and 
marketing  and  merchandising.  Although,  for  a  general 
problem  of  normal  size,  GA  is  good  option  to  get  the 
optimal  solution  in  appropriate  amount  of  time, 
whereas  for  bigger  and  complex  problems  GA  takes 
more  time  to  find  optimal  solution.  Researchers  have 
explored  different  approaches  to  minimize  this 
computational  time  and  cost  and  parallel  processing 
came  out  to  be  one  of  the  most  promising  approach. 

GA  is  based  on  the  principle  of  natural  selection.  It 
uses  a  random  search  technique  to  find  the  optimal 
solution  of  a  problem  by  manipulating  a  population  of 
candidate  solutions.  To  form  next  generation,  GA 
selects  the  best  solutions  from  the  evaluated 
population.  Good  solutions  and  time  to  reach  them  by 
GA  depends  on  the  population  size  [3,  4],  because  if 
the  population  is  too  small,  then  the  search  space  will 
not  be  sufficient  and  it  will  be  difficult  to  identify  good 
solutions  and  in  case  if  the  population  is  too  big,  the 
GA  will  waste  computational  resources  processing 
unnecessary  individuals.  Each  individual  in  the 
population  has  a  fitness  value,  which  is  a  payoff 
measure  that  depends  on  how  well  the  individual 
solves  the  problem.  Crossover  and  mutation  are  the 


two  operators  used  by  GA  to  explore  the  search  space, 
here  crossover  is  primary  and  mutation  is  a  secondary 
search  operator.  The  probability  of  crossover  is  much 
higher  than  the  probability  of  mutation.  GA  can  be 
stopped  based  on  different  conditions,  one  is 
predetermined  number  of  generations  and  function 
evaluations,  second  is  the  average  quality  of  the 
population  get  saturated  after  some  number  of 
generations,  and  the  third  is  when  all  the  individuals 
are  identical,  which  can  only  occur  when  mutation  is 
not  used.  We  are  using  predetermined  number  of 
generations  and  function  evaluations  to  stop  the  GA  in 
this  research  work.  The  generic  GA  flow  chart  is 
shown  in  Figure  1. 


Figure  1:  Generic  GA  Flow  Chart. 


The  time  taken  by  GA  is  directly  proportional  to  the 
number  of  evaluations  and  generations,  more  the 
number  of  evaluations  lager  is  the  time  for  GA.  On  the 
other  hand,  this  time  can  be  minimized  by  paralleling 
the  GA  program  on  parallel  cluster.  Most  of  the 
parallel  programs  divide  the  task  in  chunks  and  solve  it 
simultaneously  using  multiple  processors.  On  a 
parallel  cluster,  there  are  numerous  processors,  and 
they  share  the  task,  larger  the  number  of  processors 
faster  the  computation  or  lesser  the  time  for  the 
completion  of  the  algorithm.  In  this  research  work  we 
are  using  OpenMP  parallel  programming  model  and 
utilizing  a  cluster  of  four  processors  to  run  the  GA  and 
comparing  its  performance  with  the  single  processor  in 
Matlab®. 

2.  Background 

Most  of  the  parallel  programs  divide  the  task  into 
chunks  and  solve  it  simultaneously  using  multiple 


processors.  Similar  approach  can  be  used  for  GAs  in 
different  ways.  These  approaches  can  be  using  a  single 
population,  divide  the  population  into  several 
subpopulations,  use  of  massively  parallel  architecture, 
or  use  of  fewer  multicomputer  with  fewer  and  more 
powerful  processing  units.  Mainly  there  are  three  kinds 
of  parallel  GAs,  and  these  are  (a)  global  single¬ 
population  master-slave  GAs,  (b)  single-population 
fine  grained,  and  (c)  multiple-population  coarse¬ 
grained  GAs.  The  hierarchical  parallel  GAs  combine 
the  multiple  demes  with  master-slave  or  fine-grained 
GAs.  It  has  a  higher  level  and  a  lower  level,  at  higher 
level  they  are  multiple-deme  algorithms  and  at  lower 
level  they  are  single-population  parallel  GAs  (either 
master-slave  or  fine-grained)  [1]. 

The  research  work  in  [5]  shows  a  method  of  parallel 
GA,  in  which  a  global  parallel  implementation  of  the 
conventional  GA  and  a  GA  with  a  generation  gap, 
where  some  part  of  the  population  is  replaced.  The 
efficiency  of  global  parallel  GA  is  close  to  100  %  in 
SIMD  (single  instruction  multiple  data)  computers  by 

[5] .  Four  prototypes  for  parallel  GAs  are  proposed  in 

[6]  where  the  first  three  are  variations  of  the  master- 
slave  GA,  and  the  fourth  is  a  multiple-population  GA. 

2.1  Master-Slave  Parallelization 

Same  as  in  a  simple  GA,  master-slave  GA  also  have 
a  single  panmictic  population.  Figure  2  shows  the 
schematic  of  master-slave  GA,  where  the  evaluation  of 
fitness  is  distributed  among  the  slave  processors. 


Figure  2:  Master- Slave  Parallel  GA. 


The  master-slave  GA  considers  full  population  size 
for  selection  and  crossover,  so  it  is  known  as  global 
GA.  The  master-slave  parallelization  method  for  GA 


does  not  change  the  behavior  of  the  algorithm  while 
the  single-population  fine  grained  and  multiple- 
population  coarse-grained  GA  change  the  way  the  GA 
works  [1].  The  master-slave  parallel  GA  considers  all 
the  population  for  selection,  whereas  the  other  parallel 
GAs  considers  only  a  subset  of  the  population.  In 
addition,  in  the  master-slave  parallel  GA  the  mating  is 
random,  whereas  in  the  other  methods  mating  is 
restricted  to  a  subset  of  individuals  [1].  Majority  of  the 
global  parallel  GAs  are  implemented  synchronously.  If 
the  multiprocessor  architecture  is  of  shared  memory 
then  each  individual  processor  can  share  the 
information,  reading  and  writing  without  any  issue.  In 
contrast,  on  distributed-memory  architecture,  the 
population  is  stored  only  at  one  processor  and  the 
master  is  responsible  for  sending  the  individuals  to 
slaves  for  evaluation,  collecting  the  results  and 
applying  GA  for  next  generation.  Encore  Multimax  is 
a  shared-memory  computer  with  16  processors,  a  GA 
is  implemented  on  this  to  search  for  efficient 
timetables  for  schools  in  [7].  This  research  in  [7]  gave 
limited  speed-up  because  of  the  critical  path  of  the 
program  serial  code. 

In  1993,  Abramson,  Mills,  and  Perkins  added  a 
distributed-memory  machine  “Fujitsu  API 000”  with 
128  processors  to  the  experiments,  changed  the 
application  to  train  timetables  and  modified  the  code 
[8].  In  this  research,  the  speed-up  was  significant  up  to 
16  processors  and  then  decreased  because  of  the 
increase  in  communication  as  more  processors  are 
added. 

Hauser  and  Manner  used  global  GA  on  three 
different  parallel  processors  and  got  good  speed  up 
only  on  NERV  multiprocessor  [9].  The  speed-up  of 
five  using  six  processors  is  obtained  with  a  very  low 
communications  overhead  [9].  The  reason  of  low 
performance  on  other  processors  a  SparcServer  and  a 
KSRl  is  because  of  the  inadequate  scheduling  of 
computation  threads  to  processors  by  the  system.  All 
the  previous  research  results  shows  that  the  master- 
slave  parallel  GAs  are  easy  to  implement  and  very 
efficient  method  of  parallelization  especially  when  the 
evaluation  needs  considerable  computations. 
Additionally  the  master-slave  parallel  GAs  do  not 
change  the  search  behavior  of  the  GA  [1]. 


3.  GA  In  Matlab® 

The  continuous  number  GA,  which  is  used  in  this 
work,  interprets  the  parameters  of  a  problem  as  genes, 
where  one  set  of  parameters  form  a  chromosome, 
chromosome  =  [genei, gene2, , genej^par]-  Since 
one  chromosome  corresponds  to  a  candidate  solution, 
its  evaluation  is  done  by  assessing  the  numerical  value 
of  that  solution,  which  usually  referred  as  the  cost. 
Unlike  traditional  optimization,  the  function  is  not 
referred  to  as  the  cost  function  but  as  the  fitness 
function  or  objective  function.  Using  an  initial 
population  size  with  randomly  generated 

chromosomes,  where  each  gene  is  generated  by  a 
random  number  generator  within  the  search  space,  the 
chromosome  will  take  the  dimension  of 

j^Npar  ^population  size  ^  evaluating  each 

chromosome  cost  Ci  = /(chromosome  i),i  = 
1,2, population  size,  the  selection  operator  will 
select  a  subset  of  the  chromosomes  based  on  their  cost 
value  to  survive  for  the  next  iteration. 

For  elitism  based  GA,  the  best  performing 
chromosomes  always  survive.  There  are  two  options 
the  population  size,  a  steady-state  or  a  performance 
based  size.  The  first  option  maintains  a  certain  number 
of  chromosomes  for  each  iteration  -  also  referred  to  as 
a  generation;  while  performance  based  size,  selection 
sets  a  minimum  criterion  for  chromosomes  to  survive. 
The  latter  option  may  cause  the  algorithm  to  end 
prematurely  since  not  minimum  criteria  (cost  value). 

Pairing  Operator:  Genetic  Algorithm  may  employ 
a  number  of  pairing  mechanisms.  Among  them  are 
pairing  from  top  to  bottom,  where  the  best  performing 
chromosome  is  paired  with  the  next  best  performing 
chromosome  and  so  on;  random  pairing,  where  a 
uniform  distribution  is  assumed  to  randomly  pick  the 
mother  and  father  chromosome;  weighted  random 
pairing  where  the  probability  of  selection  is  influenced 
by  the  performance  of  the  individual  chromosome;  and 
rank  weighing,  where  the  probability  of  selection  is 
influenced  by  the  ranking  of  chromosome  with  respect 
to  the  others  measured  again  by  the  performance.  In 
this  paper,  the  pairing  is  accomplished  by  determining 
the  cumulative  probability  for  each  chromosome  is 

P(ji)  =  ^  .,  where 

_  population  size  —no  .of  chromosomes  kept 

r  -  ^  , 

and  n  is  the  index  of  chromosomes.  Having  computed 
the  individual  cumulative  probabilities  P(ri),  the 
parent  chromosomes  are  now  selected  by  utilizing  a 


random  number  generator  and  indexing  this  with  the 
cumulative  probability.  Hence,  the  best  performing 
chromosome  has  the  best  chance  of  being  selected,  but 
also,  all  chromosomes  in  the  mating  pool  have  a 
chance  of  being  selected. 

Mating  Operator:  In  this  work,  the  next  generation 
chromosomes  are  created  from  the  mother  and  father 
chromosome  (which  were  selected  as  described  above) 
by  following  equations  given  as: 

mother(a)  —  P(mother(a)  —  father^a)), 

father  (a)  +  ^  (mother  {a)  —  father  (a)), 

Where,  a  =  inteper(rand  *  ), 

P  =  random  number  between  0  —  1,  and  is 

number  of  parameters  for  complete  solution.  In  this  a 
can  also  be  viewed  as  equivalent  to  the  cross-over 
point  utilized  in  the  binary  GA.  Hence,  the  offspring 
(new  chromosomes)  are  found  as 

chrom^,^^  = 

(p^ne-fjiQf  pene-fjiQf  , pene^^^^ ..., 

P^^^dadNpa^  )’ 

and 

chrom^iQy^^  (p^ne^o^d^, pene^Q^^^, ... , pene^^Qy^j^, ..., 

P^nejy^QfdQy  ). 

Mutation:  Mutation  is  an  important  operator  that 
allows  the  search  to  escape  local  minima  in  order  to 
find  better  areas  on  cost  surface.  Too  much  mutation 
will  do  opposite,  i.e.  if  a  chromosome  approach  an 
optimum  point,  it  might  mutate  and  be  placed  at  an 
entirely  different  location  of  the  cost  surface.  Mutation 
is  accomplished  by  randomly  changing  a  gene,  i.e. 
substitute  it  with  a  random  numbers. 


4.  GA  In  OpenMP 

OpenMP  is  a  parallel  programming  model,  which 
uses  some  compiler  directives  and  library  routines  to 
express  shared-memory  parallelism  [10].  OpenMP 
uses  Fortran  and  C++  interfaces,  which  is  a  standard 
feature.  OpenMP  API  is  designed  and  developed  by  a 
group,  which  represents  the  major  vendors  of  high- 
performance  computing  hardware  and  software.  A  set 
of  compiler  directives  is  the  major  part  of  OpenMP 
interface.  The  programmer  adds  these  compiler 
directives  to  a  sequential  program.  Programmer 


specifies  the  synchronization  points  and  tells  the 
compiler  what  parts  of  the  program  to  execute 
concurrently.  As  the  directives  can  be  added  in  a 
incremental  fashion,  the  OpenMP  gives  a  path  and 
platform  for  the  parallelization  of  existing  software.  In 
contrary,  the  Pthreads  and  MPI  approaches  are  library 
routines.  Pthreads  and  MPI  are  linked  with  and  called 
from  a  sequential  program,  and  the  programmer  is 
required  to  divide  the  computational  work  manually 
[11]. 

Literature  does  not  show  any  evidence  of  the  use  of 
OpenMP  parallel  programming  model  for  GA  in 
specific.  This  work  is  using  OpenMP  to  optimize  the 
filter  parameters  of  Bayesian  filters  using  GA 
technique.  The  parallel  cluster  has  four  processors.  The 
idea  of  the  research  is  to  implement  the  GA  using 
OpenMP  on  this  four  processors  cluster  and  compare 
the  results  with  the  output  on  Matlab®  on  a  single 
processor.  The  OpenMP  parallel  programming  model 
is  given  in  Figure  3,  where  sequential  parts  and  parallel 
regions  are  labelled  clearly. 


Sequential  Part 

Parallel  Region 

Sequential  Part 

Parallel  Region 

Sequential  Part 


Figure  3:  OpenMP  Parallel  Programming  Model. 

5.  Results  and  Discussions 

In  this  work,  we  are  using  GA  to  optimize  the 
parameters  of  nonlinear  Bayesian  Filters  for 
electromyographic  (EMG)  signal.  OpenMP  is  a 
parallel  programming  model  for  shared  memory  and 
distributed  shared  memory  multiprocessors.  We  are 
using  OpenMP  on  four  processors  to  improve  the  time 
of  GA  optimization  for  Bayesian  Filter  parameters. 
First  Matlab®  is  used  to  run  GA  on  one  processor, 
and  the  same  algorithm  is  applied  on  OpenMP  parallel 
processing  model  using  four  processors.  Two  sets  of 
data  captured  at  a  sampling  rate  of  2000Hz  are  used, 
first  data  is  for  30  seconds  and  the  second  is  for  60 
seconds.  Total  simulation  time  taken  by  the  Matlab® 


and  OpenMP  is  recorded  precisely.  Following  tables 
shows  the  results  obtained  from  simulations.  Table  1,  2 
and  3  shows  the  Matlab®  simulation  results  for  two 
different  data  sets  of  different  lengths. 


Table  1:  Simulation  time  for  30  seconds  and  60 
seconds  data  sets  in  Matlab®. 


No.  of 

Iterations 

Simulation  time 
seconds  -  30 
seconds  of  data 

set. 

Simulation  time 
seconds  -  60 
seconds  of  data 

set. 

10,000 

7.13 

2393.06 

15,000 

16.95 

2403.52 

20,000 

28.05 

2416.66 

25,000 

42.66 

2432.89 

30,000 

60.61 

2452.34 

35,000 

82.41 

2475.94 

40,000 

108.21 

2503.69 

45,000 

139.35 

2535.91 

50,000 

175.45 

2571.72 

Table  2:  Simulation  time  for  30  seconds  and  60 
seconds  data  sets  in  Matlab®. 


No.  of 
Iterations 

Simulation  time 
seconds  -  30 
seconds  of  data 
set. 

Simulation  time 
seconds  -  60 
seconds  of  data 
set. 

60,000 

208.65 

2613.84 

70,000 

260.67 

2741.73 

80,000 

331.85 

2813.34 

90,000 

428.03 

2913.25 

100,000 

550.89 

3039.70 

Table  3:  Simulation  time  for  30  seconds  and  60 
seconds  data  sets  in  Matlab®. 


No.  of 
Iterations 

Simulation  time 
seconds  -  30 
seconds  of  data 

set. 

Simulation  time 
seconds  -  60 
seconds  of  data 

set. 

125,000 

704.54 

3193.36 

150,000 

943.89 

3433.06 

175,000 

1288.28 

3775.16 

200,000 

1755.77 

4236.28 

Figures  1,  2  and  3  are  graphical  representation  of  the 
results  from  the  Table  1,  2  and  3  respectively.  It  is 
evident  from  Figure  1,  2  and  3  that  CPU  time  is 
directly  proportional  to  the  data  size  and  number  of 
iterations.  Therefore,  increase  in  the  data  size  and  the 
number  of  iterations  results  in  the  increase  in  CPU 
time. 


Iteration  Vs,  CPU  Time  (Seeonds)  ■  30  Seeonds  Data  Set  (Matlab) 
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Figure  1:  Iterations  Vs.  CPU  Time  -  Table  1  Data. 


Iteration  Vs,  CPU  Time  (Seeonds)  ■  30  Seeonds  Data  Set  (Matlab) 


Figure  2:  Iterations  Vs.  CPU  Time  -  Table  2  Data. 


Iteration  Vs.  CPU  Time  (Seconds)  -  30  Seconds  Data  Set  (Matlab) 


Figure  3:  Iterations  Vs.  CPU  Time  -  Table  3  Data. 


6.  Summary  and  Future  Work 

To  conclude  this  work  uses  the  idea  of  parallel 
processing  and  implement  GA  on  OpenMP  parallel 
programming  model  of  four  processors.  First  Matlab® 
GA  code  is  converted  to  C  code  and  then  to  OpenMP 
to  implement  on  the  parallel  cluster.  The  algorithm  is 
implemented  both  in  OpenMP  and  Matlab®  for  25, 
50,  75  and  100  iterations  and  the  time  taken  in 
execution  is  recorded.  As  expected  the  results  shows 
the  improvement  of  time  in  OpenMP  implementation. 
In  future  work,  similar  approach  will  be  applied  using 
MPI  and  OpenMP  and  MPI  combined  for  GA  and 
more  complex  and  advanced  optimization  algorithms. 


Acknowledgement 

The  authors  gratefully  acknowledge  the  support  of  the 
Measurement  and  Control  Engineering  Research 
Center  (MCERC)  and  College  of  Engineering,  Idaho 
State  University  for  using  their  recourses  for  this  work. 


[7]  ABRAMSON  D.,  ABELA  J.,  «  A  parallel 
genetic  algorithm  for  solving  the  school  timetabling 
problem  ».  In  Proceedings  of  the  Fifteenth 
Australian  Computer  Science  Conference  (ACSC- 
15),  vol.  14,  p.  1-11,  1992. 

[8]  ABRAMSON  D.,  MILLS  G.,  PERKINS  S.,  « 
Parallelisation  of  a  genetic  algorithm  for  the 
computation  of  efficient  train  schedules  ». 
Proceedings  of  the  1993  Parallel  Computing  and 
Transputers  Conference,  p.  139-149,  1993. 

[9]  HAUSER  R.,  MANNER  R.,  «  Implementation 
of  standard  genetic  algorithm  on  MIMD  machines 
».  In  DAVIDOR  Y.,  SCHWEFEL  H.-P., 
MANNER  R.,  Eds.,  Parallel  Problem  Solving  fron 
Nature,  PPSN  III,  p.  504-513,  Springer- Verlag 
(Berlin),  1994. 

[10]  [Online]  Available:  http://www.openmp.org. 

[11]  ENRIQUE  A.,  MARCO  T.,  «  Parallelism 
and  Evolutionary  Algorithms  ».  IEEE 
Transactions  on  Evolutionary  Computation,  vol.  6, 
no.  5,  October  2002. 


References 

[1]  E.  Cantu-Paz,  “A  survey  of  parallel  genetic 
algorithms,”  Calculateurs  Paralleles,Reseaux  et 
Systemes  Repartis,  vol.  10,  no.  2,  pp.  141-171,  1998. 

[2]  GOLDBERG  D.  E.,  «  Genetic  and  evolutionary 
algorithms  come  of  age  ».  Communications  of  the 
ACM,  vol.  37,  n  3,  p.  113-119,  1994. 

[3]  GOLDBERG  D.  E.,  DEB  K.,  CLARK  J.  H.,  « 
Genetic  algorithms,  noise,  and  the  sizing  of 
populations  ».  Complex  Systems,  vol.  6,  p.  333- 
362,  1992. 

[4]  HARIK  G.,  CANTU-PAZ  E.,  GOLDBERG  D. 

E.,  MILLER  B.  L.,  «  The  gambler’s  ruin  problem, 
genetic  algorithms,  and  the  sizing  of  populations  ». 

In  Proceedings  of  1997  IEEE  International 
Conference  on  Evolutionary  Computation,  p.  7-12, 
IEEE  Press  (Piscataway,  NJ),  1997. 

[5]  BETHKE  A.  D.,  «  Comparison  of  Genetic 
Algorithms  and  Gradient-Based  Optimizers  on 
Parallel  Processors:  Efficiency  of  Use  of 
Processing  Capacity  ».  Tech.  Rep.  No.  197, 
University  of  Michigan,  Logic  of  Computers 
Group,  Ann  Arbor,  MI,  1976. 

[6]  GREFENSTETTE  J.  J.,  «  Parallel  adaptive 
algorithms  for  function  optimization  ».  Tech.  Rep. 

No.  CS-81-19,  Vanderbilt  University,  Computer 
Science  Department,  Nashville,  TN,  1981. 


A  Study  on  Hybridization  of  Particle  Swarm  and  Tabu  Search 
Algorithms  for  unconstrained  Optimization  and  Estimation  Problems 

ANISH  SEBASTIAN,  PARMOD  KUMAR,  MARCO  P.  SCHOEN 
Measurement  and  Control  Engineering  Research  Center  (MCERC) 

Idaho  State  University 

921  South  8"^  Ave.,  Stop  8060,  Pocatello,  Idaho  83209-8060 
UNITED  STATES  OF  AMERICA 
schomarc@isu.edu  http://www.isu.edu/-schomarc/ 


Abstract:  -  This  paper  presents  a  short  study  on  the  hybridization  of  a  swarm  based  optimization  algorithm 
with  a  single  agent  based  algorithm.  Swarm  based  algorithms  and  single  agent  based  algorithms  have  each 
distinct  advantages  and  disadvantages.  One  goal  of  the  presented  work  is  to  combine  the  concepts  of  the  two 
different  algorithms  such  that  a  more  effective  optimization  routine  results.  In  particular,  we  used  a  Particle 
Swarm  (PS)  based  optimization  algorithm  as  basis  and  induce  Tabu  Search  (TS)  based  operators.  The 
developed  hybrid  algorithm  is  tailored  such  that  it  has  the  capability  to  adapt  to  the  given  cost  function  during 
the  optimization  process.  The  proposed  algorithm  is  tested  on  a  set  of  different  benchmark  problems.  In 
addition,  the  hybrid  algorithm  is  utilized  for  solving  the  estimation  problem  encountered  when  colored  noise  is 
present  and  the  Least  Squares  (LS)  algorithm  has  bias  problems. 

Key-Words:  -  Particle  Swarm,  Optimization,  Tabu  Search,  Parameter  Estimation,  Colored  Noise 


1  Introduction 

Meta-heuristic  approaches  such  as  Particle  Swarm 
Optimization  (PSO)  and  Tabu  Search  (TS) 
algorithms  have  been  around  for  a  few  years.  They 
present  alternative  approaches  to  find  optimality  for 
a  diverse  set  of  optimization  problems,  such  as 
estimation  and  system  identification,  among  others. 
PSO  and  TS  based  approaches  stand  in  contrast  to 
hard  computing  methods  such  as  gradient  based 
methods  by  vastly  reducing  the  computational 
complexity,  especially  for  higher  dimensional 
problems.  A  key  motivation  for  using  these  soft- 
computing  algorithms  is  the  ability  to  escape  local 
optimal  points  in  pursuit  of  the  global  optimum 
during  the  search  process. 

PSO  was  first  introduced  by  Kennedy  and 
Eberhart  as  a  stochastic  global  optimization  routine, 
[1].  The  algorithm  searches  the  cost-surface  with  a 
set  of  individual  particles,  each  representing  a 
solution  to  the  optimization  problem.  The  particles 
orient  themselves  via  influence  components  such  as 
inertia,  current  best  solution  found  by  the  entire 
flock,  and  the  particle’s  best  position.  TS  was 
presented  by  Glover,  [2],  as  an  iterative  optimization 
procedure  that  attempts  to  avoid  the  shortfalls  of  the 
Local  Search  (LS)  algorithm.  TS  is  a  single  agent 
algorithm  that  progresses  through  the  cost  surface  by 
creating  a  set  of  neighbors  (which  are  potential  new 
locations)  and  moves  to  a  new  location  by 
evaluating  these  neighbors  and  comparing  them  to  a 


list  of  previously  visited  locations.  This  list,  the  tabu 
list,  ensures  that  no  cycling  will  occur  and  local 
optimal  points  are  overcome. 

Recent  efforts  in  improving  PSO  and  TS  have 
lead  to  a  number  of  propositions  that  include 
concepts  from  other  optimization  philosophies.  In 
[3]  the  authors  proposed  a  TS-Genetic  Algorithm 
based  scheme  to  find  best  parameter  estimates  in 
colored  noise  environments.  Higashitani  et  al.,  [4] 
proposed  a  predator-prey  based  PSO.  The 
Constriction  Factor  Method  (CFM)  proposed  by 
Clerc  [5]  reduces  the  velocity  of  the  particles  with 
duration  of  the  search  process  in  order  to  facilitate 
the  intensification  over  the  diversification  mission 
with  time.  Combinations  of  PSO  and  TS  have  also 
been  investigated,  such  as  in  [6],  where  PSO  and  TS 
are  switched  at  each  step  to  explore  the  vicinity  of 
the  particles,  and  in  [7]  where  TS  and  PSO  and 
sequential  quadratic  programming  are  combined.  In 
[8]  concepts  of  TS  are  used  to  create  two  swarms  in 
PSO,  one  responsible  for  intensification,  the  other 
for  diversification. 

In  this  paper,  we  investigate  some  elements  of 
the  TS  algorithm  applied  to  the  PSO  scheme.  In 
particular  we  investigate  an  alternative  to  the  CFM 
method,  where  we  use  the  TS  concept  to  adapt  the 
PSO  parameters  to  the  given  problem  using  a 
parallel  scheme  of  hybridization.  The  paper  is 
organized  as  follows;  Section  2  presents  the  problem 
formulation  and  basic  background  on  PSO  and  TS. 


Section  3  introduces  the  proposed  PSO-TS 
hybridization  algorithm,  while  Section  4  will  present 
the  results. 


2  Problem  Formulation 

The  optimization  problems  addressed  in  this  paper 
are  of  the  unconstrained  type.  Consider  a  real  valued 
objective  function  /(x)  defined  on  a  set  xgS  in 
M"  .  We  are  tasked  to  find  a  point  x  corresponding 
to  the  value  of  /(x  )  such  that 

/(x*)  =  min{/(x)|xe5'}  (1) 

The  difficulty  of  finding  such  a  point  arises  when 
/b)  or  the  feasible  domain  S  is  non-convex.  For 
such  problems,  gradient  based  methods  will  result  in 
local  optimums.  Soft  computing  methods  such  as 
PSO  and  TS  allow  for  an  escape  from  local 
optimums  and  the  continued  search  for  a  better 
optimum,  in  the  extreme  case  the  global  optimum. 
For  PSO  algorithms,  we  consider  a  set  of  particles 
p  and  their  associated  location  x^  where  i  is  the 
index  for  the  particles.  The  particles  explore  S  in  an 
incremental  fashion.  Their  position  is  altered  at  each 
step  by  the  following  update  rule: 

x'  (^  +  l)  =  x'  (^)  + v'  (^  +  l),  (2) 

where,  k  is  the  increment  number  and  v'  the 
velocity  associated  with  the  particle,  which  can  be 
computed  as  follows: 

V-'  (^  + 1)  =  wy\k)  +  qri  [b^  -x’'  (^)]  + 

+  c^r^\h\-iL‘{k)\. 

In  the  velocity  update  formula,  and  b'  represent 
the  best  ever  position  of  the  particle  i  ancf  the  global 
best  position  of  the  swarm  up  to  iteration  k, 
respectively.  ri  and  r2  are  uniformly  distributed 
random  numbers  between  0  and  1,  while  w,  ci  and  C2 
are  weighting  coefficients  that  manage  the  three 
tendencies  of  Equation  (3).  These  tendencies  -  as 
given  by  the  three  terms  in  the  velocity  equation  - 
are  characterized  as:  audacious  for  following  your 
own  way;  conservative,  for  going  back  towards  your 
best  previous  position;  and  sheep-like,  for  being 
pulled  to  the  best  overall  position.  The  weighting 
coefficients  help  the  balancing  act  of  combining 
these  tendencies  in  order  to  be  globally  efficient. 
The  PSO  scheme  described  so  far  is  rather  simple 
and  computationally  very  efficient,  especially  when 
compared  to  a  GA  or  any  gradient  based  methods. 
To  further  this  algorithm,  a  limitation  on  the 
maximum  value  of  V  can  be  imposed,  say 
This  type  of  velocity  clamping  balances  the 
exploration  and  intensification  and  also  avoids 
excessive  velocities  that  are  responsible  for  particles 
overshooting  their  targets,  [9].  Also,  the  CFM 
method  can  be  employed,  where  the  velocity  update 
is  modified  -  reduced  -  as  the  search  progresses.  For 
this.  Equation  (3)  is  altered  as  follows: 


y\k^\)  =  K^  [v-' (/:)  +  (b;  - x-' (^))]  + 

^:x[+c/,(b;-x'w)] 


(4) 


where 


K  = 


and  ^  +  C2 ,  as 


given  by  [5]. 

The  inertia  weight  w  has  a  competing  purpose  to 
the  velocity  clamping  method  [10],  and  is 
responsible  for  balancing  the  exploration  and 
intensification  part  of  the  PSO.  In  [II]  it  is  also 
shown  that  w  is  problem  dependent.  In  this  paper, 
we  will  investigate  the  option  of  adapting  w  using  a 
TS  based  scheme  such  that  the  PSO  algorithm 
becomes  less  problem  dependent.  Besides  tv,  q 
and  control  the  stochastic  influence,  analogous 
to  the  mutation  operator  in  GA.  In  [12],  it  is  stated 
that  for  most  problems  one  chooses  q  =  C2 ,  but  the 
ratio  is  also  problem  dependent,  i.e.  for  unimodal 
problems  with  smooth  surfaces,  usually  one  selects 
C2  >  q ,  while  for  multimodal  problems  these 
coefficients  are  chosen  to  be  q  >Cj.  In  this  paper, 
we  also  will  investigate  the  optimization  of  these 
coefficients  by  implementing  a  TS  scheme  in 
parallel  to  the  PSO. 

The  TS  algorithm  has  the  same  objective  as  PSO- 
given  by  Equation  1.  A  TS  algorithm  employs  one 
candidate  point  which  moves  incrementally  on  S . 
The  moves  between  increments  are  defined  by 
selecting  the  best  update  from  a  set  of  candidate 
points.  This  set  is  created  by  forming  R  n- 
dimensional  spheres  about  the  current  position,  and 
randomly  place  a  point  in  each  section  (sphere). 
These  points  are  evaluated  on  /(x)  and  then 
compared  to  a  list  T  e  of  previously  visited 
places.  The  list  length  q  basically  represents  the 
memory  of  the  algorithm.  Around  each  element  in 
T  a  /I -dimensional  sphere  is  created  serving  as  a 
tabu-ball,  where  no  new  solution  can  be  located.  The 
best  performing  candidate  point  not  violating  the 
restricted  spaces  given  by  the  q  tabu  balls  is 
selected  as  the  new  position  of  the  search.  An 
aspiration  criterion  can  be  formulated  as  an  escape 
clause  to  circumvent  the  restrictions  imposed  by  the 
tabu-balls,  often  in  the  form  of  having  an  improved 
cost  to  the  current  solution.  All  of  the  past  best 
solutions  are  stored  in  a  new  list  -  the  promising  list, 
which  is  assembled  as  the  TS  algorithm  processes. 
The  optimum  of  the  entries  of  that  list  will  be  used 
as  the  final  optimal  value  of  the  algorithm. 

Usually,  q,  R ,  and  the  dimension  of  the 
individual  R' s  are  considered  the  control 
parameters  of  the  TS  algorithm,  which  are  all 
problem  dependent. 


3  Problem  Solution 

The  selection  of  w,  q ,  and  have  rather  large 
implication  on  the  update  of  the  new  velocity  vector 
v'(A:  +  l),  as  is  illustrated  in  Fig.  1.  Here,  the  three 


influence  vectors  with  regard  to  the  global  best 
solution,  -x  [k) ^  and  with  regard  to  the  particles 
best  solution  -x  (/:)  as  well  as  the  inertia  vector 
v'  (^)  are  depicted  for  an  instant  k  and  a  single 
particle  i.  Each  of  these  vectors  are  pre-multiplied 
by  tv ,  q  ,  and  respectively,  resulting  into  some 
variation  of  the  vectors,  denoted  by  A  in  Fig.  1. 


Location  of 


Fig.  1:  Adaptation  of  proposed  PSO-TS  Algorithm. 

As  stated  earlier,  these  three  influence  coefficients 
are  problem  dependent.  In  this  paper,  we  propose  to 
find  the  optimal  coefficients  by  utilizing  a  TS.  This 
is  accomplished  by  using  the  variation  of  the 
influence  vectors  to  describe  a  new  search  area,  in 
which  the  original  cost  function  /  is  prescribed. 
In  Fig.  I,  this  area  is  symbolized  in  the  shaded 
ellipsoid.  The  best  combination  of  coefficient  along 
with  the  influence  vectors  will  then  determine  the 
velocity  update  v(^  +  l).  This  optimization  is 
repeated  at  each  increment.  TS  lends  itself  well  for 
this  purpose,  since  it  is  computationally  very 
efficient.  Since  ry  and  r2  are  superimposed  to  the 
influence  coefficients,  we  will  investigate  an  option 
where  this  randomization  is  suppressed. 

Parameter  estimation  is  an  important  concept  in 
engineering  where  a  mathematical  model  of  a 
system  is  identified  with  the  help  of  input  and  output 
signals.  The  classical  Least  Squares  (LS)  algorithm 
gives  an  unbiased  estimate  of  the  parameters  when 
the  system  noise  is  white.  A  bias  result  may  occur  if 
the  residual  £{k)  =  y{k)  -  y{k)  is  not  white,  where 
y  is  the  system  output,  y  is  the  estimated  output, 
and  k  is  the  discrete  time  index.  For  such  instances, 
one  can  use  a  whitening  filter,  i.e.  C{q~^)£{k)  =  e{k) , 
where  C(z“')  is  the  coefficient  polynomial  of  the 
whitening  filter  and  is  the  backward  shift 
operator.  The  corresponding  cost  function  for  the 
estimation  becomes,  [3]: 

J  =  =  Y,[C{z')A{z')y{k)  +  C{z)B{z')u{k)t  ^ 

where,*  m(^)  is  the  input  sequence,  A(z ‘)and  B{z  ') 
are  the  numerator  and  denominator  polynomials 
of  the  system  transfer  function,  respectively.  As 
the  signal  to  noise  ratio  becomes  large,  the  cost 
function  J  may  become  multimodal.  This  was 
shown  by  Soderstrom  et  al.  [13].  In  order  to 


obtain  the  global  minimum  an  intelligent 
optimization  technique  needs  to  be  employed.  In 
this  paper,  we  will  utilize  the  proposed  hybrid  PSO- 
TS  algorithm  to  such  parameter  estimation  problems 
with  a  colored  noise  environment  and  compare  it  to 
the  traditional  LS  method. 


4  Simulation  Results 

The  proposed  hybrid  algorithm  is  tested  on  a  set  of 
standard  optimization  benchmark  problems,  which 
are  listed  below: 

n 

Spherical:  /(x)  =  ^v^^  and 

7=1 

Quadratic:  =  ? 

where  x.  e  [-100,100]  and  =  [0,0] . 

n 

Hyperellipsoid:  where  g[-I,I] 

7=1 

and  =  [0,0] . 

Bohachevsky  1: 

/(x)  =  v"  +2x1  -0-3  cos  (3;rv^ )  -  0.4  cos  (4;rv2 )  +  0.7 
where  x.  e  [-50,50]  and  /(^x*^  =  [0,0] . 

Rastrigin:  =  !(-:  ^ -I0cos(^2;rv^^  +  I0^  where 

7=1 

X.  G  [-5.12,5.12]  and  /(^x*^  =  [0,0] . 

Rosenbrock: 

/(x)  =  £  100(x,.-4._,)'+(l-x,._,)'  ,  where 

7=1  ^ 

X .  G  [-2.048, 2.048]  and  /  (x* )  =  [l,  l] . 

Haupt  &  Haupt:  /(x)  =  sin(4x^)  +  l.lv2  sin (2X2), 

where  x.  g[0,10]  and  /(x*)  =  [9.0389,8.6674] . 

In  addition  to  these  benchmark  problems,  we  also 
will  test  the  proposed  algorithm  to  some  parameter 
estimation  problem  with  a  colored  noise 
environment.  In  particular,  we  will  test  the  algorithm 
on  one  simple  model,  which  is  given  by  Equation  5: 
y(^)  =  0.5y(^-l)-0.5y(^-2)  +  w(^)  +  ^(^)  (5) 

The  simulation  was  carried  out  by  using  the 
following  set  of  parameters  and  conditions: 
uniformly  distributed  initial  locations  of  particles, 
number  of  neighborhoods  created  at  each  step  for 
each  particle  R  =  25,  uniform  initial  velocity  of 
magnitude  1  for  all  particles,  p  =  40 ,  q  =  5  ,  radius 
of  the  n  dimensional  Tabu  balls: 


r  =  0.025 (x  -X  where  x  and  x  are  the 
dimensions  of  S ,  radius  of  neighborhood  =  0.5r  , 
and  radius  of  promising  balls  =  0.5r^ .  The  PSO 
portion  utilized  100  iterations,  while  the  embedded 
TS  section  used  10  iterations.  Since  randomness  is  a 
factor  in  the  used  and  proposed  algorithms,  and  in 
order  to  gain  some  kind  of  understanding  of 
consistency,  the  simulations  were  carried  out  100 
times  for  each  cost  function  listed  above. 

Table  1  lists  the  results  for  the  unconstraint 
optimization  problems  in  comparison  with  the 
original  PSO  algorithm.  In  this  set  of  simulations,  rj 
and  r2  were  selected  to  be  uniform  random  between 
0  and  1 . 


Table  1:  Simulation  results  with  random  r 


Cost  Function 

PSO 

Hybrid  PSOTS 

w 

w,  cl 

W,CiC2 

Spherical 

0.55135 

0.17214 

0.0555 

0.2216 

Quadratic 

0.50718 

0.25637 

0.12497 

0.1347 

Bohachevsky 

0.80852 

0.17689 

0.15473 

0.01617 

Hperellipsoid 

0.03252 

0.00436 

0.00745 

0.00069 

Rastrigin 

0.07168 

0.16678 

0.16728 

0.16021 

Rosenbrock 

1.4261 

1.43255 

1.47011 

1.44042 

Haupt 

12.4736 

10.5563 

10.5329 

11.5222 

Table  2  lists  the  results  for  the  unconstraint 
optimization  problems  in  comparison  with  the 
original  PSO  algorithm.  In  this  set  of  simulations,  rj 
and  r2  were  set  equal,  at  all  times,  to  1.  The 
proposed  hybrid  optimization  algorithm,  regardless 
of  which  set  of  coefficients  are  optimized,  performs 
significantly  better  in  comparison  to  the  standard 
PSO  for  the  Hyperellipsoid,  the  Bohachevsky  cost 
function.  For  this  case  too  (ry  and  r2  fixed),  the 
spherical  and  the  quadratic  functions  produced 
better  results.  In  both  the  cases  there  was  no 
improvement  in  the  Rosenbrock  function  values  and 
the  Rastrigin  still  showed  poor  results  as  compared 
to  the  standard  PSO  algorithm. 


Table  2:  Simulation  results  with  fixed  r 


Cost  Function 

PSO 

Hybrid  PSOTS 

w 

w,  cl 

W,CiC2 

Spherical 

0.55135 

0.08975 

0.19801 

0.81325 

Quadratic 

0.50718 

0.31023 

0.14124 

0.07529 

Bohachevsky 

0.80852 

0.13091 

0.20773 

0.15158 

Hperellipsoid 

0.03252 

0.01464 

0.01736 

0.00278 

Rastrigin 

0.07168 

0.13648 

0.23206 

0.4902 

Rosenbrock 

1.4261 

1.44026 

1.44147 

1.39044 

Haupt 

12.4736 

10.6342 

10.8366 

10.8408 

The  distinction  between  the  characteristics  of  the 
cost  function  and  the  performance  of  the  proposed 
algorithm  can  be  made  by  associating  the  presented 
results  with  unimodal  and  multimodal  cost 
functions.  As  listed  above,  the  improved 
performance  given  by  the  proposed  hybrid  algorithm 
is  found  for  unimodal  cost  functions.  While  the 


proposed  algorithm  does  work  well  for  multimodal 
cost  functions,  it  excels  in  comparison  to  the 
standard  PSO  algorithm  with  regard  to  unimodal 
functions. 

A  key  objective  of  this  paper  is  to  make  the 
proposed  algorithm  adaptive  in  nature  to  the 
subjected  problem,  i.e.  cost  function.  As  detailed  in 
Section  2,  the  choice  of  the  influence  coefficients  is 
dependent  on  the  characteristics  of  the  cost  surface. 
The  proposed  hybrid  algorithm  optimizes  these 
coefficients  as  well  as  the  inertia  coefficient  w  at 
each  iteration.  Hence  we  can  plot  these  coefficients 
in  order  to  determine  if  they  show  adaptation  and 
consistency.  This  is  done  in  Fig.  2.  The  plot  is  a 
representative  characterization  of  the  simulation 
results  obtained  for  the  tested  multimodal  cost 
functions.  We  can  recognize  that  the  proposed 
algorithm  adapts  fast  to  the  cost  function  and  selects 

>  C2  as  determined  in  the  literature,  indicating 
that  each  particle  is  dominated  by  its  own  personal 
best,  and  the  algorithm  is  searching  wider  ranges. 
The  rather  non-smooth  convergence  plot  is  due  to 
the  fact  that  ri  and  r2  are  kept  random  and  impose  a 
perturbation  to  the  optimal  location  of  the  influence 
coefficients.  In  comparison,  the  same  plots  are 
generated  for  some  multimodal  cost  functions,  i.e. 
the  Hyperellipsoid  in  Fig.  3  and  Spherical  as 
depicted  in  Fig.  4.  In  both  cases  for  the  unimodal 
cost  functions,  the  coefficients  move  quickly  to  the 
case  where  as  given  in  the  literature,  but 

after  a  few  iterations,  the  weighting  is  switched  and 
q  >  C2 

This  implies  that  the  particles  are  no  longer 
dominated  by  the  global  optimum,  but  rather  by 
their  own  personal  best  performance  and  try  to 
improve  their  performances.  An  explanation  for  this 
is  found  by  considering  the  convergence  plot,  as 
detailed  in  Fig.  5.  Here  we  can  see  that  most  of  the 
convergence  is  achieved  after  the  first  few  iterations. 
Once  not  much  improvement  is  found,  the  algorithm 
tries  to  spread  out  and  search  larger  regions  rather 
than  concentrating  to  the  area  dominated  by  the 
current  global  best  solution.  This  adaptation  may 
explain  the  cause  for  the  improved  performance  of 
the  proposed  algorithm  for  unimodal  functions 
compared  to  standard  PSO  algorithms. 

The  hybrid  algorithm  was  also  tested  to  estimate 
the  parameters  of  the  system  given  by  Equation  (5). 
The  estimated  system  parameters  are  given  in  Table 
3  for  the  two  cases  a)  Random  rj  and  r2  and  b)  Fixed 
rj  and  r2  to  unity.  In  addition,  we  distinguished  two 
cases  where  we  either  computed  the  instantaneous 
optimum  value  of  the  influence  coefficients  and  the 
accumulated  “averaged”  optimum.  The  variance  in 
the  noise  was  set  at  1%,  while  the  input  sequence 
was  a  white  noise  sequence  with  variance  of  30%. 
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Fig.  2:  Plot  of  optimized  influence  coefficients. 
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ig.  3:  Plot  of  optimized  influence  coefficients  for 
Hyperellipsoid  cost  function. 


0.9 

0.8 

0.7 

0.6 

0.5 

0.4 

0.3 

0.2 

0.1 

0 


cl 

c2 


40  60  80 

Iteration  Index  k 


Fig.  4:  Plot  of  optimized  influence  coefficients  for 
the  Spherical  cost  function. 


Fig.  5:  Plot  of  global  best  cost  vs.  iteration  index  for 
the  Spherical  cost  function. 
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l)le  3:  Simulation  Results  for  Estimation 


Random 

Accumulative 

w 

0.5898 

-0.4583 

1.0425 

w,cl 

0.5319 

-0.3717 

1.1217 

w,cl,c2 

0.4704 

-0.4666 

0.8921 

Just  Optimum 

w 

0.5340 

-0.5159 

1.0025 

w,cl 

0.5339 

-0.5234 

1.0550 

w,cl,c2 

0.4820 

-0.4622 

1.0110 

Fixed 

Accumulative 

w 

0.5289 

-0.3794 

1.0061 

w,cl 

0.5018 

-0.3799 

1.0777 

w,cl,c2 

0.478 

-0.4917 

0.9182 

Just  Optimum 

w 

0.4707 

-0.4827 

1.0515 

w,cl 

0.4797 

-0.4397 

1.0260 

w,cl,c2 

0.5074 

-0.5164 

0.9794 

The  hybrid  algorithm  gave  the  best  estimated 
values  of  the  system  parameters  for  the  following 
combination;  Fixed  rj  and  r2,  just  optimum,  w,  Cj,  C2 
optimized,  and  40  particles.  Table  3  is  giving  the 
average  values  based  on  10  sample  points.  This 
combination  was  then  used  to  compare  the  results  of 
the  hybrid  algorithm  with  Least  Squares  (LS).  Table 
4  shows  the  comparison  between  LS  and  the 
proposed  hybrid  algorithm  for  various  variances  in 
the  noise  level.  The  hybrid  PSOTS  again 
outperforms  the  LS  method  in  almost  all  the  cases 
and  in  some  estimated  values.  These  cases  are 
highlighted  in  bold  italics.  Simulation  runs,  for  the 
hybrid  algorithm,  for  variances  0.05,  0.09,  0.1  and 
0.2  were  increased  from  10  to  30  which  gave 
slightly  better  results  once  again  in  comparison  to 
the  LS. 


Table  4:  Comparison  Hybrid  PSOTS  and  LS 


Simulation  Options:  Optimized  w,cl,c2.  Fixed  and 
and  Just  Optimum,  Simulation  Runs  :  10 

Hybrid  PSOTS 

Least  Squares 

Variance:  0.001 

[0.5265,-0.4688,0.96951 

[-0.00640,-0.4238,0.8794] 

Variance:  0.005 

[0.5256,-0.5206,1.05311 

[0.0005,-0.5050,0.8703] 

Variance:  0.009 

[0.5289,-0.4394,0.96401 

[0.0640,-0.5395,0.8626] 

Variance:  0.01 

[0.5074,-0.5164,0.97941 

[0.0208,-0.4711,0.8592] 

Variance:  0.05 

[0.4183, -0.3>9%^,0.95391 

[0.1354,-^.5J45,0.8100] 

Variance:  0.09 

[0.3300,-0.2699,0.98401 

[Q.t)9U,-0.7102,Q.9513] 

Variance:  0.1 

[0.4035,-0.3056,1.0322] 

[0.1276,-^.6654,0.8821] 

Variance:  0.2 

[0.2952,-0.16^4,0.98611 

[0.0418,-6.7696,0.9323] 

Variance:  0.05,  Simulation  runs: 30 

[0.4476,-0.3844,1.00491 

[0.1354,-6.5545,0.8100] 

Variance:  0.09,  Simulation  runs: 30 

[0.3852,-0.3505,0.9672] 

[0.0981,-6.7762,0.9573] 

Variance:  0.1,  Simulation  runs: 30 

[0.4129,-0.3550,0.9922] 

[0.1276,-6.6654,0.8821] 

Variance:  0.2,  Simulation  runs: 30 

[0.3072,-0.2769,0.9970] 

[0.0418,-6.7696,0.9323] 

4  Conclusion 

In  this  paper,  we  propose  a  hybrid  PSO-TS 
algorithm  for  optimization  of  unconstraint  cost 
functions.  The  algorithm  adapts  to  the  underlying 
cost  surface  by  adjusting  the  influence  coefficients 
at  each  step.  The  proposed  algorithm  is  tested  on  a 
series  of  benchmark  problems  and  showed  improved 
performance  for  unimodal  cost  functions.  In 
addition,  the  hybrid  PSO-TS  algorithm  is  tested  on 
one  parameter  estimation  problem  where  colored 
noise  influence  causes  bias  estimates  when  the  LS 
algorithm  is  used.  The  simulations  indicate  an 
improved  estimate  when  the  proposed  PSO-TS 
algorithm  is  used. 
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Abstract:  -  Skeletal  muscle  force  can  be  estimated  using  surface  electromyographic  (sEMG)  signals.  Usually,  the 
sEMG  location  for  the  sensors  is  near  the  respective  muscle  motor  unit  points.  Skeletal  muscles  generate  a  temporal 
and  spatial  distributed  EMG  signal,  which  causes  cross  talk  between  different  sEMG  signal  sensors.  In  this  paper,  an 
array  of  three  sEMG  sensors  is  used  to  capture  the  information  of  muscle  dynamics  in  terms  of  sEMG  signals  and 
generated  muscle  force.  The  recorded  sEMG  signals  are  filtered  utilizing  optimized  nonlinear  Half-Gaussian  Bayesian 
filter,  and  a  Chebyshev  type-II  filter  prepares  the  muscle  force  signal.  The  filter  optimization  is  accomplished  using 
Genetic  Algorithm  (GA).  Multi  nonlinear  Auto  Regressive  exogenous  (ARX)  and  Wiener-Hammerstein  models  with 
different  nonlinearity  estimators/classes  are  obtained  using  system  identification  (SI)  for  three  sets  of  sensor  data.  The 
outputs  of  these  models  are  fused  with  a  probabilistic  Kullback  Information  Criterion  (KIC)  for  model  selection  and  an 
adaptive  probability  of  KIC.  First,  the  outputs  are  fused  for  the  same  sensor  and  for  different  models  and  then  the  final 
outputs  from  each  sensor.  The  final  fusion  based  output  of  three  sensors  provides  good  skeletal  muscle  force  estimates. 

Key-Words:  -  sEMG,  ARX,  Weiner-Hammerstein,  KIC,  SI,  GA 


1  Introduction 

Aftereffects  of  the  loss  of  upper  limbs  are  a  reduction 
of  functionality  and  psychological  disturbance  for  the 
person.  According  to  [1]  there  are  1.7  million  peoples 
with  amputation  in  the  United  States  and  this  number  is 
on  rise  after  the  Afghanistan  and  Iraq  war  in  2003  [2]. 
Conversely,  a  prosthetic  limb  can  considerably  increase 
the  functionality  of  an  amputee  and  benefit  the  person  in 
everyday  life. 

In  the  past,  there  have  been  various  research  works 
towards  prosthetic  hand  design,  having  similar 
functionality  and  appearance  as  human  hand  [3-4].  Most 
of  these  research  works  are  based  on  electromyography 
(EMG).  The  EMG  signal  is  activated  and  controlled  by 
the  central  nervous  system,  which  depends  on  the  flow 
of  specific  ions  such  as  sodium  (Aa"^),  potassium  (K^) 
and  calcium 

An  EMG  signal  recorded  on  the  surface  of  the  limb  is 
expressed  as  an  electric  voltage  ranging  between  -5  and 
+5  mV.  This  method  is  known  as  surface 
electromyography  (sEMG).  sEMG  is  utilized  as  an  input 
to  the  controller  to  realize  the  movements  of  the 
prosthesis  and  force  control  [5-6].  Past  research  results 
show  that  EMG  signal  amplitude  generally  increases 
with  skeletal  muscle  force.  However,  this  relationship  is 
not  always  rigid;  various  factors  affect  this  relationship. 


EMG  signals  are  a  result  of  the  varying  motor  unit 
recruitments,  crosstalk,  and  biochemical  interaction 
within  the  muscular  fibres.  This  makes  EMG  signals 
random,  complex  and  dynamic  in  nature  and  the  control 
of  the  prosthesis  difficult.  Moreover,  it  changes 
continuously  due  to  the  onset  and  progression  of  muscle 
fatigue  which  results  because  of  continuous  high 
frequency  stimulation  or  because  of  titanic  stimulation 
[7].  Synchronization  of  active  motor  units  along  the 
muscle  fibres,  and  a  decrease  in  conduction  velocity  are 
reflected  in  the  EMG  signal  as  an  increase  of  amplitude 
in  time  domain  and  a  decrease  of  medium  frequency  in 
frequency  domain  [8].  All  these  factors  make  the 
relationship  between  EMG  and  force  nonlinear.  Correct 
interpretation  of  EMG  signal  is  vital  to  achieve  precise 
motion  and  force  control  of  prosthesis. 

The  present  work  presents  a  novel  approach  to 
estimate  skeletal  muscle  force  using  an  adaptive  multi¬ 
sensor  data  fusion  algorithm  with  hybrid  nonlinear  ARX 
and  Wiener-Hammerstein  models.  Here,  an  array  of 
three  sEMG  sensors  is  used  to  capture  the  information  of 
muscle  dynamics  in  terms  of  sEMG  signals.  The 
recorded  sEMG  signals  are  filtered  utilizing  optimized 
nonlinear  Half-Gaussian  Bayesian  filter  parameters,  and 
the  skeletal  muscle  force  signal  is  filtered  by  using  a 
Chebyshev  type-II  filter.  A  simple  Genetic  Algorithm 


code  is  used  to  optimize  the  Bayesian  filter  parameters. 
Using  an  input/output  approach,  the  EMG  signal 
measured  at  the  skin  surface  is  considered  as  input  to  the 
skeletal  muscle,  whereas  the  resulting  hand/finger  force 
constitutes  the  output.  Multi  nonlinear  ARX  and 
Wiener-Hammerstein  models  with  different  nonlinearity 
estimators/classes  are  obtained  using  SI  for  three  sets  of 
sensor  data  obtained  from  the  vicinity  of  a  single  motor 
unit.  Different  nonlinearity  estimators/classes  are  used 
for  nonlinear  modeling  as  they  capture  the  dynamics  of 
the  system  differently.  The  outputs  of  estimated 
nonlinear  models  are  fused  with  a  probabilistic  Kullback 
Information  Criterion  (KIC)  for  model  selection  and  an 
adaptive  probability  of  KIC.  First,  the  outputs  are  fused 
for  the  same  sensor  and  for  different  models  and  then  the 
final  outputs  from  each  sensor.  The  final  fused  output  of 
three  sensors  provides  good  skeletal  muscle  force 
estimates. 


Fig.  1:  The  Flow  Chart  for  Skeletal  Muscle  Force  Estimation. 

Fig.  1  shows  the  flow  chart  for  skeletal  muscle  force 
estimation.  This  paper  is  stmctured  as  follows.  First,  the 
experimental  set-up,  pre-processing  and  filter  parameter 
optimization  for  sEMG  signals  are  discussed.  Second, 
nonlinear  ARX  and  Wiener-Hammerstein  modeling  are 
covered.  Third,  the  fusion  of  various  nonlinear  model  outputs 


using  KIC  and  adaptive  probability  of  KIC  is  covered.  Finally, 
the  results,  discussion  and  future  work  are  provided  followed 
by  a  conclusion  to  summarize  the  importance  of  this  work. 

2  Experimental  Set-Up  and  Pre- 
Processing 

The  experimental  set-up  is  shown  in  Fig.  2.  Both 
sEMG  and  muscle  force  signals  were  acquired 
simultaneously  using  Lab  VIEW™  at  a  sampling  rate  of 
2000  Hz.  The  sEMG  data  capturing  was  aided  by  a 
DELSYS®  Bagnoli-16  EMG  system  with  DE-2.1 
differential  EMG  sensors.  The  corresponding  force  data 
was  captured  using  Interlink  Electronics  FSR  0.5” 
circular  force  sensor.  One  sEMG  sensor  was  placed  on 
the  motor  point  of  the  ring  finger  and  two  adjacent  to 
the  motor  point  of  a  healthy  subject.  Prior  to  placing  the 
sEMG  sensors,  the  skin  surface  of  the  subject  was 
prepared  according  to  International  Society  of 
Electrophysiology  and  Kinesiology  (ISEK)  protocols. 


Fig.  2:  Experimental  Set-Up. 


According  to  previous  research,  the  Bayesian  based 
filtering  method  yields  the  most  suitable  sEMG  signals 
[9].  The  nonlinear  filter  significantly  reduces  noise  and 
extracts  a  signal  that  best  describes  EMG  signals  and 
may  permit  effective  use  in  prosthetic  control.  An 
instantaneous  conditional  probability  density  P(EMG\x) 
provides  the  resulting  EMG  for  the  latent  driving  signal 
X  [9].  The  model  for  the  conditional  probability  of  the 
rectified  EMG  signal  emg  =  \EMG\is  used  in  this 
current  estimation  algorithm.  EMG  signals  are  usually 
described  as  amplitude-modulated  zero  mean  Gaussian 
noise  sequence  [10].  For  the  rectified  EMG  signal,  the 
“Half-Gaussian  measurement  model”  in  [9]  is  given  by 
Equation  (1). 

P(emg\x)  =  2  *  exp(-^^^)/(2  *  tt  *  (1) 

The  EMG  signal  is  modeled  for  the  conditional 
probability  of  the  rectified  EMG  signal  as  a  filtered 
random  process  with  random  rate.  The  likelihood 
function  for  the  rate  evolves  in  time  according  to  a 


Fokker-Planck  partial  differential  equation  [9].  The 
diserete  time  Fokker-Planek  Equation  is  given  by 
equation  (2). 

p(x,  t—)  ^  a  ^  p(x  —  t  —  1)  +  (1  —  2  *  cr)  *  p(x,  t  — 
1)  +  a  *  p(x  +  £;  t  -  1)  +  +  (1  -  jff)  *  p(x,  t  -  1). 

(2) 

Here,  a  and  P  are  two  free  parameters,  a  is  the  expeeted 
rate  of  gradual  drift  in  the  signal,  and  ^  is  the  expeeted 
rate  of  sudden  shifts  in  the  signal.  The  unknown  driving 
signal  X  is  diseretized  into  bins  of  width  a.  These  two 
free  parameters  of  the  non-linear  Half-Gaussian  filter 
model  are  optimized  for  the  aequired  EMG  data  using 
elitism  based  GA. 

A  Chebyshev  type  II  low  pass  filter  with  a  550  Hz 
pass  frequeney  is  used  to  filter  the  foree  signal.  Fig.  3 
depiets  the  raw  and  Chebyshev  type-II  low  pass  filtered 
foree  signals. 


(a)  Raw  Skeletal  Muscle  Force  Signal 


Time  (60.35  secs)  x  io* 

(b)  Chebyshev  Type  -  H  Filtered  Force  Signal 


Fig.  3:  (a)  Raw  and  (b)  Chebyshev  Type-II  Filtered 
Skeletal  Muscle  Force  Signals. 

3  Nonlinear  ARX  and  Wiener- 
Hammerstein  Modeling 

In  this  paper,  we  are  using  nonlinear  ARX  and 
Wiener-Hammerstein  models  with  different  nonlinearity 
estimators/elasses  to  model  three  sEMG  sensors  data  as 
input  and  skeletal  musele  foree  data  as  output.  The 
nonlinear  ARX  model  uses  a  parallel  eombination  of 
nonlinear  and  linear  bloeks  [11]. 

Fig.  4  shows  the  nonlinear  ARX  model  strueture.  The 
nonlinear  ARX  model  uses  regressors  as  variables  for 
nonlinear  and  linear  funetions.  Regressors  are  funetions 
of  measured  input-output  data  [11].  The  predieted  output 
y(t)  of  a  nonlinear  model  at  time  t  is  given  by  the 
general  Equation  (3): 

y(t)  =  F(x(t))  (3) 

where  x(t)  represents  the  regressors,  F  is  a  nonlinear 
regressor  eommand,  whieh  is  estimated  by  nonlinearity 
estimators/elasses  [11].  As  shown  in  Fig.  4,  the 
eommand  F  ean  inelude  both  linear  and  nonlinear 
funetions  of  x(t).  Equation  (4)  gives  the  deseription  of 
F. 

FM  =  -  7fc))  (4) 


where  k  is  the  unit  nonlinear  eommand,  d  is  the  number 
of  nonlinearity  units,  and  aj^,  and  are  the 
parameters  of  the  nonlinearity  estimators/elasses  [11]. 


Fig.  4:  Nonlinear  ARX  Model  Strueture. 

The  Wiener-Hammerstein  model  uses  one  or  two 
statie  nonlinear  bloeks  in  series  with  a  linear  bloek. 
Struetural  representation  of  a  nonlinear  Wiener- 
Hammerstein  is  shown  in  Fig.  5  [11]. 


Output  y(t) 

Fig.  5:  Nonlinear  Wiener-Hammerstein  Model  Strueture. 

The  general  Equations  (5),  (6),  and  (7)  ean  deseribe 
the  Wiener-Hammerstein  strueture  [11]. 
w(t)  =  /(u(t))  (5) 

y(t)  =  /i(x(t)).  (7) 

where  u(t)  and  y(t)  are  input  and  output  of  the  system, 
respeetively,  /  and  h  are  nonlinear  funetions,  whieh 
eorresponds  to  input  and  output  nonlinearity, 
respeetively,  w(t)  and  x(t)  are  internal  variables,  where 
w(t)  has  the  same  dimensions  as  u(t)  and  x(t)  has  the 
same  dimensions  as  y(t),  and  B(q)  and  F(q) 
eorresponds  to  the  linear  dynamie  bloek,  these  are 
polynomials  in  the  baekward  shift  operator. 

The  nonlinearity  elasses  used  in  this  work  are 
Wavenet,  Treepartition,  Sigmoidnet,  Pwlinear, 
Saturation,  and  Deadzone.  For  motor  point  and  ringl 
sensors,  three  nonlinear  ARX  and  four  nonlinear 
Wiener-Hammerstein  models  with  different  nonlinearity 


estimators/classes  are  obtained.  For  ring2  sensor,  three 
nonlinear  ARX  and  five  nonlinear  Wiener-Hammerstein 
models  with  different  nonlinearity  estimators/elasses  are 
obtained. 


4  Data  Fusion  and  Adaptive  KIC 
Probability 

Data  fusion  of  multiple  outputs  of  nonlinear  ARX 
and  Wiener-Hammerstein  models  is  done  by  assigning  a 
partieular  probability  to  eaeh  individual  model  [12]. 
First,  the  fusion  algorithm  is  applied  to  the  outputs  of 
different  nonlinear  ARX  and  Wiener-Hammerstein 
models  for  eaeh  sensor  obtained  using  different 
nonlinearity  estimators.  Seeond,  the  fusion  algorithm  is 
again  applied  to  the  final  fusion  based  outputs  of  eaeh 
sensor;  this  gives  good  foree  estimate.  SI  model  fit 
value  gives  the  probability  for  eaeh  model,  whieh  is 

1  —  *  100.  The  model  seleetion 

eriterion  used  in  this  paper  is  KIC.  The  sum  of  two 
direeted  divergenees,  whieh  is  the  measure  of  the 
models  dissimilarity,  is  known  as  Kullbaek’s  symmetrie 
or  J-divergenee  [13],  as  given  by  Equation  (8). 

+^(n),  (8) 

where  gin)  =  n  *  log(n/2). 

The  following  fusion  algorithm  as  given  by  [12]  is 
applied  for  data  fusion  of  the  outputs  of  different 
nonlinear  ARX  and  Wiener-Hammerstein  models: 

1)  Identify  models  M^,  using  sEMG  data 

(u)  as  input  and  foree  data  (T)  as  output,  for  k  number 
of  sensors  eolleeting  data  simultaneously. 

2)  Compute  the  residual  square  norm 

=  ||r- 0^0^11' =  ||r-f||,  where 


0; 

and 

r  y'^ 

i-p 

T 

Up 

T 

...  u[ 

o 

= 

Y^ 

^p+l 

T 

Ip 

T 

. 

Y^ 

T 

Un-± 

^n-2 

Un-p 

3)  Caleulate  the  model  eriteria  eoeffieient  using 
Equation  (8). 


4)  Compute  the  model  probability  p(Mj|Z)  = 


^J- 


-q-’ 

>  e  J 


where  I  is  model  seleetion  eriterion,  i.e.  KlCipi). 

5)  Compute  the  fused  model  output 

6)  Compute  the  overall  model  from  Yf  and  foree  data. 
Here  all  the  eomputation  from  step  2)  to  6)  is  adaptive 
i.e.  the  residual  square  norm,  KICipi),  model 
probability  p(Mj|Z),  and  fused  model  output  Yf  are 
being  updated  with  time  or  for  eaeh  data  point.  Fig.  6 


shows  the  flow  ehart  for  fusion  of  outputs  and  adaptive 
probability  of  KIC. 


Fig.  6:  Data  Fusion  and  Adaptive  KIC  Probability. 


5  Results,  Discussion  and  Future  Work 

This  seetion  deals  with  the  results,  diseussion  and 
future  work.  The  following  plots  show  the  nonlinear 
(ARX  and  Wiener-Hammerstein)  model  and  adaptive 
fusion  algorithm  based  estimated  foree  output  for  eaeh 
sensor  first  and  then  finally  eombined  adaptive  fusion 
based  output  for  all  three  sensors.  Fig.  7  shows  the 
overlapping  plot  of  the  original  and  adaptive  fusion 
based  foree  output  for  the  motor  point  sensor.  The 
output  is  the  result  of  the  adaptive  fusion  algorithm  on 
three  nonlinear  ARX  and  four  nonlinear  Wiener- 
Hammerstein  models  for  the  motor  point  sensor  signal. 


Origiml  Force  and  NL-ARX  -  NL-HW-2-3-4-5  Models  Fused  Output  -  Sensor  Motor  Point 


Fig.  7:  Original  and  Fusion  Based  Output  for  Motor 
Point  Sensor. 

Fig.  8  shows  the  overlapping  plot  of  the  original  and 
adaptive  fusion  based  foree  output  for  ringl  sensor.  The 


output  is  the  result  of  adaptive  fusion  algorithm  of  three 
nonlinear  ARX  and  four  nonlinear  Wiener-Hammerstein 
models  for  ringl  sensor  signal. 


Original  Force  and  NLARX  -  NL-HW  -  Models  Fused  Force  Output  -  Ringl  Sensor 


Fig.  8:  Original  and  Fusion  Based  Output  for  Ringl 
Sensor. 

Fig.  9  shows  the  overlapping  plot  of  the  original  and 
adaptive  fusion  based  foree  output  for  ring2  sensor.  The 
output  is  the  result  of  adaptive  fusion  algorithm  on  three 
nonlinear  ARX  and  five  nonlinear  Wiener-Hammerstein 
models  for  ring2  sensor  signal. 


Original  Force  and  NIrARX  -  NL-HW  Models  Fused  Output  -  Ring2  Sensor 


Fig.  9:  Original  and  Fusion  Based  Output  for  Ring2 
Sensor. 


Original  Force  and  NLARX  -  NLHW  Models  Output  -  MotorPoint  -  Ringl  -  Ring2  Sensors 


Time  x  lo*' 


Fig.  10:  Final  Plot  -  Original  and  Fusion  Based  Output 
for  All  Three  Sensors. 

Fig.  10  shows  the  overlapping  plot  of  the  original  and 
final  eombined  adaptive  fusion  based  foree  output  for 


motor  point,  ringl  and  ring2  sensors.  The  output  is  the 
result  of  adaptive  fusion  algorithm  on  the  final  outputs 
of  three  sensors  i.e.  motor  point,  ringl  and  ring2  as 
shown  in  Fig.  7  to  9.  Fig.  10  shows  the  best  skeletal 
musele  foree  estimate,  whieh  is  the  result  of  the  multi 
nonlinear  ARX  and  Wiener-Hammerstein  models  and  an 
adaptive  hybrid  data  fusion  on  these  nonlinear  models. 
Fig.  11  shows  the  error  plot  of  the  original  and  best- 
estimated  model  output  for  the  motor  point  sensor. 


Error  Plot  -  Original  and  Best  Model  Simulated  Output  for  Motor  Point  Sensor 


Time  x  10“ 

Fig.  11:  Error  Plot  -  Original  and  Best-Estimated  Model 
Output  for  Motor  Point  Sensor. 

Fig.  12  shows  the  error  plot  of  original  and  final 
multi  nonlinear  modeled  and  adaptive  hybrid  data  fusion 
based  foree  estimate  (results  from  three  sensors, 
nonlinear  modeling  and  adaptive  data  fusion  algorithm). 
If  we  eompare  Fig.  11  and  12,  it  is  very  elear  and 
eonspieuous  that  the  error  has  deereased  remarkably  and 
is  very  elose  to  zero. 


Final  Error  Plot  -  Original  and  Fused  Output  -  MotorPoint,  Ringl  and  Ring2  Sensors 


Fig.  12:  Final  Error  Plot  -  Original  and  Fusion  Based 
Output  for  Motor  Point,  Ringl  and  Ring2  Sensors. 

Future  work  will  foeus  on  the  improvement  of  the 
data  eolleetion  teehniques  and  experimental  set-up.  By 
using  the  eombination  of  linear  and  nonlinear  modeling, 
and  adaptive  hybrid  data  fusion,  the  skeletal  musele 
foree  estimate  ean  be  improved  further.  Furthermore,  the 
authors  believe  that  by  using  different  model  seleetion 
eriteria  sueh  as  Akaike  Information  Criterion  (AIC), 
Kullbaek  Information  Criterion  (KIC)  and  the  Bayesian 


Information  Criterion  (BIC)  together  to  obtain  final 
skeletal  musele  foree  estimate  will  give  improved 
results. 

6  Conclusion 

sEMG  and  foree  data  aequired  using  three  EMG  and 
one  eommon  FSR  foree  sensor  is  modeled  using 
nonlinear  SI.  Using  different  nonlinearity 
estimators/elasses,  multi  nonlinear  ARX  and  Wiener- 
Hammerstein  models  are  obtained  for  eaeh  sensor.  First, 
the  outputs  of  different  models  for  eaeh  sensor  are  fused 
with  a  data  fusion  algorithm  and  an  adaptive  KIC 
probability.  Finally,  the  fused  outputs  from  eaeh  sensor 
are  again  fused  with  same  algorithm  and  adaptive  KIC 
probability.  The  final  estimated  foree  using  this 
teehnique  gives  the  best  estimate. 
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Abstract  -  Position  and  force  control  are  two  critical  aspects 
of  a  prosthesis  control.  Surface  electromyographic  (sEMG) 
signals  can  be  used  for  skeletal  muscle  force  estimation.  In 
this  paper,  skeletal  muscle  is  considered  as  a  system  and 
System  Identification  (SI)  is  used  to  model  sEMG  and  skeletal 
muscle  force.  The  recorded  sEMG  signal  is  filtered  utilizing 
optimized  nonlinear  Half-Gaussian  Bayesian  filter,  and  a 
Chebyshev  type-II  filter  prepares  the  muscle  force  signal.  The 
filter  optimization  is  accomplished  using  Genetic  Algorithm 
(GA).  Multi  linear  and  nonlinear  models  are  obtained  with 
sEMG  as  input  and  skeletal  muscle  force  as  an  output.  The 
outputs  of  these  models  are  fused  with  a  probabilistic 
Kullback  Information  Criterion  (KIC)  for  model  selection 
and  an  adaptive  probability  of  KIC.  This  approach  gives  good 
estimate  of  the  skeletal  muscle  force. 


1.  Introduction 

United  States  had  1.7  million  peoples  with  amputation 
[1]  and  this  number  is  on  rise  after  the  Afghanistan  and 
Iraq  war  in  2003  [2].  Loss  of  upper  limb  results  in  the 
reduction  of  functionality  and  psychological  disturbance 
for  the  amputee  whereas  a  prosthetic  limb  can  benefit  the 
person  in  day-to-day  life. 
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Previous  research  works  [3-4]  mainly  based  on  the 
electromyography  (EMG)  signals  and  focus  on  the 
prosthetic  hand  design.  The  EMG  signal  recorded  at  the 
surface  of  the  limb  is  known  as  surface  EMG  (sEMG) 
which  is  an  electric  voltage  ranging  between  -5  and  +5 
mV.  sEMG  can  be  used  to  control  the  position  and  force  of 
the  prosthesis  [5-6].  Generally  EMG  signal  amplitude 
increases  with  an  increase  in  the  skeletal  muscle  force, 
however,  various  factors  affect  this  relationship.  Since 
varying  motor  unit  recruitments,  crosstalk,  and 
biochemical  interaction  within  the  muscular  fibres 
contributes  to  generate  EMG  signals,  so  EMG  signals  are 
random,  complex  and  dynamic  in  nature.  Furthermore,  the 
onset  and  progression  of  the  muscle  fatigue  results  in  the 
continuous  change  of  EMG  signal.  Together  all  of  these 
factors  make  the  relationship  between  EMG  and  force 
nonlinear.  Precise  control  of  the  prosthesis  is  critical,  so 
the  correct  interpretation  of  EMG  signal  is  important. 


Figure  1 :  The  Flow  Chart  of  the  Work  in  this  Paper. 


The  present  work  presents  a  novel  approach  to  estimate 
skeletal  muscle  force  using  an  adaptive  data  fusion 
algorithm  with  hybrid  multi  linear  and  nonlinear  models. 
The  Flow  Chart  of  the  work  in  this  paper  is  shown  in  figure 
1 .  The  recorded  sEMG  signals  are  filtered  utilizing 
optimized  nonlinear  Half-Gaussian  Bayesian  filter 
parameters,  and  the  skeletal  muscle  force  signal  is  filtered 
by  using  a  Chebyshev  type-II  filter.  A  simple  Genetic 
Algorithm  code  is  used  to  optimize  the  Bayesian  filter 
parameters.  Using  an  input/output  approach,  the  EMG 
signal  measured  at  the  skin  surface  is  considered  as  input 
to  the  skeletal  muscle,  whereas  the  resulting  hand/fmger 
force  constitutes  the  output.  Multi  linear  and  nonlinear 
models  are  obtained  using  system  identification  (SI)  for  the 
motor  point  signals  as  they  capture  the  dynamics  of  the 
system  differently.  The  outputs  of  estimated  linear  and 
nonlinear  models  are  fused  with  a  probabilistic  Kullback 
Information  Criterion  (KIC)  for  model  selection  and  an 
adaptive  probability  of  KIC.  First,  the  outputs  are  fused  for 
the  linear  models  and  then  for  nonlinear  models  and  finally 
the  resultant  outputs  of  linear  and  nonlinear  models  are 
fused  together.  The  final  fused  output  of  different  linear 
and  nonlinear  models  gives  good  skeletal  muscle  force 
estimates. 

II.  Experimental  set-up  and  pre-processing 

Data  acquisition  for  EMG  and  skeletal  muscle  force  is 
accomplished  using  Lab  VIEW™  8.2  simultaneously  at  a 
sampling  rate  of  2000  Hz.  DELSYS®  Bagnoli-16  EMG 
system  with  DE-2.1  differential  EMG  sensors  is  used  for 
sEMG  data  capturing.  However,  the  corresponding  force 
data  was  captured  using  NI  ELVIS  with  Interlink 
Electronics  FSR  0.5”  circular  force  sensor.  Figure  2 
explains  the  experimental  set-up.  One  sEMG  sensor  was 
placed  on  the  motor  point  of  ring  finger  and  two  adjacent 
to  the  motor  point  of  a  healthy  subject.  For  the  experiment, 
three  sEMG  sensors  were  used,  but  only  motor  point  signal 
is  used  for  this  research  work.  International  Society  of 
Electrophysiology  and  Kinesiology  (ISEK)  protocol  was 
followed  to  capture  the  sEMG  signals. 


Figure  2:  Experimental  Set-Up. 

To  model  the  sEMG  signal,  it  is  assumed  that  the 
conditional  probability  of  the  rectified  EMG  signal  is  a 
filtered  random  process  with  random  rate.  Fokker-Planck 
partial  differential  Equation  gives  the  likelihood  function 


for  the  rate  evolves  in  time  [7].  In  Fokker-Planck  partial 
differential  Equation  a  and  are  two  free  parameters,  a  is 
the  expected  rate  of  gradual  drift  in  the  signal,  and  is  the 
expected  rate  of  sudden  shifts  in  the  signal.  Optimization 
of  these  two  free  parameters  of  the  non-linear  “Half- 
Gaussian  filter  model”  of  sEMG  signal  is  achieved  using 
an  elitism  based  Genetic  Algorithm.  Skeletal  muscle  force 
signal  is  filtered  with  a  Chebyshev  type  II  low  pass  filter. 

III.  System  identification  -  linear  and  non¬ 

linear  MODELING 

System  Identification  (SI)  is  based  on  the  acquired 
experimental  data  and  is  an  alternative  to  physically  based 
mathematical  modeling  [8].  A  dynamical  model  such  as  the 
Auto  Regressive  with  exogenous  input  (ARX)  or  Output 
Error  (OE)  gives  the  system  in  mathematical  form  which  is 
the  outcome  of  parametric  system  identification  process.  In 
this  work,  the  SI  approach  is  used  with  the  myolelectric 
signal  as  the  input  to  the  system  and  as  the  output  is  the 
intended  fmger/hand  force.  In  this  work,  mutli  linear  and 
nonlinear  models  are  obtained  for  the  modeling  of  EMG 
and  hand/fmger  force  signals.  Six  linear  and  three 
nonlinear  models  are  obtained  for  the  motor  point  sEMG 
signal.  For  the  linear  models  Output  Error  model  of  order 
6,  ARX  model  of  order  6,  ARMAX  model  of  model  order 
5,  Box-Jenkins  model  of  order  18,  State-Space  model  with 
subspace  method  of  order  12  and  a  State-Space  model  with 
prediction  error/maximum  likelihood  method  of  order  12 
are  obtained  using  SI.  In  contrary  to  these  three  nonlinear 
models,  nonlinear  ARX  with  nonlinearity  estimator  as 
‘sigmoidnef  and  nonlinear  Wiener-Hammerstein  models 
with  nonlinearity  estimators  as  ‘piecewise  linear  - 
pwlinear’  and  ‘saturation’  are  obtained. 


Table  3:  Linear  Models  Used  and  Their  Structures. 


Linear  Model 
Name 

Linear  Model  Structure 

Output  Error 

B(q) 

y(t)  =  u(t  nk)  +  e(t) 

ARX 

A{ci)y(t)  =  E(q)u(t  -  rifc) 

+  e(t) 

ARMAX 

A(.q)y(t)  =  B(,q)u(t  -  71^) 

+  C(q)e(t) 

Box-Jenkins 

B(q) 

nk) 

C(q) 

State- Space  - 
subspace  method 

x(t  +  Ts)  =  Ax(t)  +  Bu(t) 

+  Ke(t) 

y(t)  =  Cx(t)  +  Du(t)  +  e(t) 

State- Space  - 
prediction 
error/maximum 
likelihood  method 

x(t  +  Ts)  =  Ax(t)  +  Bu(t) 

+  Ke(t) 

y(t)  =  Cx(t)  +  Du(t)  +  e(t) 

For  Output  Error  (OE),  Auto  Regressive  exogenous 
(ARX),  Autoregressive  moving  average  model  with 
exogenous  inputs  (ARMAX),  and  Box-Jenkins  (BJ) 
models:-  y  is  output,  t  is  time,  B{q),  F(q),  A{q),  C(q), 
D(q),  are  polynomials,  q  is  a  backward  shift  operator,  u  is 
input,  nk  and  rij^  is  delay  and  e  is  error  [9]. 

For  State-Space  models:-  x  is  state,  t  is  time,  Ts  is 
sampling  time,  u  is  input,  e  is  error.  A,  B,  K,  C,  and  D  are 
system  matrices,  and  y  is  output  [9]. 


Table  4:  Nonlinear  Models  Used  and  Their  Structures. 


Nonlinear  Model 
Name 

Nonlinear  Model 
Structure 

Nonlinear  ARX  - 
Sigmoidnet 

yp(0  =  f(y(t  - 
l),y(t-2),y(t- 
3),  —  l),u(t  - 

2),...); 

f(z)  =  IS  sigmoid 

function. 

Nonlinear  HW  - 
Piecewise  Linear  - 

pwlinear 

w(0  =  /(u(t)), 

y(0  =  /i(x(t)); 

/  and  h  are  piecewise- 
linear  nonlinear  estimators. 

Nonlinear  HW  - 
Saturation 

w(t)  = 

xit)  = 

FjiiQ) 

y(t)  =  /i(x(t)); 

/  and  h  are  nonlinear 
functions  which  stores  the 
saturation  nonlinearity 
estimators  to  parameterize 
the  hard  limits  on  the  signal 
value  as  upper  and  lower 
saturation  limits. 

Where  /  is  a  nonlinear  function  in  nonlinear  ARX 
model.  Inputs  to  /  are  model  regressors.  yp(t)  is  the 
predicted  output  as  a  weighted  sum  of  past  output  values 
and  current  and  past  input  values.  For  nonlinear 
Hammerstein- Wiener  model  u(t)  and  y(t)  are  the  inputs 
and  outputs  for  the  system,  respectively.  /  and  h  are 
nonlinear  functions  that  corresponds  to  the  input  and 
output  nonlinearity,  respectively.  w(t)  and  x(t)  are 
internal  variables.  w(t)  has  the  same  dimension  as  u(t). 
x(t)  has  the  same  dimension  as  y(t).  B(q)  and  F(q)  in  the 
linear  dynamic  block  are  polynomials  in  the  backward  shift 
operator.  If  only  the  input  nonlinearity  is  present,  the 
model  is  called  the  Hammerstein  model.  If  only  the  output 
nonlinearity  is  present,  the  model  is  called  the  Wiener 
model  [9]. 


IV.  Fusion  of  outputs  and  adaptive  probability 

OFKIC 

According  to  [10]  the  outputs  of  multiple  models  can 
be  fused  by  assigning  a  particular  probability  to  each 
individual  model.  In  this  work,  we  are  obtaining  multi 
linear  and  nonlinear  models  using  SI  for  the  sEMG  sensor 
for  the  motor  unit.  The  probability  of  each  model  is 
computed  using  the  SI  model  fit  value.  Model  fit  value  is 

[|r-f  n 

1  —  *  100.  Kullback  information  criterion 

(KIC)  that  is  an  asymmetric  measure  for  the  model 
selection  is  used  for  this  research.  Kullback’s  symmetric  or 
J-divergence  is  the  sum  of  two  directed  divergences,  which 
is  the  measure  of  the  models  dissimilarity  is  given  by 
Equation  (1)  [11]. 

=  flogfi; +5(n),  (1) 

where  g(n)  =  n  *  log  (nl2). 

Based  on  [10],  following  fusion  technique  is  applied  for 
sEMG  -  force  identification  models. 

1)  Identify  OE  models  M^,  M2,  using  sEMG  data 

(u)  as  input  and  force  data  (Y)  as  output,  for  kl  number  of 
sensors  collecting  data  simultaneously. 

2)  Compute  the  residual  square  norm 

=  ||y-cl>,0;||'  =  \\Y-Y\\\ 
where  0^  =  and 
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3)  Calculate  the  model  criteria  coefficient  using  Equation 

(3). 

e-h 

4)  Compute  the  model  probability  p(Mi\Z)  =  — — 

where  I  is  model  selection  criterion,  i.e.  KIC(pi). 

5)  Compute  the  fused  model  output  Yf  = 

6)  Compute  the  overall  OE  model  from  Y^  and  force  data. 

In  the  above  steps  all  the  computation  from  step  2)  to  step 
6)  is  adaptive  i.e.  the  residual  square  norm,  KIC(pi), 
model  probability  p(Mj|Z),  and  fused  model  output  Y^  are 
being  updated  with  time  or  for  each  data  point. 

V.  Results,  conclusion  and  future  work 

In  this  section  results,  discussion  and  future  work  are 
discussed.  Adaptive  KIC  probability  based  data  fusion 
algorithm  is  applied  to  linear  and  nonlinear  models 
separately  and  then  combined.  Figure  3  and  4  show  the 
results  for  the  linear  and  nonlinear  models  respectively. 
Finally,  both  linear  and  nonlinear  models  are  used 
combined  and  adaptive  KIC  probability  based  data  fusion 
algorithm  is  applied  to  obtain  the  final  output  that  is  given 
by  figure  5.  Validation  of  this  technique  is  confirmed  with 
a  separate  data  set.  Figure  6  depicts  the  validation  of  the 
proposed  technique. 


KIC  Adaptive  Probability  -  Data  Fusion  Based  Foree- Linear  Models  and  Chebyshev  Filtered  Foree  Signal 
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Figure  3:  For  Linear  Models:  KIC  Adaptive  Probability 
Data  Fusion  Based  Force  Vs.  Chebyshev  Type  II  Filtered 
Force. 


KIC  Adaptive  Probability  -  Data  Fusion  Based  Force -NL  Models  and  Chebyshev  Filtered  Force  Signal 


Figure  4:  For  Nonlinear  Models:  KIC  Adaptive  Probability 
Data  Fusion  Based  Force  Vs.  Chebyshev  Type  II  Filtered 
Force. 


Time  (60.32  Seconds  Data) 


Figure  5:  For  Linear  and  Nonlinear  Models  Combined: 
KIC  Adaptive  Probability  Data  Fusion  Based  Force  Vs. 
Chebyshev  Type  II  Filtered  Force. 


Future  work  will  focus  on  the  improved  data  collection 
techniques,  use  of  spatial  filters  for  sEMG  signals 
filtration,  and  use  of  multi  sensor  data  with  this  technique. 
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Abstract — Precise  and  effective  prosthetic  control  is  important  for 
its  applicability.  Two  desired  objectives  of  the  prosthetic  control 
are  finger  position  and  force  control.  Variation  in  skeletal  muscle 
force  results  in  corresponding  change  of  surface 
electromyographic  (sEMG)  signals.  sEMG  signals  generated  by 
skeletal  muscles  are  temporal  and  spatially  distributed  that  result 
in  cross  talk  between  adjacent  sEMG  signal  sensors.  To  address 
this  issue,  an  array  of  nine  sEMG  sensors  is  used  with  a  force 
sensing  resistor  to  capture  muscle  dynamics  in  terms  of  sEMG 
and  skeletal  muscle  force.  sEMG  and  skeletal  muscle  force  are 
filtered  with  a  nonlinear  Teager-Kaiser  Energy  (TKE)  operator 
based  nonlinear  spatial  filter  and  Chebyshev  type-II  filter 
respectively.  Multiple  Takagi-Sugeno-Kang  Adaptive  Neuro 
Fuzzy  Inference  Systems  (ANFIS)  are  obtained  using  sEMG  as 
input  and  skeletal  muscle  force  as  output.  Outputs  of  these 
ANFIS  systems  are  fitted  with  smoothing  spline  curve  fitting.  To 
achieve  better  estimate  of  the  skeletal  muscle  force,  an  adaptive 
probabilistic  Kullback  Information  Criterion  (KIC)  for  model 
selection  based  data  fusion  algorithm  is  applied  to  the  smoothing 
spline  curve  fitting  outputs.  Final  fusion  based  output  of  this 
approach  results  in  improved  skeletal  muscle  force  estimates. 

Keywords  -  sEMG;  TKE;  ANFIS;  KIC 

I.  Introduction 

In  the  United  States,  1.6  million  people  lived  with 
amputations  during  2005  [1].  This  increase  reflects  on  the  war 
effects  in  Afghanistan  and  Iraq  since  2003  [2].  During  the 
same  period  of  time,  the  fields  of  prosthetic  design  and 
development  research  for  prosthesis  has  received  increased 
attention.  Precise  and  timely  control  of  prosthesis  is  critical  for 
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its  applicability,  which  necessitates  the  replacement  of 
conventional  algorithms  by  intelligent  systems  and  decision 
methods.  Therefore,  a  natural  means  of  interface  between  the 
user  and  prosthesis  is  required.  sEMG  signals  from  skeletal 
muscles  are  a  convenient  means  for  users  who  do  not  want  to 
deal  with  additional  surgeries  and  regular  hygiene  problems. 
sEMG  signals  are  simply  electric  voltages  ranging  between  -5 
and  +5  [mV]  which  can  be  recorded  on  the  skin  surface  of  a 
hand  amputee’s  forearm.  Skeletal  muscles  generate  a  base 
sEMG  even  without  a  limb  movement  which  changes  with 
different  movements  and  applied  forces.  This  makes  sEMG 
signals  useful  for  position  and  force  control  of  prosthesis. 
Presently  available  prosthetic  hands  have  no  tactile  or 
proprioceptive  feedback  for  grasping  and  only  user’s  direct 
vision  as  a  sensory  feedback  is  available  for  its  position 
control.  Afore  mentioned  reasons  cause  30-50%  of  the  upper 
extremity  amputees  to  choose  not  to  use  their  prosthetic  hand 
on  a  regular  bases  [3-4]. 

Effective  grasping  of  any  object  requires  the  knowledge  of 
force  and  its  feedback.  Since  the  hand  amputee  uses  only 
sEMG  signals  collected  from  skeletal  muscles,  there  is  no 
hand  force  information  directly  available.  sEMG  is  a  measure 
of  the  nervous  excitation  that  ultimately  is  responsible  for 
activating  the  skeletal  muscles,  which  in  turn  generate  the 
finger  forces  with  the  help  of  the  link  kinematics  of  human 
hand.  Therefore,  a  model  or  estimation  scheme  is  needed  for 
the  dynamic  estimation  of  skeletal  muscle  force  from  sEMG 
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signals.  There  have  been  numerous  efforts  in  this  direction  and 
some  of  the  recent  are  evident  in  the  research  work  of  [5-10]. 

The  present  work  proposes  a  novel  scheme  of  skeletal 
muscle  force  identification  using  sEMG  signals.  An  array  of 
nine  sEMG  sensors  is  used  to  record  sEMG  signals  and 
skeletal  muscle  force  signals  recorded  with  a  force  sensing 
resistor  from  the  arm  of  a  healthy  subject,  which  respectively 
is  explained  in  detail  in  Section  II  and  III.  Eight  Takagi- 
Sugeno-Kang  ANFIS  with  different  membership  functions 
each  with  a  rule  base  of  ten  are  designed.  The  training  of  each 
ANFIS  is  done  using  a  hybrid  optimization  method  with  zero 
error  tolerance  and  40  epochs.  Each  of  the  force  signals 
simulated  using  these  ANFIS  and  measured  force  signals  are 
applied  to  a  smoothing  spline  curve  fitting  method.  Figure  1 
shows  the  flow  chart  of  the  proposed  approach.  Final 
estimated  force  signal  shows  good  match  with  the  measured 
signal.  This  approach  is  tested  on  two  different  data  sets  of  45 
and  60  seconds  duration  and  the  results  seem  promising.  The 
paper  is  organized  in  eight  sections.  Present  section  follows 
the  experimental  set-up  and  then  signal  processing,  ANFIS 
modeling,  smoothing  spline  curve  fitting,  data  fusion,  results 
and  discussion  and  conclusion  and  future  work  is  presented 
respectively. 


\/ 


II.  Experimental  Set-Up 

Based  on  the  set-up  of  a  sEMG  sensor  array  in  [II],  an 
experiment  set-up  was  developed  using  DELSYS®  Bagnoli- 
16  EMG  system  with  nine  DE-3.1  sEMG  sensors  to  capture 
sEMG  signals  from  skeletal  muscles.  Here,  the  array  involves 
nine  sensors  covering  four  directional  spatial  distributions  of 
the  sEMG  signal.  The  middle  three  sEMG  sensors  were 
attached  directly  on  the  skin  surface  above  the  motor  point  of 
the  flexor  digitorum  superficialis  muscle  (FDS)  which  controls 
the  flexion  of  the  ring  finger.  Appropriate  sEMG  electrode 
attachment  point  for  the  flexion  of  the  ring  finger  was 
identified  using  a  wet  probe  muscle  stimulator  at  the  FDS 
(RICH-MAR,  HV  1000). 

Prior  to  placing  the  sEMG  sensors,  the  skin  surface  of  the 
subject  was  prepared  according  to  International  Society  of 
Electrophysiology  and  Kinesiology  (ISEK)  protocols.  The 
thumb  movement  was  restricted  in  this  experiment  using  a 
thumb  splint.  However,  the  corresponding  force  data  was 
captured  using  NI  ELVIS™  with  Interlink™  Electronics  FSR 
0.5”  circular  force  sensor.  Experimental  set-up  is  shown  in 
Figure  2,  where  9  sensors  are  shown  on  a  healthy  subject 
forearm,  holding  a  stress  ball  for  force  measurements.  The 
sEMG  and  finger  force  data  was  collected  at  a  sampling  rate 
of  2000  Hz  using  Lab  VIEW™  in  conjunction  with  DELSYS® 
Bagnoli-16  EMG  and  NI  ELVIS™.  With  this  experimental 
set-up  we  conducted  several  experiments  of  30  seconds,  45 
seconds  and  60  seconds  durations. 


Figure  2.  Experiment  set-up. 

III.  Signal  Processing 

The  recorded  sEMG  signal  is  filtered  using  nonlinear 
spatial  filtering  for  multichannel  surface  EMG.  As  given  in 
[12],  this  nonlinear  spatial  filter  is  derived  from  “Nonlinear 
Teager-Kaiser  Energy  (TKE)  Operator.”  As  given  in  [11],  the 


Figure  1 .  Flow  ehart  of  the  approaeh  used  in  this  researeh  work. 


933 


IV.  Anfis  Modeling 


TKE  operator  in  the  time  domain  on  sEMG  signal  is  defined 
by  Equation  (1). 

¥[x(n)]  =  x^(n)  -  x(n  +  1)  *  x(n  -  1).  (1) 

Here,  ¥  is  the  TKE  operator  and  x(ri)  is  the  time  domain 
sEMG  signal.  Based  on  the  TKE  operator,  the  four¬ 
dimensional  nonlinear  spatial  filter  is  given  by  Equation  (2). 

¥^  4[x(m,n)]  =  4  *  x^(jn,n)  —  x(jn  -  l,n)  *  x(jn  +  l,n)  - 
X(m,  72  -  1)  *  X(jn,  72  +  1)  -  X(m  -  1,  72  +  1)  *  X(m  +  1,  72  - 
1)  -  x(m  -  1, 72  -  1)  *  x{m  +  1, 72  +  1).  (2) 

Figure  3  shows  a  comparison  between  the  measured  and 
nonlinear  spatial  filtered  sEMG  signals. 

A  Chebyshev  type  II  infinite  impulse  response  (HR)  low 
pass  filter  with  a  550  Hz  pass  band  frequency  is  used  to  filter 
the  skeletal  muscle  force  signal.  Figure  4  shows  the  comparison 
between  the  measured  and  Chebyshev  type  II  filtered  skeletal 
muscle  force  signal. 


Figure  3.  sEMG  signal  from  ring  finger. 


Measured  Skeletal  Musele  Foree  Signal  ■  Without  Filteration 


1  2  3  4  5  6  7  8  9 


Figure  4.  Skeletal  musele  foree  signal  from  ring  finger. 


In  1965  professor  Lofti  A.  Zadeh  introduced  the  concept  of 
''Fuzzy  Sets'\  which  are  sets  with  imprecise  amplitudes  [12]. 
Dr.  Zadeh  stated  that  the  "membership''  in  a  fuzzy  set  is  a 
matter  of  degree  and  not  a  matter  of  affirmation  or  denial.  For 
last  four  decades,  this  proposal  has  gained  recognition  as  an 
important  point  in  the  evolution  of  modern  concept  of 
imprecision  and  uncertainty  [12].  This  innovation  represents  a 
paradigm  shift  from  the  classical  sets  or  the  crisp  sets  to 
"Fuzzy  Sets"  [12]. 

Fuzzy  set  and  fuzzy  logic  theory  can  be  used  to  capture  the 
natural  phenomenon  of  the  imprecision  and  uncertainty  [12]. 
The  membership  function  is  the  characteristic  of  fuzzy  set, 
which  is  a  function  whose  range  is  an  ordered  membership  set 
within  the  closed  unit  interval  [12]. 

A  crisp  set  which  is  a  collection  of  distinct  objects  is 
defined  in  a  way  to  partition  objects  in  a  given  domain  of 
discourse  into  two  groups:  members  and  non-members  [12]. 
On  the  other  hand,  a  fuzzy  set  can  be  formed  by  assigning  a 
membership  value  (which  represents  the  degree  to  which  an 
object  belongs  to  a  fuzzy  set)  to  each  object  in  the  interval  of  0 
to  1  [12].  Fuzzy  membership  functions  can  be  of  different 
forms  such  as  triangular,  trapezoidal,  pi,  bell  and  Gaussian 
form. 

Fuzzy  Inferance  System  (FIS)  in  fuzzy  logic  can  be  used  to 
model  a  system  which  is  an  inference  system  based  on 
empirical  knowledge  based  linguistic  rules  [13].  The  fuzzy 
inference  system  is  composed  of  five  steps:  fuzzification  of 
the  input  variables,  application  of  the  fuzzy  operator  (AND  or 
OR)  in  the  precedent,  implication  from  the  precedent  to  the 
subsequent,  aggregation  of  the  subsequents  across  the  rules, 
and  defuzzification.  In  the  fuzzification  process,  the 
membership  values  coming  from  quantitative  measurements 
are  converted  to  linguistic  values  based  on  the  membership 
functions  [13]. 


0  1  2  3  4  5 


inpyt  variable  "if! pil" 

Figure  5.  Gaussian  membership  funetions  for  sEMG. 
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Figure  5  shows  the  plot  of  Gaussian  membership  functions 
for  fuzzification  of  sEMG.  The  process  of  fuzzification 
followed  by  IF  ..  AND..  THEN  ..OR  ELSE  type  control  or 
relation/estimation  rules  [13].  The  output  of  the  rules  is 
computed  as  a  max-min  composition  [13].  In  the 
defuzzification  process,  the  output  of  the  rules  has  to  be 
converted  to  a  crisp  value  [13]. 


inputi  =  0 


output  =  4.38 


Figure  6.  Illustration  of  ANFIS  inference  mechanism. 
TABLE  I.  Membership  Functions 


S.  No. 

Membership  Function 

1. 

Gaussian  (GAUSSMF) 

2. 

Gaussian  combination  (GAUSS2MF) 

3. 

Difference  between  two  sigmoidal  membership  funetions 
(DSIMF) 

4. 

Generalized  bell-shaped  (GBELLMF) 

5. 

n-shaped  (PIMF) 

6. 

Produet  of  two  sigmoidally  shaped  membership  funetions 
(PSIMF) 

7. 

Trapezoidal-shaped  (TRAPMF) 

8. 

Triangular-shaped  (TRIMF) 

Using  eight  different  membership  functions  types  we 
designed  eight  single-output  Sugeno-type  adaptive  neuro- 
flizzy  inference  systems  (ANFIS)  using  a  grid  partition  on  the 
data.  The  output  membership  function  in  each  of  these  is 
linear.  Each  ANFIS  has  ten  rules  and  connection  type  is  ‘And’ 
with  a  weight  of  1.  For  the  ‘And’  method  ‘product’  and  for 
‘Or’  method  ‘probabilistic’  types  are  used  for  each  ANFIS. 
Deffuzification  is  achieved  using  weighted  average  (wtaver) 
from  each  rule.  Figure  6  shows  the  rules  for  ANFIS  with 
Gaussian  membership  functions  and  illustrate  the  ANFIS 
inference  mechanism.  The  membership  functions  used  are 
tabulated  in  Table  1. 


-(x-c)^ 

A  Gaussian  function  is  given  by  /(x;  (7,c)  =  e  2^2 
some  real  constants  c  and  cr  >  0,  and  e  =  2.718.  Gaussian 
combination  membership  function  (GAUSS2MF)  depends  on 
the  c  and  a  parameters  [14].  The  sigmoidal  membership 
function  is  given  as  /(x;  a,  c)  =  depends  on  the 

two  parameters  a  and  c  .  The  difference  between  two 
sigmoidal  membership  function  (DSIMF)  which  is  the 
difference  between  two  sigmoidal  functions  depends  on  the 
four  parameters  ai,Ci,a2,  and  C2  [14].  Generalized  bell¬ 
shaped  membership  function  (GBELLMF)  is  given  as 

/(x;  a,  b,  c)  = - and  depends  on  three  parameters  a,  b, 

1+1— I 

I  a  \ 

and  c  where  parameter  a  and  b  decide  the  width  of  the  curve 
and  parameter  c  locates  the  center,  usually  h  >  0  [14].  Pi- 
shaped  membership  function  (PIMF)  is  given  by 


/(x;  a,  b,  c,  d) 


0, 

X  <  a 

a+h 

a  <  X  <  — 
2 

'  —  <  X  <  b 

2 

1, 

b  <  X  <  c 

1-2  , 

c+d 

,  C  <  X  <  -— 

\d-cJ  ‘ 

’  2 

cTd  _ ,  _ ,  j 

—  <x<d 
2 

\d-cJ 

0, 

X  >  d 

and 


evaluated  at  the  points  given  by  vector  x.  The  “feet”  of  the 
curve  is  determined  by  parameters  a  and  d  whereas 
parameters  b  and  c  decides  its  “shoulders”  [14].  The  Product 
of  two  sigmoidally  shaped  membership  functions  (PSIMF)  is 
simply  the  products  of  two  sigmoidal  functions  as  given 
before.  The  trapezoidal  shaped  membership  function 
(TRAPMF)  is  given  by 


/(x;  a,  b,  c,  d) 


^  0, 
x-a 

b-a' 

1, 

d-x 


\( 


0, 


X  <  a 
a  <  X  <  b 


\ 


b  <  X  <  c 
c  <  X  <  d 
d  <  X  / 


which  depends  on 


four  scalar  parameters  a,  b,  c,  and  d .  The  triangular  shaped 
membership  function  (TRIMF)  is  given  by 


935 


/  0,  X  <  a  \ 

x-a  .  .  ,  ' 

— ,  a  <  X  <  b 
b-a 

b<x<c 

c-b 

\  0,  c 

scalar  parameters  a,  b  and 


f(x-,  a,  b,  c)  = 


i  A  C 

:  <  X  j 


which  depends  on  the 


small.  In  this  work  the  smoothing  parameter  p  is  chosen  as 
0.92  [15].  Figure  7  shows  the  analysis  results  for  smoothing 
spline  curve  fitting  to  the  output  of  ANFIS  with  Gaussian 
membership  function. 


VI.  Data  Fusion 


V.  Smoothing  Spline  Curve  Fitting 

MATLAB®  Curve  Fitting  Toolbox™  is  a  useful  tool  for 
fitting  curves  and  surfaces  to  acquired  data  [15].  It  can  be  used 
to  do  exploratory  data  analysis,  preprocessing  and  post¬ 
processing  of  the  data,  comparing  candidate  models,  and  for 
removing  outliers  [15].  Weights  for  each  smoothing  spline 
curve  fit  are  calculated  by  subtracting  the  ANFIS  output  from 
the  measured  skeletal  muscle  force  output.  A  graphical  user 
interface  is  used  to  fit  the  smoothing  spline  curve  to  each 
output  from  eight  ANFIS  with  respective  weights.  Smoothing 
spline  which  is  a  piecewise  polynomial  computed  from  a 
smoothing  parameter  (p)  of  0.92  is  fitted  to  each  of  eight 
outputs  of  ANFIS.  Smoothing  parameter  (p)  is  a  number 
between  0  and  I .  Change  in  the  value  of  p  from  0  to  1  results 
in  the  change  in  smoothing  spline.  For  p  =  0  the  smoothing 
spline  is  a  least-square  straight-line  approximation  to  the  data 
whereas  for  p  =  1  it  gives  the  "natural"  cubic  spline 
interpolant  to  the  data  [15]. 


Analysis  of  fit  "fit  1 "  for  dataset  "a_e_40GAUSS2MF  with  wtl_2GA40" 


Figure  7.  Analysis  results  for  smoothing  spline  eurve  fitting  to  the  output  of 
ANFIS  with  Gaussian  membership  funetion. 

For  the  specified  weight  (Wj)  and  smoothing  parameter  (p) 
a  smoothing  spline  5  is  formed  which  minimizes  the 
parameter  ]  given  by  Equation  (3). 

/  =  p'ZiWiiyi  -  s(Xi)y  +  il-p)Ji^ydx,  (3) 

where  Xi  and  are  predictor  and  response  data  respectively. 
The  smoothing  parameter  p  should  be  chosen  to  make  the 

error  E(s)  = 'ZiWiiyi  —  s(xi)y  and  roughness  J  (— 


Data  fusion  of  multiple  outputs  of  smoothing  spline  curve 
fittings  is  done  by  assigning  a  particular  probability  to  each 
individual  output  [16].  This  method  gives  good  estimation  of 
the  skeletal  muscle  force.  The  goodness  of  the  fit  of  each 
smoothing  spline  output  can  be  measured  using  System 
Identification  (SI)  model  fit  value  which  is  given  by  Equation 

(4). 

FIT  =  [1  -  |T  -  f  \/\Y  -  F  I  ]  *  100  (4) 

In  Equation  (4)  Y  is  measured,  F  is  estimated  and  F  is 
mean  output  signal.  The  model  selection  criterion  used  in  this 
paper  is  Kullback  Information  Criterion  (KIC)  which  has 
shown  to  perform  well  for  sEMG  sensor  data  fusion  [7-10]. 
The  sum  of  two  directed  divergences,  which  is  the  measure  of 
the  models  dissimilarity,  is  known  as  Kullback’ s  symmetric  or 
J-divergence  [17],  as  given  by  Equation  (5). 

KIC(Pi)=^logRi  +  ^^^^-n^p^^)+g(n),  (5) 

where  g(ji)  =  n  *  login fT). 

The  fusion  algorithm  as  given  by  [16]  is  applied  for  data 
fusion  of  the  outputs  of  eight  smoothing  spline  curve  fit 
outputs  which  are  obtained  from  eight  different  ANFIS 
models: 

(I)  Find  smoothing  spline  curve  fit  outputs  M2, for 
k  number  of  outputs. 

(II)  Compute  the  residual  square  norm 

=  11^-0;  QiW^  =  \\Y-Y  \\\ 
where  0^  =  and 


r  Y'^ 
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Up 

^p-i 
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...  ui 

0  = 

^p+i 
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Up+1 
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Ip 
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y'^ 

L^n-1 
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K-1 

^n-2 
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■  <-p 

(III)  Calculate  the  model  criteria  coefficient  using  Equation 
(5). 

e-h 

(IV)  Compute  the  model  probability  p(Mi|Z)  =  — zr,  where 

I  is  model  selection  criterion,  i.e.  KlCipi). 

(V)  Compute  the  fused  model  output  Yf  =  YJth  p(Mi|Z)Yi. 

(VI)  Compute  the  overall  model  from  Yf  and  skeletal  muscle 
force  data. 

Here  all  the  computation  from  step  (II)  to  (VI)  is  adaptive 
i.e.  the  residual  square  norm,  KlC(Pi)  ,  model  probability 
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p(Mi|Z),  and  fused  model  output  Yf  are  being  updated  with 
time  or  for  each  data  point.  Figure  8  shows  the  flow  chart  for 
fusion  of  outputs  and  adaptive  probability  of  KIC. 


Figure  8.  Flow  chart  for  fusion  of  outputs  and  adaptive  probability. 

VIL  Results  and  Discussion 

The  proposed  method  gives  good  estimation  of  the  skeletal 
muscle  force.  A  data  set  of  45  seconds  is  used  to  estimate  the 
output.  Figure  9  shows  the  measured  and  estimated  skeletal 
muscle  force  using  this  method. 


ANFIS  -  CURVE  FITTING  -  DATA  FUSION  OUTPUT 


Figure  9.  Plot  of  measured  and  proposed  method  estimated  skeletal  muscle 

force. 


Figures  10  and  11  are  the  validation  plots  for  45  seconds 
and  60  seconds  of  data  sets  respectively.  All  of  these  three 
plots  show  a  very  close  follow  up  of  the  measured  signal  by 
the  estimated  signal  using  this  approach.  Figure  12  shows  the 
percentage  error  between  the  measured  force  signal  and 
estimated  finger  force  signal  for  45  seconds  of  data  set.  The 
percentage  error  reduced  to  the  lower  values  and  the 
maximum  percentage  error  value  is  1.7  percent.  The  mean  fit 
value  between  the  measured  and  estimated  output  is  91.3 
percent. 


Validation  Plot  1  -  ANFIS  -  CURVE  FITTING  -  DATA  FUSION 


Figure  10.  Validation  plot  1  using  different  data  set. 
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Figure  1 1 .  Validation  plot  2  using  different  data  set. 
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Figure  13  shows  the  percentage  error  plot  for  different  data 
set  of  60  seconds  duration.  Percentage  error  reduced  to  lower 
values  and  the  maximum  percentage  error  value  is  3.7  percent. 
The  mean  fit  value  between  the  measured  and  estimated 
output  is  40  percent.  The  mean  fit  value  for  another  45 
seconds  of  data  set  is  73  percent. 


Percentage  Error  -  Validation  2  Data 


Time 

Figure  13.  Percentage  error  plot  for  60  seconds  data  set. 


VIII.  CONCEUSION  AND  FUTURE  WORK 

Using  sEMG  and  skeletal  muscle  force  as  input  and  output 
data,  eight  ANFIS  were  designed  and  tested.  Output  of  these 
ANFIS  were  fitted  with  smoothing  spline  curve  fit  and 
resultant  outputs  were  fused  using  a  KIC  based  data  fusion 
algorithm.  This  approach  has  been  validated  using  two 
separate  data  sets.  Results  are  promising  and  show  good 
estimation  of  skeletal  muscle  force  which  can  be  applied  to 
design,  application  and  improvement  of  prosthetic  hands  for 
amputees. 

Future  work  will  address  the  improvement  of  data 
collection  techniques,  sEMG  sensor  design,  use  of  this 
approach  for  finger  angles  and  stiffness  estimation  from 
sEMG  signals.  Different  modeling  techniques  with  this 
approach  and  combined  probability  of  different  model 
selection  criteria  such  as  Akaike  Information  Criterion  (AIC), 
Kullback  Information  Criterion  (KIC)  and  the  Bayesian 
Information  Criterion  (BIC)  together  will  give  improved 
results. 
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Abstract — This  paper  presents  surface  electromyographic 
(sEMG)-based,  real-time  Model  Reference  Adaptive  Control 
(MRAC)  strategy  for  a  prosthetic  hand  prototype.  The 
proposed  design  is  capable  of  decoding  the  prerecorded 
surface  electromyographic  (sEMG)  signal  as  well  as  the 
sensory  force  feedback  from  the  sensors  to  control  the  force 
of  the  prosthetic  hand  prototype  using  a  PIC 
32MX360P512L  microcontroller.  The  input  sEMG  signal  is 
preprocessed  using  a  Half-Gaussian  filter  and  fed  to  a  fusion 
based  Multiple  Input  Single  Output  (MISO)  skeletal  muscle 
force  model.  This  MISO  system  provides  the  estimated 
finger  forces  to  be  produced  as  input  to  the  prosthetic  hand 
prototype.  A  simple  MRAC  method  along  with  a  two  stage 
embedded  design  is  used  for  the  force  control  of  the 
prosthetic  hand.  The  sensed  force  at  the  fingertip  is  fed  back 
to  the  controller  for  real-time  operation.  The  data  is 
transmitted  to  the  computer  through  the  universal 
asynchronous  receiver/transmitter  (UART)  interface  of  the 
proposed  embedded  design.  Results  show  good  performance 
in  controlling  the  finger  force  as  well  as  shortcomings  of  the 
mechanical  design  of  the  prosthetic  hand  prototype  to  be 
addressed  in  future. 

I.  INTRODUCTION 


In  the  United  States,  the  number  of  people  with  missing 
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limbs  because  of  combat  and  non-combat  operations  is  over 
1.2  million  [1].  The  number  of  amputees  has  substantially 
increased  due  to  the  recent  wars  in  Afghanistan  and  Iraq.  To 
date,  there  has  been  active  research  to  design  a  prosthetic 
hand;  however,  even  today,  there  are  no  prosthetic  devices 
available  at  an  affordable  cost  and  with  tactile  or 
proprioceptive  feedback  for  grasping  [2].  In  nonindustrial 
robotics,  ‘rehabilitation  robotics’  is  an  active  research  area 
for  the  last  two  decades.  Rehabilitation  robotics  is  human- 
centered  and  addresses  a  different  set  of  requirements  such 
as  mechanical  compliance,  flexibility,  adaptability  towards 
the  user,  gentleness,  safety  and,  last  but  not  least,  humanoid 
appearance  and  behavior  [3].  Past  researches  stipulate  that 
human-centered  robots  must  be  autonomous  with  a  high 
level  of  functionality,  pleasure,  comfort  and  ease  of  use  [4]. 
One  interesting  domain  of  rehabilitation  robotics  is  human- 
machine  interface.  Human-centered  robotics  requires  a 
natural  means  of  communication  [5],  and  in  the  case  of 
electromyographic  (EMG)  based  prosthesis  one  natural 
means  of  interface  between  the  human  arm  and  prosthesis  is 
sEMG  itself.  The  sEMG  signals  are  electrical  voltages 
ranging  from  -5  to  -h5  (mV).  sEMG  signals  are  always 
available  and  their  strength  and  variability  depends  on 
different  movements  and  force  levels.  sEMG  signals  can  be 
acquired  using  suitable  sensors  and  can  be  used  as  an  input 
to  the  controller  of  the  hand  prosthesis  to  control  the 
movements  and  force  applied  by  the  fingers.  Since,  most  of 
the  available  prostheses  employ  the  users  direct  vision  as  a 
sensory  feedback  lack  in  tactile  or  proprioceptive  feedback 
for  grasping  [2],  and  thus  half  of  the  upper  extremity 
amputees  choose  not  to  use  their  prosthetic  hands  on  a 
regular  basis  [6,  7]. The  control  of  a  multi-fingered  prosthetic 
hand  is  difficult  as  the  human  hand  is  a  highly  complex  and 
nonlinear  system  with  many  degrees  of  freedom  [8].  Past 
research  suggests  that  the  typical  approach  to  the  control  of  a 
prosthetic  hand  is  to  use  hybrid  position  and  force  control 
[9].  As  sEMG  signals  are  collected  from  the  surface  of  the 
skin,  the  signals  pass  through  numerous  tissues  before  they 
reaches  the  surface  of  the  skin  and  are  acquired  by  the 
sensors  [10].  Hence,  they  are  prone  to  cross-talk, 
interference  and  noise.  The  sEMG  is  a  temporal  and 
spatially  modulated  signal  [11].  The  prediction  of  skeletal 
muscle  forces  corresponding  to  the  sEMG  signal  is 
challenging.  Usually  sEMG  measurements  are  based  on 
single  sensor  data. 


For  this  work  we  used  an  array  of  three  sEMG  sensors  and 
a  force  sensing  resistor  (FSR)  to  acquire  the  EMG  signal  and 
the  corresponding  skeletal  muscle  force.  The  data  from  the 
three  sEMG  sensors  is  fused  using  a  fusion  algorithm  since, 
the  fusion  based  force  shows  a  better  estimation  of  skeletal 
muscle  force  from  the  corresponding  sEMG  signal  when 
compared  to  single  sensor  data  [12].  In  order  for  this  design 
to  accomplish  its  goals,  a  real-time  embedded  control  system 
is  essential.  Such  a  system  combines  the  hardware  and 
software  components  to  balance  the  computational,  electrical 
and  mechanical  workloads  across  the  system.  Also  the 
present  work  utilizes  a  real-time  MRAC  which  is 
implemented  on  an  embedded  test  bed  to  control  the 
movements  and  the  force  of  a  prosthetic  hand  prototype  with 
sensory  feedback.  The  input  to  the  real-time  control  system 
is  a  fusion  based  force  estimate.  A  two  stage  embedded 
platform  with  a  simple  MRAC  strategy  is  chosen  for  the 
force  control  of  the  prosthetic  hand  prototype.  The  paper  is 
organized  as  follows.  The  present  section  covers  the 
literature  review  and  introduction,  and  the  next  section 
describes  the  experimental  set-up.  These  are  followed  by  the 
proposed  design,  results  and  discussion,  and  conclusion  and 
future  work. 

II.  Experimental  Set-UP 

Fig.  1  shows  the  experimental  set-up  used  to  capture 
sEMG  and  force  signals.  The  motor  points  and  the 
appropriated  EMG  electrode  attachment  points  of  the  subject 
were  identified  by  using  a  wet  probe  point  muscle  stimulator 
(Rich-Mar  Corporation,  model  number  HV  1100.). Here  we 
are  using  an  array  of  three  sensors.  The  sEMG  sensor  at  the 
center  in  Fig.  1  is  at  the  motor  point  while  the  other  two 
sensors  are  adjacent  to  the  motor  point.  sEMG  signals  are 
captured  from  the  surface  of  the  skin  using  DE  2.1  sEMG 
sensors  with  a  16-channel  DELSYS®  Bagnoli  EMG  system 
and  Lab  VIEW™.  The  sEMG  signals  are  acquired  at  a 
sampling  rate  of  2000  samples  per  second.  Prior  to  placing 
the  sEMG  sensors,  the  skin  surface  of  the  subject  was 
prepared  according  to  the  International  Society  of 
Electrophysiology  and  Kinesiology  (ISEK)  protocols  [13]. 


Fig.  1.  Experimental  Set-Up. 


III.  Proposed  Design 

The  objective  of  the  embedded  system  design  is  for  the 
prosthetic  hand  fingers  to  track  a  force  signal  as  closely  as 
possible.  Here,  the  force  signal  is  inferred  from  surface 
EMG  (sEMG)  signals  obtained  from  the  array  of  the  three 
sEMG  sensors  located  at  the  arm.  The  sEMG  data  is 
processed  by  filtering  and  using  a  sensor  fusion  algorithm  to 
facilitate  the  extraction  of  the  best  finger  force  estimates. 
Sensor  fusion  is  done  in  the  frequency  domain  for  the  sEMG 
data  using  a  simple  elitism  based  Genetic  Algorithm  (GA). 
The  data  from  the  three  sensors  is  collected  around  the 
corresponding  individual  motor  unit  location  at  the 
transradial  arm  location  (flexor  digitorum  superficialis)  and 
before  fusing  are  rectified  and  filtered  using  a  Half  - 
Gaussian  filter,  as  given  by  (1). 

f  EMG 
exp — ^ 

p(EMG\x)  =  2x  ^  \  (1) 

where  p{EMG\x)  is  a  conditional  probability  density 
function,  x  is  a  latent  driving  signal. 

System  identification  (SI)  is  used  to  identify  the  dynamical 
relationship  between  the  sEMG  data  from  the  three 
sensors  Ui,U2,  and  and  the  corresponding  finger  force  of 
a  healthy  male  subject.  In  this  fusion  algorithm.  Output  Error 
(OE)  models  are  used  and  are  constructed  for  each 
individual  data  set.  The  OE  model  is  given  as  follows. 

y(t)  =  (2) 

Where  B,  and  Fare  the  polynomials,  q  is  shift  operator,  e(t) 
is  output  error,  y(t)  is  system  output,  u  is  input,  nk  is  the 
system  delay  and  t  is  time  index. 

Using  the  three  resulting  OE  models  and  the  fusion 
algorithm  given  by  [12]  a  corresponding  continuous-time 
model  is  constructed  as  given  by  the  transfer  function  as 

F(s)  s^f+fnfS^f-^+-+fi  ' 

Similar  to  the  discrete-time  casenh  and  nf  determine  the 
orders  of  the  numerator  and  denominator.  For  multi-input 
systems,  nb  and  nf  are  row  vectors.  b,f  are  the  coefficients 
of  the  numerator  and  denominator  polynomials  respectively. 

A  MISO  transfer  function  is  constructed  based  on  the 
poles  of  three  individual  OE  models  corresponding  to  each 
sensor.  GA  is  used  to  find  the  corresponding  zeros.  The 
search  area  is  limited  to  the  unit  circle,  because  a  discrete 
time  model  is  used  (and  the  resulting  MISO  model  is 
decreased  to  minimum  phase).  The  number  of  zeros  is  at 
most  the  number  of  poles.  The  number  of  potential  zeros  is 
set  to  the  order  of  the  corresponding  denominator.  The  error 
squared  of  the  resulting  MISO  system  H(s)  (see  Appendix) 


and  the  recorded  force  signal  was  set  as  an  objective 

function.  The  objective  function  /  is  constructed  as  follows,  Implementation: 


f  =  ///(  F(t)  -  Y{tfdt  =  ill  (4) 


where  to  and  tf  are  the  initial  and  final  time  values,  Y (t) 
is  the  fusion  model  estimated  force  and  Y  (t)  is  the  actual 
force  from  the  FSR. 

The  MISO  system  //(s)  is  constructed  as  follows. 


H{s)  = 


^Zi,i5^+Zi,25^ 

Z2,i5^+Z2,2S^~^+---Z2,n+l 

P2.lS^+P2,2S^-^+-P2.n^l 

Wl5”+^3,25^-^+-P3,n  +  l^ 


(5) 


The  force  feedback  signal  is  acquired  by  a  Force  Sensitive 
Resistor  (FSR).  The  FSR  is  mounted  on  the  fingertip  of  the 
prosthetic  hand  prototype  as  shown  in  Fig.  3.  A  simple 
MRAC  is  employed  to  generate  the  actual  force  from  the 
FSR,  and  make  it  equal  to  the  model  reference  output  in 
order  to  impose  a  desired  dynamical  response.  The  proposed 
control  design  is  implemented  on  a  PIC  32MX360F512L 
microcontroller  in  two  stages:  “Signal  Processing”  and 
“Motor  Actuation”.  The  Signal  Processing  stage  facilitates 
the  execution  and  implementation  of  real-time  control 
strategies.  A  dsPIC  block  set  is  used  to  generate  the  C  code 
for  the  PIC  32  from  Simulink®.  The  dsPIC  block  set 
generates  a  .hex  file,  and  this  file  is  imported  in  MPLAB®  to 
program  the  PIC  32. 


where  Z's  and  Fs  are  the  zeros  and  poles  respectively  of  the 
individual  transfer  function  and  n  is  the  order  of  the  system. 


Signal  Processing  Stage: 


Feeding  the  new  data  sets  to  the  MISO  transfer  function 
results  in  an  estimated  fusion  based  force  Y. 


The  following  modules  of  the  PIC  32  are  used  for  the 
implementation  of  the  signal  processing  stage. 


Fig.  2.  Block  Diagram  of  Model  Reference  Adaptive  Control 
(MRAC). 

The  controller  utilized  for  compensating  the  dynamics  of 
the  prosthetic  hand  is  based  on  a  simple  MRAC  scheme. 
During  the  development  of  the  artificial  hand,  changes  are 
being  undertaken  to  the  mechanical  design  and  drive  trains 
of  the  hand  that  affect  the  dynamics  of  the  finger  motion  of 
the  prosthesis.  In  addition,  the  uncertain  characteristics  of 
the  kinematic  and  actuator  interaction  may  lead  to  different 
performance  than  expected.  Hence,  a  simple  MRAC 
controller  is  devised  in  order  to  maintain  some  performance 
stability.  The  controller  is  given  by  Fig.  2  where  the  MIT 
rule  is  used  for  updating  the  controller  parameter  6, 

-yeY^  ■  (6) 


a.  The  Analog  Input  module 

b.  The  Digital  Output  module 

c.  The  Output  Compare  module 

d.  The  UART  module 

The  Analog  Input  module  is  used  for  acquiring  the 
sensory  feedback  force  data  from  the  FSR.  The  PIC  32  has 
an  internal  analog  to  digital  converter  (ADC)  which  has  a 
10-bit  resolution  so  that  it  can  distinguish  up  to  1024 
different  voltage  values,  usually  in  the  range  of  0  to  3.3 
volts,  and  it  yields  3mV  resolution.  The  Digital  Output 
module  of  the  PIC  32  is  used  to  generate  digital  control 
signals  based  on  the  selected  control  strategy  to  the  motor 
actuation  stage.  This  module  detects  the  changes  in  the 
reference/command  signal  and  flips  the  direction  bits 
between  0  and  1.  The  motors  switch  direction  accordingly. 
Depending  on  the  error,  a  pulse  width  modulated  (PWM) 
wave  with  a  specific  duty  cycle  is  generated  by  the  Output 
Compare  module.  The  UART  module  in  the  PIC  32  is  used 
to  transmit  the  force  data  from  the  microcontroller  to  the  PC 
via  serial  communication.  In  this  design,  a  virtual  com  port 
was  created  to  feed  the  data  via  USB  cable  to  the  computer. 
MATLAB®  is  used  to  read  the  signals  from  the  ports.  This 
enables  the  user  to  troubleshoot  and  see  the  performance  and 
accuracy  of  the  designed  control  strategy. 

Motor  Actuation  Stage: 


The  gain  y  is  chosen  to  be  3.0  and  the  error  e  =  Y  —  Y^  is 
computed  by  the  difference  of  the  model  reference  output  Y^ 
and  the  true  output  (force  generated  by  the  prosthetic  hand). 
The  model  reference  is  chosen  to  be  of  first  order  to  suppress 
overshoot  and  facilitate  fast  response  time,  given  by 


Gmis)  — 


2 

2s-\-l 


(7) 


In  this  stage,  a  SN7544I0  quadruple  half-H  driver  [14]  is 
used  to  actuate  the  motor  with  the  corresponding  control 
signal.  The  PWM  wave  from  the  Output  Compare  module  is 
connected  to  the  pinl  (1,  2EN)  of  the  H  driver.  The  PWM 
wave  enables  this  H  driver.  The  speed  of  the  motor  depends 
on  the  duty  cycle  of  the  PWM  wave  from  the  Output 
Compare  module  which  is  a  function  of  error  e(t). 
Therefore  the  speed  of  the  motor  is  adjusted  based  on  the 


error  to  achieve  desired  performance  and  accuracy.  The 
digital  outputs  of  the  PIC  32  microcontroller  are  connected 
to  the  direction  pins  of  the  H  driver  (pins  2  and  7).  Switching 
the  digital  outputs  to  0  and  1  between  the  pins  makes  the 
motor  rotate  in  clockwise  and  counter-clockwise  directions. 
This  controls  the  finger  to  maintain  the  force  levels  based  on 
the  control  strategy.  Vcd  and  Vcc2  are  connected  to  the  5V 
supply  of  the  PIC  32  I/O  board.  This  proposed  design  was 
tested  on  an  index  finger  of  a  prosthetic  hand  prototype.  Fig. 
3  shows  the  test  bed  for  the  proposed  design.  The 
Mechanical  design  of  the  robotic  hand  prototype  is 
explained  in  the  following  section. 


Fig.  3.  Embedded  Test  bed  for  the  proposed  design 


IV.  MECHANICAL  STRUCTURE  OF  THE  ROBOTIC  HAND 
PROTOTYPE 

The  prototype  finger  has  three  degrees  of  freedom 
actuated  by  two  Pololu  35:1  mini  metal  gear  motors.  The 
main  characteristic  of  this  robotic  hand  is  its  biologically- 
inspired  parallel  actuation  system,  which  is  based  on  the 
behavior/strength  space  of  the  Flexor  Digitorum  Profundus 
(FDP)  and  the  Flexor  Digitorum  Superficialis  (FDS)  muscles 
[15].  Fig.  4  depicts  the  strength  space  of  FDS  and  FDP 
muscles.  The  DC  motor  in  the  metacarpal  phalange  of  the 
finger  actuates  the  Proximal  Inter  Phalangeal  (PIP)  joint  and 
through  the  belt  transmission  system.  It  also  drives  the  DIP 
(Distal  Inter  Phalangeal)  joint.  The  DC  motor  at  the  base  of 
the  finger  actuates  the  Meta  Carpo  Phalangeal  (MCP)  joint 
as  shown  in  Fig.  5. 


Fig.4.  Strength  space  of  FDS  and  FDP  muscles  [16] 


Fig.  5.  Actuation  scheme  for  the  finger 


The  DC  motors  were  selected  based  on  their  high 
efficiency  (90%)  in  order  to  minimize  power  consumption 
during  more  frequently  executed  tasks  (Region  1).  An 
additional  criterion  is  based  on  the  motor’s  time  response, 
which  needs  to  approximately  correspond  to  the  joint  speeds 
of  the  human  hand.  Grip  force  is  measured  for  a  number  of 
reasons.  For  instance,  it  is  typical  for  real-life  gripping 
scenarios  to  be  recreated  to  investigate  entities  such  as 
maximum  grip  force,  and  the  effects  of  loading  on 
transmission  and  range  of  motions.  The  requirement  to 
reproduce  representative  grip  conditions  means  that  the  force 
sensor  used  must  not  significantly  alter  the  performance 
characteristics  of  the  grasping  action  or  the  operator’s  ability 
to  use  the  prosthetic  hand  prototype.  Particularly,  in  this 
paper,  the  Region  1  actuation  scheme  is  considered.  In  order 
to  sense  the  normal  force  applied  by  the  tip  of  the  finger, 
FSR  is  attached  to  the  tip  of  the  finger. 

V.  Results  and  Discussion 

Data  is  acquired  from  the  microcontroller  through  UART 
channel2  of  the  PIC  32  micro  controller  by  a  virtual  com 
port  via  USB  at  57600  baud  rate.  The  data  from  the 
microcontroller  is  converted  into  unit  16  data  type  before  it  is 
transmitted  through  the  UART.  The  PIC  32  microcontroller 
is  running  at  80  million  instructions  per  second  (MIPS)  with 
its  phase  lock  loop  (PLL)  activated.  It  is  running  at  an 
external  clock  frequency  of  8MHz  with  internal  scaling 
enabled.  Fig.  6  depicts  the  experimental  results  of  the 
proposed  design.  The  prosthetic  hand  prototype 
mathematical  model  is  used  instead  of  the  actual  hand  to 
obtain  the  simulation  based  force  output  to  validate  the 
controller  performance.  The  simulation  based  force  output 
converges  to  the  fusion  model  estimate  Y  in  approximately 
0.9  ms.  The  simulation  based  force  output  exactly  matches 
the  fusion  model  estimated  force  Y  after  the  convergence. 
The  actual  force  output  from  the  FSR  (i.e.  Y)  closely  follows 
the  fusion  model  estimated  force  Y.  In  Fig.  6  there  are  some 
instances  where  the  FSR  lost  contact  with  the  object,  as 
indicated  by  a  sharp  drop  in  the  force  curve. 


Fig.  6.  Fusion  based  force  estimate,  simulation  based  force 
and  actual  force  from  FSR  during  the  grasp. 


Fig.  7.  Fusion  based  force  estimate  and  actual  force  from 
FSR  during  the  grasp  (separate  experiment). 


Time  (ms) 


Fig.  8.  Fusion  based  force  estimate  and  actual  force  from 
FSR  during  the  grasp  (for  a  repeated  experiment). 

Fig.  7  shows  the  fusion  model  estimated  force  Y  and 
actual  force  from  the  FSR  (F)  plotted  for  a  separate 
experiment.  In  this  case,  the  prosthetic  hand  prototype  is 
made  to  maintain  a  minimum  constant  force  so  that  the 
contact  between  the  FSR  and  the  object  will  not  be  lost.  The 
same  experiment  is  repeated  to  test  the  consistency,  and  to 


make  sure  that  the  object  is  in  contact  with  the  FSR 
throughout  the  experiment. 

Fig.  8  shows  the  repeated  experimental  results.  The 
proposed  control  strategy  is  tracking  the  force  profile  and 
matching  the  actual  force  with  the  model  estimated  force 
( Y).  While  conducting  the  experiments,  the  following 
observations  were  made.  The  DC  motors  currently  employed 
have  the  primary  task  of  moving  the  prosthetic  fingers.  As 
the  project  is  ongoing  research,  the  SMA  actuation  scheme 
is  not  yet  implemented  because  of  the  slow  response  of  the 
SMA’s,  and  also  SMA’s  have  high  relaxation  time. 
Therefore  it  is  difficult  to  track  a  randomly  changing  force 
profile  with  a  slowly  responding  actuation  system.  However, 
as  the  hand  is  designed  to  use  the  parallel  actuation  of  these 
DC  motors  and  SMA’s,  the  DC  motors  alone  cannot  produce 
fusion  model  estimated  force.  In  this  work,  the  DC  motors 
are  solely  responsible  for  the  motion  and  force  actuation. 
Since  the  DC  motors  have  small  gear  heads,  the  usual 
characteristic  of  gear  driver  actuation  cores  occurs:  gear 
backlash.  In  addition,  the  DC  motors  employed  were  slow  in 
responding  to  the  changes  in  the  force  profile.  Hence  some 
gaps  were  observed  in  the  measured  force  signal.  This 
indicates  that  there  are  instances  in  which  the  fingertip 
looses  contact  due  to  backlash  and  vibration  problems. 
However,  the  profile  of  the  measured  force  from  the  FSR 
has  a  similar  pattern  as  the  fusion  model  estimated  force 
(  Y).  Thus  we  can  conclude  that  apart  from  those  mechanical 
transmission  problems  the  implemented  control  scheme 
produced  promising  results.  These  problems  will  be 
considered  in  a  new  prototype  design  that  we  are  currently 
developing.  It  is  also  evident  from  Figs.  7  and  8  that  the 
minimum  constant  force  is  needed  to  obtain  better  contact 
with  the  object  and  to  accomplish  accuracy  in  tracking  the 
reference  force  profile.  In  order  to  test  the  precision  of  the 
proposed  control  strategy,  15  different  experiments  were 
conducted.  The  mean  of  the  Pearson's  correlation  coefficient 
(see  Appendix)  for  fusion  model  estimated  force  (  Y)  and  the 
actual  force  from  the  FSR  (F)  in  all  the  15  experiments  is 
0.86.  Because  of  the  above  mentioned  transmission 
problems  and  the  slow  response  of  the  gears,  slight 
variability  is  observed  in  the  correlation  coefficients  for  the 
15  experiments.  Hence  the  difference  in  tracking  the  force 
profile  is  observed  in  Figs.  7  and  8.  Fig.  9  depicts  the 
validation  plot  with  a  different  fusion  based  force  estimate  F 
obtained  by  feeding  a  different  sEMG  signal  to  the  MISO 
transfer  function  The  fusion  based  force  estimate, 

simulation  based  force  and  the  actual  force  from  the  FSR  are 
all  shown  in  Fig.  9.  The  same  mechanical  transmission 
problems  and  the  slow  response  of  gears  are  observed  in  this 
experiment  as  well.  However,  the  controller  is  tracking  the 
force  profile  and  the  Pearson's  correlation  coefficients  for 
fusion  model  estimated  force  ( F)  and  the  actual  force  from 
the  FSR  (F)  is  0.84,  which  is  close  to  other  experiments. 


Fig.  9.  Validation  plot  for  different  model  estimated  forces. 


VI.  Conclusion  and  Future  Work 

A  two- stage  real-time  embedded  MRAC  strategy  was 
designed  for  a  prosthetic  hand  prototype.  The  proposed 
design  gives  good  performance  when  tested  on  a  prosthetic 
hand  prototype,  based  on  tracking  a  reference  force  profile. 
This  design  facilitates  the  transmission  of  the  data  from  the 
microcontroller  to  the  computer.  This  design  enables  the 
control  engineer  to  increase  the  accuracy  and  performance  of 
the  design  by  implementing  various  novel  control  strategies 
and  also  enables  fast  trouble  shooting. 

For  the  future  work,  we  are  planning  to  implement  online 
model-based  force  estimation  along  with  controller  designs 
that  address  the  above  listed  mechanical  shortcomings  for 
position  and  force  control,  using  this  embedded  platform.  It 
will  be  interesting  to  acquire  the  sEMG  signal  directly  from 
the  arm  of  a  healthy  subject  transmit  to  our  embedded 
system  instead  of  using  prerecorded  sEMG  signals,  which 
will  be  investigated  as  well  in  the  future.  Finally,  we  plan  to 
use  the  prototype  with  five  fingers. 

Appendix 

The  resulting  MISO  transfer  function  H(s)  is  constructed  as. 
From  Ui  to  output, 

-  3.843s^  +  7.729s^  -  10.78s^  +  10.6s^  -  7.417s^  +  3.6035^  -  0.9795s  +  0.1192 
s^  -  4.0285^  +  6.325s^  -  4.121s^  -  1.5455^  +  5.875^  -  5.4335^  +  2.28s  -  0.3496 

From  U2  to  output, 

s^  -  4.339s^  +  9.005s^  -  12.42s^  +  12.22s^  -  8.117s^  +  3A27s^  -  0.9134  s  +  0.1424 
s^-  4.028  s^  +  6.325  s^-  4.121  s^-  1.545  s^  +  5.87  s^-  5.433  s^  +  2.28  s  -  0.3496 

From  U3  to  output, 

s^-  3.522  s^  +  6.655  s*^-  8.864  s^  +  8.183  s^-  5.365  s^  +  2.423  s^  -  0.557  s  +  0.09585 
s^-  4.028  s^  +  6.325  s^-  4.121s^  -  1.545  s^  +  5.87  s^-  5.433  s^  +  2.28  s  -  0.3496 

Pearson  correlation  coefficient  is  given  by, 

...  _  coviX,Y)  _  E[(X  -  -  fiy)] 

Px,Y  —  corriA,  Y )  — - — - 

axCTy  GxCJy 

Where  X,  Y  are  Random  Variables,  jix  and  jiy  are  expected 
values,  ax,  ay  are  standard  deviations  respectively.  E  is 
expected  value  operator. 
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Abstract —  Our  recent  investigations  are  focused  to  develop 
dynamic  models  for  skeletal  muscle  force  and  finger  angles  for 
prosthetic  hand  control  using  surface  electromyographic  sEMG 
as  input.  Since  sEMG  is  temporal  and  spatially  distributed  and 
is  influenced  by  various  factors,  muscle  fatigue  and  its  related 
sEMG  becomes  of  importance.  This  study  is  an  effort  to 
spectrally  analyze  the  sEMG  signal  during  progression  of 
muscle  fatigue.  The  sEMG  is  captured  from  the  arms  of  healthy 
subjects  during  muscle  fatiguing  experiments  for  dynamic  and 
static  force  levels.  Filtered  sEMG  signal  is  segmented  in  five 
parts  with  75%  overlap  between  adjacent  segments.  The 
analysis  is  done  using  different  classical  (fast  Fourier 
transform,  Welch’s  averaged  modified  periodogram),  model- 
based  (Yule- Walker,  Burg,  Covariance  and  Modified 
Covariance  autoregressive  (AR)  method),  and  eigenvector 
methods  (Multiple  Signal  Classification  (MUSIC)  and 
eigenvector  spectral  estimation  method)  in  frequency  domain. 
Results  show  that  the  classical  and  eigenvector  based  methods 
are  more  sensitive  than  the  model-based  methods  to  fatigue 
related  changes  in  sEMG  signals. 

L  Introduction 

This  work  focuses  on  the  analysis  of  sEMG  signals, 
which  are  electric  voltages  ranging  between  -5  to  +5  mV 
and  investigates  the  effects  of  fatigue  in  the  skeletal  muscles. 
The  motor  units  operate  as  a  consequence  of  the  central 
nervous  system  control  strategies,  signal  transmission  along 
nerve  fibers  and  across  neuromuscular  junctions,  electrical 
activation  of  the  muscle  fibers  organized  in  elementary 
motors  and,  through  a  chain  of  complex  biochemical  events. 
The  productions  of  the  forces  acting  on  the  tendons  of  the 
agonist  and/or  antagonist  muscles  predict  bone  movement 
[1].  This  mechanism  also  involves  a  number  of  feedback 
circuits  relaying  back  to  the  spinal  cord  and  the  brain 
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information  concerning  the  length  and  velocity  of  shortening 
of  the  muscles  and  the  forces  acting  on  the  tendons  [1].  The 
EMG  signal  gives  information  about  the  motor  points  and 
their  controller  i.e.  the  central  nervous  system  [2,  3].  The 
central  nervous  system  activates  and  controls  the  EMG 
signals  which  depend  on  the  flow  of  specific  ions  including 
sodium  {Na^),  potassium  (K^)  and  calcium  (Ca^^) 
resulting  in  the  action  potentials  in  nerves  and  their 
respective  skeletal  muscle  fibers  from  which  EMG  signals 
are  derived.  Research  efforts  in  the  last  few  decades  have 
focused  on  the  prosthetic  design  where  sEMG  is  a  control 
input  to  activate  the  prosthesis.  The  sEMG  is  a  dynamic 
signal  with  continual  change  in  its  pattern  and  strength  and 
this  becomes  more  complex  with  the  fatigue  induced  in 
skeletal  muscles. 

Failure  to  maintain  the  required  force  level  is  termed  as 
muscle  fatigue,  which  is  a  complex  phenomenon  [4]. 
Reasons  for  fatigue  can  be  the  result  of  peripheral  changes  at 
the  muscle  level  or  an  inadequate  output  from  the  central 
nervous  system  to  stimulate  motoneurons  [4].  Intricacies  of 
muscle  fatigue  are  associated  with  several  aspects  where  the 
relative  importance  of  each  depends  on  the  fiber  type  and 
composition  of  the  contracting  muscle(s),  as  well  as  the 
intensity,  type,  and  duration  of  contraction  activity.  Muscle 
cells  are  the  focal  points  of  fatigue  and  rarely  involve  the 
central  nervous  system  or  the  neuromuscular  junction  [5]. 
The  amount  of  force  generated,  duration  of  each  contraction, 
and  the  rest  period  between  two  contractions  has  a  direct 
influence  on  the  muscle  fatigue  rate  [6].  Muscle  fiber-type 
distribution  [7,  8],  nerve  conduction  velocity  of  fatiguing 
muscles  [9,  10],  or  even  central  factors  within  the  central 
nervous  system  (CNS)  will  affect  motivation  to  perform 
activities  [11].  The  EMG  analysis  is  a  well-accepted  method 
for  muscle  fatigue  assessment  [8-10,  12-17].  Even  though 
the  sEMG  has  some  limitations  associated  with  the  skin 
impedance,  electrode  placement,  and  cross-talk,  it  is  used  for 
the  estimation  of  muscle  fatigue  of  different  muscles  [16,  18, 
19]. 

L.  Lindstrom  et  al.  developed  a  method  that  measures  the 
localized  muscle  fatigue  based  on  the  power  spectrum 
analysis  using  myoelectric  signals,  [20].  This  approach 
permits  real-time  investigations  and  can  yield  statistically 
based  criteria  for  the  occurrence  of  fatigue.  Rate  of  fatigue 
development  and  changes  in  muscle  action  potential 
conduction  velocity  were  used  to  interpret  the  findings  [20- 
22].  Additional  recruitment  of  motor  units,  synchronization 


of  active  motor  units  along  the  muscle  fibers,  and  a  decrease 
in  conduction  velocity  is  reflected  in  the  EMG  signal  as  an 
increase  of  amplitude  in  time  domain  and  a  decrease  of 
medium  frequency  in  frequency  domain  [23,  24]. 

The  joint  analysis  method  using  sEMG  amplitude  and 
spectrum  (JASA)  allows  distinguishing  between  the 
difference  of  fatigue-induced  and  force  related  EMG 
changes.  Simultaneous  changes  in  the  EMG  amplitude  and 
spectrum  is  considered  in  the  JASA  approach  [25]. 
According  to  traditional  measurements,  the  EMG  amplitude 
increases  and  median  frequency  (ME)  decreases  as  a  result 
of  muscle  fatigue  [26-28].  Fatigue  can  occur  because  of 
continuous  high  frequency  and  tetanic  stimulations.  Decline 
in  the  force  magnitude  can  be  attributed  to  reduced 
release  from  the  sarcoplasmic  reticulum  (SR),  reduced 
myofibrilllar  sensitivity,  or  because  of  reduced 

maximum  Ca^^-  activated  tension.  The  main  reason  of  the 
tension  decline  with  continuous  tetanic  stimulation  is 
decreased  release,  which  is  due  to  impaired  action 

potential  propagation  in  the  T  tubules.  Decrease  in  pH  and 
increase  in  inorganic  phosphate  (Pi)  concentration  causes 
reduced  sensitivity  and  decline  in  maximum  tension. 

This  is  the  main  contributing  factor  in  decline  of  force  with 
continual  tetanic  stimulation  [29]. 

Increase  in  the  inorganic  phosphate  in  the  myoplasm 
([Pi]myo)  results  in  reduced  SR  Ca'^'^  release  in  both 
skinned  and  intact  fibers.  Muscle  performance  declines  with 
rigorous  activities  which  results  in  fatigue.  Metabolic 
changes  on  either  the  contractile  machinery  or  the  activation 
process  are  also  responsible  for  the  fatigue  of  muscles. 
Myofibrillar  proteins  and  activation  process  both  are 
affected  during  fatigue  with  substantial  increase  in  the 
concentration  of  inorganic  phosphate  (Pi)  in  myoplasm. 
Further,  it  has  been  shown  that  failure  of  the  sarcoplasmic 
reticulum  (SR)  to  release  Ca'^'^  also  contributes  to  fatigue 
[30].  During  intense  exercise  of  skeletal  muscles  (less  than 
20  seconds),  cells  consume  100  of  times  more  energy  than 
during  the  rest  period.  The  aerobic  capacity  of  muscle  cells 
falls  short  on  energy  demand  and  anaerobic  metabolism 
must  supply  the  majority  of  the  adenosine  triphosphate 
(ATP)  required.  Skeletal  muscle  fatigue  results  because  of 
the  high-intensity  exercise.  Hence,  the  anaerobic  metabolism 
pathway  results  in  a  decline  of  contractile  functionality  [31]. 

The  present  work  investigates  the  change  in  sEMG  in 
frequency  domain  during  skeletal  muscle  fatigue.  The  sEMG 
signals  are  acquired  for  multiple  subjects  for  dynamic  and 
static  force  experiments  to  induce  skeletal  muscle  fatigue. 
The  sEMG  signals  are  filtered  with  a  nonlinear  Teager- 
Kaiser  Energy  (TKE)  operator-based  nonlinear  spatial  filter 
[32].  Two  sets  of  dynamic  force  data  are  segmented  into 
three  and  five  parts  and  two  sets  of  static  force  data  are 
segmented  into  five  parts  each.  There  is  a  75%  overlap 
between  the  two  adjacent  segments.  A  number  of  classical, 
model-based  and  eigenvector  based  spectral  estimation 
techniques  are  used  to  study  the  change  in  the  sEMG  signals 
as  a  result  of  muscle  fatigue.  In  classical  methods  Fast 


Fourier  transform  (FFT)  and  Welch’s  averaged  modified 
periodogram  methods  are  used.  In  case  of  model-based 
methods  Yule-Walker  (Y-W),  Burg,  Covariance  (Cov.)  and 
Modified  Covariance  (Mcov.)  Autoregressive  (AR)  methods 
are  applied.  For  eigenvector  methods  Multiple  Signal 
Classification  (MUSIC)  and  Eigenvector  (EIG)  spectral 
estimation  methods  were  selected  for  processing  sEMG 
signals.  Using  these  spectrum  analysis  techniques.  Power 
Spectral  Density  (PSD)  estimates  and  detailed 
documentations  of  the  sEMG  signals  were  obtained.  These 
methods  were  compared  in  terms  of  their  frequency 
resolution  and  the  effects  in  determination  of  skeletal  muscle 
fatigue. 


II.  Experimental  Set-Up  And  Pre-Processing 


An  experiment  set-up  was  developed  using  DELSYS® 
Bagnoli-16  EMG  system  with  nine  DE-3.1  sEMG  sensors  to 
capture  the  sEMG  signals  from  skeletal  muscles  as  given  in 
[32].  This  arrangement  involves  nine  sensors  covering  four 
directional  spatial  distributions  of  the  sEMG  signal.  The 
appropriate  motor  point  of  the  flexor  digitorum  superficialis 
muscle  (FDS),  which  controls  the  flexion  of  the  ring  finger, 
was  identified  using  a  wet  probe  muscle  stimulator  at  the 
FDS  (RICH-MAR,  HV  1000).  The  middle  three  sEMG 
sensors  were  attached  directly  on  the  skin  surface  above  the 
motor  point  of  the  ring  finger.  Prior  to  placing  the  sEMG 
sensors,  the  skin  surface  of  the  subject  was  prepared 
according  to  International  Society  of  Electrophysiology  and 
Kinesiology  (ISEK)  protocols  [33].  Two  different  sets  of 
fatigue  inducing  experiments  were  conducted  using  this  set¬ 
up  of  sEMG  sensors.  One  experiment  using  dynamic  force 
variations  and  another  with  50  pounds  of  static  force.  For  the 
dynamic  force  variation  we  used  an  Interlink™  Electronics 
FSR  0.5”  circular  force  sensor  on  a  stress  ball  and  for  the 
static  force  experiment  we  used  a  cable  tensionmeter 
(T5166)  by  ‘Pacific  Scientific  Company.’ 


Fig.  1.  Experimental  set-up  for  dynamic  force  levels. 


For  the  dynamic  force  experiment  we  restricted  the  thumb 
movement  using  a  thumb  splint.  For  the  static  force 
experiment  we  held  the  force  of  the  dynamometer  at  50 
pounds  and  tried  to  maintain  this  force  level  to  induce 
fatigue  in  skeletal  muscles.  Force  data  for  dynamic  force 
experiments  was  captured  using  NI  ELVIS™  with 
Interlink™  Electronics  FSR  0.5”  circular  force  sensor. 
Experimental  set-up  is  shown  in  Fig.  1  and  2,  where  9 
sensors  are  shown  on  a  healthy  subject  forearm,  holding  a 


stress  ball  and  a  grip  tension  dynamometer,  respectively. 
The  sEMG  and  finger  force  data  was  collected  at  a  sampling 
rate  of  2000  Hz  using  Lab  VIEW™  in  conjunction  with 
DELSYS®  Bagnoli-16  EMG  and  NI  ELVIS™.  With  these 
experimental  set-ups,  we  conducted  several  experiments  of 
30  seconds,  45  seconds  and  60  seconds  durations. 


Fig.  2.  Experimental  set-up  for  50  pounds  static  force  levels. 


III.  Spectral  Estimation  Methods 

Signals  can  be  analyzed  in  the  time  and  frequency 
domains  and  in  some  instances  the  frequency  content  of  the 
signal  is  more  useful  than  the  time  domain  characteristics 
[34].  Various  bio  signals  such  as  the  heart  rate,  EMG,  EEG, 
EGG,  eye  movements,  and  other  motor  responses,  acoustic 
heart  sounds,  and  stomach  and  intestinal  sounds,  show  much 
richer  information  in  the  frequency  domain  [34].  Spectral 
analysis  is  a  mathematical  prism  which  finds  the  frequency 
content  of  a  waveform  by  decomposing  the  signal  into  its 
constituent  frequencies  [34,  35].  There  is  a  wide  range  of 
methods  for  spectral  analysis,  each  having  its  own  benefits 
and  drawbacks.  In  this  research  we  are  using  classical 
methods  based  on  the  Fourier  transform,  modern  methods 
based  on  the  estimation  of  model  parameters,  and 
eigenvector  based  methods  [34]  in  order  to  characterize  the 
muscle  fatigue  occurring  in  skeletal  human  muscles,  in 
particular  muscles  of  the  forearm.  To  use  the  spectral 
analysis  wisely,  we  need  to  have  an  understanding  of  the 
spectral  features  of  interests  and  the  best  methods  to 
accurately  determine  those  features  [34]. 

A.  Discrete  Fourier  Transform  (DFT) 

DFT  which  is  the  computational  basis  of  the  spectral 
analysis  transforms  the  time  or  space  domain  data  into 
frequency  domain  data  [36].  The  DFT  of  a  vector  x  of  length 
N  is  given  as 

=  (1) 

where  =  e(“27n)/^  is  the  root  of  unity  [36]. 

B.  Welch 's  averaged  modified periodogram  method: 

As  the  name  suggests,  the  ‘Welch’s  averaged  modified 
periodogram  method’  depends  on  the  periodogram  of  the 
signal  {x(rT)^]  which  is  given  by  Equation  (2),  [36]. 

Sperif)  =  ^  \T.n=i  x(n)exp(-j2nfn)\^.  (2) 

In  Welch  method,  the  signal  is  segmented  into  eight  parts  of 
equal  length  with  an  overlapping  ratio  of  50%  and  each  part 
is  segmented  using  a  Hamming  window  as  given  by 
Equation  (3),  [36]. 


w(n)  =  0.54  -  0.46 cos(2nf).Q<n<N  .  (3) 

C.  Yule-Walker  (Y-W)  autoregressive  (AR)  method: 

The  Yule-Walker  autoregressive  method,  also  called  the 
autocorrelation  method,  estimates  the  power  spectral  density 
(PSD)  of  the  input.  This  method  fits  an  autoregressive  (AR) 
model  to  the  windowed  input  data  by  minimizing  the 
forward  prediction  error  in  the  least-squares  sense.  This 
formulation  leads  to  the  Yule- Walker  equations,  which  are 
solved  by  Levinson-Durbin  recursion  [36]. 

D.  Burg  autoregressive  (AR)  method: 

The  Burg  autoregressive  (AR)  method  is  a  parametric 
spectral  estimation  method  of  the  signal,  x.  The  power 
spectral  density  is  calculated  in  units  of  power  per  radians 
per  sample.  This  method  is  based  on  the  minimization  of  the 
forward  and  backward  prediction  error  and  on  estimation  of 
the  reflection  coefficients  [36]. 

E.  Covariance  (Cov.)  autoregressive  (AR)  method: 

The  covariance  autoregressive  (AR)  method  uses  the 
covariance  algorithm  to  estimate  the  parametric  spectral 
density  of  the  signal,  x.  Based  on  causal  observation  of  the 
input  signal,  the  covariance  method  minimizes  the  forward 
prediction  error  and  fits  an  AR  linear  prediction  filter  model 
to  the  signal  [36]. 


F.  Modified  covariance  (Mcov.)  autoregressive  (AR) 
method: 

Modified  covariance  autoregressive  (AR)  method  estimates 
the  PSD  of  the  signal  using  the  modified  covariance  method. 
Based  on  the  causal  information  of  the  input  signal,  the 
modified  covariance  method  fits  an  autoregressive  (AR) 
linear  prediction  filter  model  to  the  signal  by  simultaneously 
minimizing  the  forward  and  backward  prediction  errors.  The 
spectral  estimate  returned  by  this  method  is  the  magnitude 
squared  frequency  response  of  the  AR  model  [36]. 


G.  Multiple  Signal  Classification  (MUSIC)  spectral 
estimation  method: 


The  MUSIC  algorithm  estimates  the  pseudospectrum  (in 
rad/sample)  at  the  corresponding  vector  of  frequencies  for 
the  input  signal  x  [36].  This  algorithm  uses  the  estimates  of 
the  eigenvectors  of  a  correlation  matrix  associated  with  the 
input  signal  using  Schmidt’s  eigenspace  analysis  method 
[37].  The  MUSIC  pseudospectrum  estimate  is  given  by 
Equation  (4), 


:(/) 


(4) 


where  N  is  the  dimension  of  the  eigenvectors  and  is  the 
/c-th  eigenvector  of  the  correlation  matrix  [36].  The  signal 
subspace  has  a  dimension  p  and  the  eigenvectors  Vj^  used  in 
the  sum  corresponds  to  the  smallest  eigenvalues  and  also 
spans  the  noise  subspace  [36].  The  vector  e(f)  consists  of 
the  complex  exponentials,  so  the  inner  product  vj^e(f) 
amounts  to  a  Fourier  transform.  To  estimates  the 
pseudospectrum,  the  squared  magnitudes  are  summed  for 
FFT  computed  for  each  Vj^  [36]. 


H.  Eigenvector  (EIG)  spectral  estimation  method: 


The  eigenvector  spectral  estimation  method  estimates  the 
pseudospectmm  (in  rad/sample)  at  the  corresponding  vector 
of  frequencies  using  estimates  of  the  eigenvectors  of  a 
correlation  matrix  associated  with  the  input  signal  x  [36]. 
This  method  estimates  the  pseudospectrum  from  a  signal  or 
a  correlation  matrix  using  a  weighted  version  of  the  MUSIC 
algorithm  derived  from  Schmidt’s  eigenspace  analysis 
method  [37,  38].  To  find  the  frequency  content  of  the  signal 
the  algorithm  performs  eigenspace  analysis  of  the  signal's 
correlation  matrix.  Singular  value  decomposition  is  used  to 
compute  the  eigenvalues  and  eigenvectors  of  the  signal's 
correlation  matrix  [36].  This  method  computes  the 
pseudospectrum  estimate  as  given  by  Equation  (5). 

(5) 


Pev(f)  = 


where  the  eigenvectors  have  a  dimension  of  N  and  Vj^  is  the 
/c-th  eigenvector  of  the  correlation  matrix  [36].  The  signal 
subspace  has  a  dimension  p  and  the  eigenvectors  Vj^  used  in 
the  sum  corresponds  to  the  smallest  eigenvalues  and  also 
spans  the  noise  subspace  [36].  The  vector  e(/)  consists  of 
the  complex  exponentials,  so  the  inner  product 
amounts  to  a  Fourier  transform  and  to  estimate  the 
pseudospectrum,  the  squared  magnitudes  are  summed  for 
FFT  computed  for  each  [36]. 


/.  Selection  of  Model  Orders  for  Model-Based  and 
Eigenvector  Based  Methods 

Model-based  and  eigenvector-based  methods  need  to  have 
a  specific  model  order  which  is  an  important  aspect  of  the 
use  in  these  methods.  Using  the  sEMG  and  force  data  as 
input  and  outputs  for  three  and  five  sets  of  the  segments  for 
different  data  sets,  we  created  model  structure  matrices  using 
‘struc’  function  in  MATFAB®,  using  ‘arxstruc’  we 
compared  a  model  order  of  1  to  50^^  with  varying  delay  of  1 
to  50  using  cross-validation  on  the  second  half  of  the  data 
set.  With  this  approach,  it  was  possible  to  select  the  order 
that  gives  the  best  fit  for  the  validation  data  set. 


IV.  Results  and  Discussion 

sEMG  signal  changes  as  a  consequence  of  muscle  fatigue 
[23-28],  the  amplitude  of  the  PSD  of  the  signal  increases  and 
the  median  frequency  shifts  towards  the  lower  frequency 
range  [26-28].  In  this  study,  PSDs  of  the  different  segments 
of  each  sEMG  data  set  were  obtained  using  FFT,  Welch’s 
averaged  modified  periodogram.  Yule- Walker,  Burg, 
Covariance,  Modified  Covariance  autoregressive  (AR), 
Multiple  Signal  Classification  (MUSIC),  and  Eigenvector 
spectral  estimation  methods.  The  objective  of  this  study  was 
to  determine  preferred  methods  of  signal  processing  that 
elevates  the  sensitivity  of  muscle  fatigue  as  represented  in 
the  PSD  of  the  sEMG  signal.  An  increased  sensitivity  allows 
for  better  modeling  of  the  fatigue  phenomena  and  hence 
more  accurate  sEMG  models.  Ultimately  this  may  lead  to 
better  prosthetic  control. 

Data  of  two  experiments  for  dynamic  force  variations  was 
segmented  in  three  and  five  parts  respectively.  Each  segment 
is  with  an  overlap  of  75%  with  its  adjacent  segment.  Using 


different  methods,  we  computed  the  PSDs  for  each  segment. 
For  the  dynamic  force  experiments,  the  maximum  value  of 
PSDs  of  sEMG  signal  increases  with  muscle  fatigue  as  time 
or  segment  number  is  increased.  The  classical  methods  (FFT 
and  Welch)  and  eigenvector  based  methods  (MUSIC  and 
Eigenvector  (FIG.))  are  representing  this  change  well  in  case 
of  maximum  PSD  values  and  show  a  clear  difference. 

Table  I  lists  the  peak  values  of  the  PSDs  of  five  segments 
using  classical  and  eigenvector  based  methods  for  a 
dynamically  varying  force  experiment.  Fig.  3  shows  the 
overlapping  plot  of  PSDs  for  five  segments  using  the 
MUSIC  algorithm  based  spectral  estimation  method.  The 
increase  in  the  maximum  PSD  value  is  evident  from  the  U* 
to  the  5^^  segment  of  the  data. 

TABLE  I 

MAXIMUM  VALUE  OF  PSD  FOR  CLASSICAL  METHODS  AND 
EIGENVECTOR  BASED  METHODS  -  DYNAMIC  VARYING  FORCE  - 
EXPERIMENT  2 


Segment  No. 

Classieal-Methods 

Eigenveetor-Methods 

FFT 

Weleh 

MUSIC 

EIG 

I  St 

4.Ie+6 

0.0082 

371.59 

I.08I9 

2nd 

5.09e+6 

0.0100 

424.43 

1.3892 

3rd 

5.74e+6 

O.OIII 

480.71 

I.4I32 

4th 

6.79e+6 

0.0133 

508.64 

1.4936 

S'" 

2.I3e+7 

0.0379 

695.08 

I0.2II8 

MUSIC  -  Dynamic  Force  -  Experiment  2 


Dynamic  Force  Experiment. 


Fig.  4  shows  the  resulting  PSD  using  the  Burg  method. 
Comparing  Fig.  3  and  4,  the  progression  of  fatigue  influence 
shift  in  PSDs  is  evident  in  both  plots.  However,  the  MUSIC 
algorithm  not  only  shows  larger  amplitudes,  but  also  a 
greater  relative  sensitivity  to  fatigue. 


Burg  -  Dynamic  Force  -  Exp88 
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Fig.  4.  PSD  vs.  Frequency  Plot  for  Burg  Method  -  Dynamic 
Force  Experiment. 


The  rather  equal  spacing  between  the  lines  of  the  PSD  for 
the  MUSIC  algorithm  compared  to  the  Burg  method 


indicates  a  rather  more  linear  relationship  of  the  fatigue 
progression. 

The  sEMG  data  of  two  experiments  for  static  force  (50 
pounds)  were  processed  and  the  maximum  PSDs  of  five 
segments  using  classical,  model-based,  and  eigenvector 
based  methods  were  computed.  Data  from  both  the 
experiments  show  similar  results  as  the  dynamic  case.  Table 
II  lists  the  peak  values  of  the  PSDs  of  five  segments  using 
classical  and  eigenvector  based  methods  for  static  force  (50 
pounds)  for  one  experiment.  Table  III  lists  the  maximum 
values  of  the  PSD  for  model-based  methods:  Y-W,  Burg, 
Covariance,  and  modified  covariance. 

TABLE  II 

MAXIMUM  VALUE  OF  PSD  FOR  CLASSICAL  METHODS  -  STATIC 


FORCE  -  50  POUNDS  -  EXPERIMENT  I 


Segment  No. 

Classieal-Methods 

Eigenveetor-Methods 

FFT 

Weleh 

MUSIC 

EIG 

ist 

I.03e+5 

6.8Ie-5 

1413 

9.93e-4 

2nd 

I.80e+5 

I.I2e-4 

1793 

I6e-4 

3rd 

3.2Ie+5 

I.80e-4 

2296 

28e-4 

4th 

4.25e+5 

2.62e-4 

3102 

37e-4 

S'" 

6.23e+5 

3.58e-4 

7723 

I04e-4 

TABLE  III 

MAXIMUM  VALUE  OF  PSD  FOR  CLASSICAL  METHODS  -  STATIC 

FORCE  -  50  POUNDS  -  EXPERIMENT  I 

Segment  No. 

ist 

2nd 

jrd 

4th  3th 

Model-Based 

7.7e-7 

I.3e-6 

2.3e-6 

3.Ie-6  7.81-6 

Methods 

All  of  these 

methods 

resulted 

in  the 

same  maximum 

values  for  each  segment.  Comparing  Table  II  and  III,  we 
recognize  the  large  difference  in  maximum  value  between 
the  model-based  methods  and  the  corresponding  values  from 
the  TFT  and  MUSIC  method.  Fig.  5  shows  the  overlapping 
plot  of  PSDs  for  five  parts  using  eigenvector  algorithm 
based  spectral  estimation  method.  The  increase  in  the 
maximum  PSD  value  is  evident  from  the  to  the  5^^ 
segment  of  the  static  force  sEMG  data. 


Fig.  5.  PSD  vs.  Frequency  Plot  for  Eigenvector  Method  - 
Static  Force  of  50  Pounds. 

The  eigenvector  method  produces  a  similar  characteristic 
as  the  MUSIC  algorithm  and  distinguishes  itself  by  also 
providing  a  more  linear  characteristic  of  the  fatigue 
progression  and  a  greater  relative  sensitivity.  Fig.  6  depicts 
the  PSD  generated  by  using  FFT  method  for  the  and  5^^ 
segments  of  a  static  force  experiment.  While  providing  a 
large  maximum  value,  the  FFT  method  is  limited  by  its  own 


spectral  resolution  (1/A^)  and,  due  to  windowing  of  the  finite 
data  set,  results  into  spectral  leaking. 

All  the  model-based  methods  for  both  dynamic  and  static 
force  levels  produce  the  same  peak  values  and  the  same  PSD 
for  the  corresponding  experiment.  Since  Burg  and  Y-W 
methods  guarantee  stability  while  the  covariance  and 
modified  covariance  methods  have  conditions  for  stability  to 
be  satisfied  (i.e.  min.  order  must  be  of  certain  length  of  the 
input  frame  size).  Burg  and  Y-W  should  be  the  preferred 
methods  for  sEMG  analysis.  However,  the  Burg  method  is  to 
be  preferred  if  short  data  sets  are  used. 


FFT  -  Static  Force  -  50  Pounds  -  1st  and  5th  Segment  -  Exp33 


Fig.  6.  PSD  vs.  Frequency  Plot  for  FFT  Method  -  Static 
Force  of  50  Pounds. 

Comparing  the  eigenvector  based  methods  (MUSIC  and 
Eigenvector),  both  of  these  methods  are  frequency  estimator 
techniques  based  on  eigenanalysis  of  the  autocorrelation 
matrix  where  the  resulting  estimate  has  sharp  peaks  at  the 
frequencies  of  interest.  The  eigenvector  method  uses  inverse 
eigenvector  weighting  whereas  the  MUSIC  method  uses 
unity  weighting,  implying  that  the  eigenvector  method  gives 
fewer  spurious  peaks  than  the  MUSIC  algorithm  [39].  As 
seen  from  the  dynamic  experiment  results,  the  MUSIC 
method  provides  for  a  better  spacing  between  the  segment 
based  PSDs  compared  to  the  Burg  and  eigenvector  method. 
From  static  experiments,  we  conclude  that  all  three  (MUSIC, 
Burg,  and  Eigenvector)  methods  perform  similarly  if  a  linear 
relationship  of  the  fatigue  progression  is  desired. 

V.  Conclusion  and  Future  Work 

This  research  characterizes  muscle  fatigue  using  a  PSD 
representation  of  different  segments  of  sEMG  data.  Classical 
(fast  Fourier  transform  and  Welch’s  averaged  modified 
periodogram),  model-based  (Y-W,  Burg,  Cov.,  and  Mcov. 
autoregressive  (AR)  method)  and  eigenvector  based  methods 
(MUSIC  and  EIG.  spectral  estimation  method)  are  used  to 
compute  the  PSDs.  Classical  and  eigenvector  based  methods 
are  more  sensitive  than  the  model-based  methods  for 
analyzing  the  fatigue  related  changes  in  sEMG  signal. 
However,  the  MUSIC  algorithm  provides  good  maximum 
value  in  the  PSD  as  well  as  a  clear  distinction  between  the 
segmented  sEMG  data.  The  latter  point  is  indicative  of  a 
relative  linear  fatigue  progression  in  time  for  the  same  case 
when  the  MUSIC  algorithm  is  utilized.  In  the  future  work 
these  results  can  be  used  to  design  and  improve  the  skeletal 
muscle  ‘ Force- sEMG-Fatigue’  based  models  [40]  for 
prosthetic  design  and  other  rehabilitation  research. 
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Abstract  -  Effective  use  of  upper  extremity  prostheses  depends  on 
the  two  critical  aspects  of  precise  position  and  force  control 
Surface  electromyographic  (sEMG)  signals  can  be  used  as  a 
control  input  for  the  position  and  force  actions  related  to  the 
prosthesis.  In  this  paper,  we  use  the  measured  sEMG  signals  to 
estimate  skeletal  muscle  force,  Eurther,  we  consider  skeletal  muscle 
as  a  system  and  System  Identification  (SI)  is  used  to  model  multi¬ 
sensor  sEMG  and  skeletal  muscle  force.  The  sEMG  signals  are 
filtered  utilizing  optimized  nonlinear  Half-Gaussian  Bayesian  filter, 
and  a  Chebyshev  type-II  filter  provides  the  muscle  force  signal.  The 
filter  optimization  is  accomplished  using  a  Genetic  Algorithm  (GA), 
Multi-  linear  and  nonlinear  models  are  obtained  with  sEMG  data 
as  input  and  skeletal  muscle  force  of  a  healthy  human  hand  as  an 
output  for  three  sensors.  The  outputs  of  these  models  for  three 
sensors  are  fused  with  a  probabilistic  Kullback  Information 
Criterion  (KIC)  for  model  selection  and  an  adaptive  probability  of 
KIC,  The  final  fusion  based  force  for  multi-sensor  sEMG  gives 
improved  estimate  of  the  skeletal  muscle  force. 

Keywords:  sEMG,  SI,  GA,  KIC 

L  Introduction 

In  the  last  decade  there  have  been  active  research  efforts 
in  the  field  of  prosthetics.  According  to  [1]  the  United  States 
has  1.7  million  of  amputees  and  this  figure  is  on  the  rise  since 
2003  due  to  the  wars  in  Afghanistan  and  Iraq  [2]. 
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Individuals  with  upper  extremity  amputations  not  only  have 
a  reduction  in  function,  but  also  struggle  with  numerous 
psychological  issues  which  may  further  complicate  the 
appropriate  control  and  use  of  the  prosthesis.  Previous 
research  on  the  prosthetic  hand  design  was  mainly  based  on 
the  electromyography  (EMG)  signals  [3-4].  The  EMG  signal 
recorded  at  the  surface  of  the  limb  is  known  as  surface  EMG 
(sEMG).  The  sEMG  is  an  electric  voltage  ranging  between  -5 
and  +5  mV,  which  reflects  the  electrical  activity  associated 
with  voluntary  muscle  contraction  and  which  has  been  used  to 
control  the  position  and  force  of  the  hand  prosthesis  [5-6]. 
The  skeletal  muscle  force  and  the  sEMG  signals  are  related 
and  higher  sEMG  amplitude  generally  correlates  with  greater 
force  production.  However,  there  are  various  other  factors 
that  affect  this  relationship.  The  sEMG  signals  are  random, 
complex  and  dynamic  in  nature  because  of  varying  motor  unit 
recruitment,  crosstalk,  and  biochemical  interaction  within  the 
muscular  fibers.  Hence  all  these  factors  contribute  towards 
the  nonlinear  relationship  between  the  two. 

Since  sEMG  is  the  control  input  for  the  prosthesis,  precise 
control  and  correct  interpretation  of  the  measured  sEMG 
signal  is  important.  In  previous  works,  the  authors  have 
published  similar  work  using  multi  sensor  data  fusion  and 
Output  Error  (OE)  model  and  modal  transformation  [7],  and 
multi  sensor  data  fusion  using  nonlinear  models  [8]. 

The  present  work  is  an  extension  of  our  previous  work  [9] 
where  we  proposed  estimation  of  the  skeletal  muscle  force 
using  an  adaptive  data  fusion  algorithm  with  hybrid  multi 
linear  and  nonlinear  models.  In  [9]  the  sEMG  data  was  based 
only  from  measuring  the  motor  point  sEMG  signal,  whereas 
in  the  present  work  we  extend  this  to  three  sensors  for  the 
ring  finger  of  the  dominant  hand  of  a  healthy  male  subject. 
Figure  1  presents  the  flow  chart  of  the  work  done  in  this 
paper.  The  sEMG  signals  are  acquired  from  the  forearm  of  a 
healthy  subject  and  filtered  utilizing  Genetic  Algorithm  (GA) 
based  optimized  nonlinear  Half-Gaussian  Bayesian  filter.  On 
the  other  hand,  the  skeletal  muscle  force  signal  is  filtered 
using  a  Chebyshev  type-II  filter.  The  sEMG  is  considered  as 
input  whereas  force  signal  is  considered  as  an  output.  Since 
each  model  captures  the  dynamics  differently,  we  obtained 
multiple  linear  and  nonlinear  models  using  System 
Identification  (SI)  for  the  sEMG  data  corresponding  to  the 
three  sensors.  First,  the  outputs  of  all  the  linear  and  nonlinear 
models  from  the  three  sensors  are  fused  separately  and  then 


the  resultant  three  outputs  are  fused  with  a  probabilistic 
Kullback  Information  Criterion  (KIC)  for  model  selection  and 
an  adaptive  probability  of  KIC.  The  final  fused  output  using 
this  approach  gives  improved  skeletal  muscle  force  estimates. 

The  paper  is  organized  as  follows,  the  present  section 
covers  the  introduction  and  literature  work,  which  is  followed 
by  the  description  of  the  experimental  set-up  and  pre¬ 
processing,  then  system  identification  and  linear  and 
nonlinear  modeling  is  discussed,  followed  by  the  data  fusion 
algorithm.  The  paper  is  concluded  by  a  section  with,  results 
and  discussions,  and  followed  by  the  conclusions  and  future 
work. 


Figure  1.  Flow  chart  for  estimation  of  skeletal  muscle  force 
using  an  adaptive  data  fusion  algorithm. 

II.  Experimental  Set-Up  and  Pre-Processing 

The  sEMG  and  skeletal  muscle  force  signals  are  acquired 
using  Lab  VIEW™  8.2  simultaneously  at  a  sampling  rate  of 
2000  Hz.  A  DELSYS®  Bagnoli-16  EMG  system  with  DE-2.1 
differential  EMG  sensors  is  used  for  sEMG  data  capturing. 
However,  the  corresponding  force  data  was  captured  using  NI 
ELVIS  with  Interlink  Electronics  FSR  0.5”  circular  force 
sensor.  The  experimental  set-up  is  shown  in  Figure  2.  One 


sEMG  sensor  was  placed  on  the  motor  point  of  the  ring  finger 
and  two  adjacent  to  the  motor  point  of  a  healthy  subject.  Skin 
surface  on  the  forearm  of  the  subject  was  prepared  with  the 
International  Society  of  Electrophysiology  and  Kinesiology 
(ISEK)  protocol  prior  to  placing  sEMG  sensors. 

The  nonlinear  Bayesian  filter  yields  good  sEMG  data  and 
significantly  reduces  the  influence  of  noise  and  it  also  extracts 
a  signal  that  best  describes  the  EMG  signals  and  may  permit 
effective  use  in  prosthetic  control  [10].  The  sEMG  signal  can 
be  modeled  with  the  assumption  that  the  conditional 
probability  of  the  rectified  EMG  signal  is  a  filtered  random 
process  with  random  rate.  The  “Half-Gaussian  measurement 
model”  for  the  rectified  EMG  signal  is  given  by  Equation  (1), 
[10]. 


Figure  2.  Experimental  Set-Up. 


P(emg\x)  =  2  *  exp(-^^^)/(2  *  tt  *  (1) 

The  likelihood  function  for  the  rate  evolving  in  time  is  given 
by  the  Fokker-Planck  partial  differential  equation,  where  the 
two  free  parameters  in  the  signal  are  the  expected  rate  of 
gradual  drift,  a  and  the  expected  rate  of  sudden  shifts  P  [10]. 
The  two  free  parameters  of  the  sEMG  signal  are  optimized 
using  an  elitism  based  GA.  On  the  other  hand  the  skeletal 
muscle  force  signal  is  filtered  with  a  Chebyshev  type  II  low 
pass  filter. 

III.  System  Identification  -  Linear  and  Nonlinear 
Modeling 

A  system  can  be  modeled  either  by  using  physics  based 
mathematical  models  or  by  System  Identification  (SI)  [II]. 
Parametric  SI  gives  a  dynamic  model  such  as  the  Auto 
Regressive  with  exogenous  input  (ARX)  or  Output  Error 
(OE)  of  the  system  in  mathematical  form.  In  this  research,  we 
use  the  SI  approach  to  model  the  two  signals.  The  sEMG  is 
the  input  to  the  system  and  the  intended  fmger/hand  force  is 
output.  In  this  work,  mutli-  linear  and  nonlinear  models  are 
obtained  for  modeling  of  sEMG  and  hand/fmger  force  signals 
for  three  sensors  for  the  ring  finger  of  the  dominant  hand  of  a 
healthy  subject.  Six  linear  and  three  nonlinear  models  are 
obtained  for  the  motor  point  sEMG  signal,  three  linear  and 
five  nonlinear  models  are  obtained  for  the  ringl  sensor,  and 
six  linear  and  five  nonlinear  models  are  obtained  for  ring2 


sensor  data.  Table  I  and  II  gives  the  structures  of  linear  and 
nonlinear  models  respectively. 

The  model  order  of  the  various  models  used  in  this  work 
are  as  follows:  linear  models  for  the  motor  point  data,  OE 
model  of  order  6,  ARX  model  of  order  6,  ARM  AX  model  of 
model  order  5,  Box-Jenkins  (BJ)  model  of  order  18,  State- 
Space  model  with  subspace  method  (N4SID)  of  order  12  and 
a  State- Space  model  with  prediction  error/maximum 
likelihood  method  (PEM)  of  order  12  are  obtained  using  SI. 
For  ringl  sensor  (sensor  adjacent  to  the  motor  point  sensor) 
data  OE  model  of  order  17,  ARM  AX  model  of  order  35  and 
BJ  model  of  order  1 1  are  obtained.  For  ring2  sensor  (sensor 
on  opposite  side  of  ringl  sensor)  data  OE  model  of  order  45, 
ARX  model  of  order  12,  ARMAX  model  of  order  17,  BJ 
model  of  order  14,  N4SID  model  of  order  13  and  PEM  model 
of  order  22  are  obtained.  Table  I  gives  the  structure  of  all  the 
linear  models.  In  table  I  y  is  output,  t  is  time,  F(q), 

A(q),  C(q),  D(q),  are  polynomials,  q  is  a  backward  shift 
operator,  u  is  input,  is  delay  and  e  is  error  [12].  For  State- 
Space  models:-  x  is  state,  t  is  time,  Ts  is  sampling  time,  u  is 
input,  e  is  error.  A,  B,  K,  C,  and  D  are  system  matrices,  and  y 
is  output  [12]. 


predicted  output  as  a  weighted  sum  of  past  output  values  and 
current  and  past  input  values.  For  the  nonlinear  Hammerstein- 
Wiener  model  u(t)  and  y(t)  are  the  inputs  and  outputs  for 
the  system,  respectively.  /  and  h  are  nonlinear  functions  that 
corresponds  to  the  input  and  output  nonlinearity,  respectively. 
w(t)  and  x(t)  are  internal  variables.  w(t)  has  the  same 
dimension  as  u(t).  x(t)  has  the  same  dimension  as  y(t). 
B(q)  and  F(q)  in  the  linear  dynamic  block  are  polynomials 
in  the  backward  shift  operator.  For  nonlinear  Hammerstein- 
Weiner  model  with  deadzone  nonlinearity  estimator,  F  is  a 
nonlinear  function  of  x  with  the  properties  given  in  the  table 
II.  For  nonlinear  Hammerste in- Weiner  model  with  wavelet 
network  as  nonlinearity  estimator,  k(s)  as  a  wavelet 
function,  and  is  a  row  vector  such  that  —  y^)  is  a 
scalar.  If  only  the  input  nonlinearity  is  present,  the  model  is 
called  the  Hammerstein  model.  If  only  the  output  nonlinearity 
is  present,  the  model  is  called  the  Wiener  model  [12]. 

TABLE  II 

NONLINEAR  MODELS  AND  THEIR  STRUCTURES 


Nonlinear  Model  Name  Nonlinear  Model  Strueture 


TABLE  I 

LINEAR  MODELS  AND  THEIR  STRUCTURES 


Linear  Model  Name 

Linear  Model  Strueture 

Output  Error 

y(t) 

B(<?) 

=  -  rik)  +  e(^t) 

ARX 

Mq)y(t) 

=  Biq)uit  —  rife)  +  e(t) 

ARMAX 

^(q)y(t) 

=  Biq)uit-nk) 

+  Fiq)eit) 

Box-Jenkins 

y(t) 

C{q) 

State-Spaee  -  subspaee  method 

xit  +  Ts) 

=  Axit)  +  Buit)  +  Keit) 
y(t) 

=  Cxit)  +  Duit)  +  e(t) 

State-Spaee  -  predietion  error/maximum 
likelihood  method 

xit  +  Ts) 

=  Axit)  +  Buit)  +  Keit) 

y(t) 

=  Cxit)  +  Duit)  +  e(t) 

Table  II  gives  the  structures  of  nonlinear  models.  The 
nonlinear  models  for  the  motor  point  data  are  obtained  as,  the 
nonlinear  ARX  with  a  sigmoidnet  nonlinearity  estimator, 
nonlinear  Wiener-Hammerstein  models  with  a  piecewise 
linear  nonlinearity  estimator,  and  a  saturation  based  estimator. 
For  each  ringl  and  ring2  signal  data  sets,  five  nonlinear 
Wiener-Hammerstein  models  with  nonlinearity  estimators  as 
‘piecewise  linear  -  pwlinear,’  ‘sigmoidnet,’  ‘saturation,’ 
‘deadzone,’  and  wavelet  network’  are  obtained. 

In  table  II  /  is  a  nonlinear  function  for  the  nonlinear  ARX 
model.  Inputs  to  /  are  model  regressors.  yp(t)  is  the 


Nonlinear  ARX  -  =  f{y{t  —  — 

Sigmoidnet  2),y(t  -  3),  -  1),  w(t  - 

2),...); 

f{z)  =  is  sigmoid  funetion. 


Nonlinear  HW  -  Pieeewise 
Linear  -  pwlinear 


w(t)  =  /(n(t)), 


y(t)  =  h{x{t)y. 


Nonlinear  HW  -  Sigmoidnet  ypiF)  —  f{y{t  l),y(t 

2),y(t  —  3),  —  l),it(t  — 

2),...); 

f{z)  =  is  sigmoid  funetion. 


Nonlinear  HW  -  Saturation 


w(t)  =  /(u(t)), 
v(t)  =  ^^w(t), 

pjiW 

y(t)  =  h(xm 


Nonlinear  HW  -  Deadzone 


Nonlinear  HW  -  Wavelet 
Network 


y  =  Fix)  ; 

a  <  X  <  b,  Fix)  =  0 
X  <  a,  Fix)  =  X  —  a 
X  >  b,  Fix)  =  X  -  b 


n 

S' W  =  2]  “(cK(/5(c(*  -  kO) 

k=l 


IV.  Data  Fusion  Algorithm 

A  data  fusion  algorithm  with  an  adaptive  probability  of  the 
Kullback  information  criterion  (KIC)  is  used  to  fuse  the 
outputs  of  different  models  obtained  [13].  Kullback 
information  criterion  (KIC)  is  an  asymmetric  measure  for  the 
model  selection.  Kullback’ s  symmetric  or  J-divergence  is  the 


sum  of  two  directed  divergences,  which  is  the  measure  of  the 
models  dissimilarity  and  given  by  Equation  (2),  [14]. 

KIC(pi)  =^\ogRi+^^^^-nip(^^+ g(n),  (2) 

where  g(n)  =  n  *  log  (nl2). 

In  this  research  work,  we  are  obtaining  multi-  linear  and 
nonlinear  models  using  SI  for  the  sEMG  sensor  for  the  ring 
finger  motor  unit,  and  two  adjacently  placed  sensors,  ringl 
and  ring2.  The  probability  of  each  model  is  computed  using 
the  SI  model  fit  value,  which  is  given  by[l  —  |E  —  E|/|E  — 
F  I  ]  *  100.  The  fusion  of  outputs  and  adaptive  KIC 
probability  is  shown  in  Figure  3  which  is  followed  by  the  data 
fusion  algorithm. 


Figure  3.  Adaptive  KIC  Probability  Based  Data  Fusion. 


The  following  fusion  algorithm  as  given  by  [13]  is 
applied  for  data  fusion  of  the  outputs  of  different  linear  and 
nonlinear  models: 

1)  Identify  models  M^,  M2,  using  sEMG  data  (u)  as 

input  and  force  data  (T)  as  output,  for  k  number  of 
sensors  collecting  data  simultaneously. 

2)  Compute  the  residual  square  norm 

=  \\y  -  tDi0i||^  =  \\Y  -  Y\\,  where  0;  = 
and 
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3)  Calculate  the  model  criteria  coefficient  using  Equation  (2). 

4)  Compute  the  model  probability  p{Mi\Z)  =  ^  where 

I  is  model  selection  criterion,  i.e.  KIC(pi). 

5)  Compute  the  fused  model  output  Yf  = 

6)  Compute  the  overall  model  from  Yf  and  force  data. 

Here  all  the  computation  from  step  2)  to  6)  is  adaptive  i.e. 
the  residual  square  norm,  K/C(pi),  model  probability 
p(Mj|Z),  and  fused  model  output  Yf  are  being  updated  with 
time  or  for  each  data  point. 

V.  Results  and  Discussion 

An  adaptive  KIC  probability  based  data  fusion  algorithm  is 
applied  to  linear  and  nonlinear  models  separately  for  the 
models  obtained  using  three  sets  of  input  and  output  data  for 
three  sEMG  sensors.  First  the  fusion  based  output  for  each 
sensor  is  obtained  and  then  the  three  fusion  based  outputs 
from  three  sEMG  sensors  are  fused  to  get  the  improved 
estimates  of  the  skeletal  muscle  force.  The  following  plots 
show  the  improvement  in  the  force  estimates  in  succession 
with  different  sensors  separately  and  then  combined.  All  the 
plots  have  the  measured  skeletal  muscle  force  signal  in  green 
and  the  estimated  force  signal  in  red  color.  Figure  4  is  a  plot 
of  measured  and  Chebyshev  type  II  filtered  finger  force  data 
with  the  adaptive  KIC  probability  fusion  based  force  for  the 
first  sensor  named  as  ringl.  The  two  signals  are  very  clear  and 
the  estimated  signal  shows  good  follow  up  of  the  measured 
signal.  Figure  5  shows  the  measured  and  Chebyshev  type  II 
filtered  skeletal  muscle  force  with  the  adaptive  KIC 
probability  fusion  based  force  signals  for  the  second  sensor 
named  as  ring2.  It  is  evident  that  the  measured  signal  has  a 
very  close  follow  up  by  the  estimated  signal. 


Chebyshev  Type  II  Filtered  Vs.  Linear-NL  Models  -  Adaptive  KIC  Probabihty  -  Ringl 


Figure  4.  Chebyshev  Type  II  vs.  Adaptive  KIC  Probability 
Based  Force  from  Finear  and  Nonlinear  Models  for  Ringl 
Sensor. 

Figure  6  shows  the  measured  and  Chebyshev  type  II 
filtered  skeletal  muscle  force  with  the  adaptive  KIC 
probability  fusion  based  force  signals  for  third  sensor  placed 
on  the  motor  point  of  ring  finger.  The  results  for  this  sensor 
are  best  among  the  three  based  of  the  used  three  sensor  data 
and  it  is  evident  that  the  measured  signal  has  a  very  close 
follow  up  by  the  estimated  signal. 


Chebyshev  Type  II  Filtered  Vs,  Linear-NL  Models  -  Adaptive  KIC  Probability  -  Ring2 


Figure  5.  Chebyshev  Type  II  vs.  Adaptive  KIC  Probability 
Based  Force  from  Linear  and  Nonlinear  Models  for  Ring2 
Sensor. 


Chebyshev  Type  II  Filtered  Vs.  Motor  Point  -  Linear-NL  Models  -  Adaptive  KIC  Probability 


Figure  6.  Chebyshev  Type  II  vs.  Adaptive  KIC  Probability 
Based  Force  from  Linear  and  Nonlinear  Models  for  Motor 
Point  Sensor. 


Chebyshev  Type  II  Filtered  Vs.  Ringl-Ring2-MotorPoint  -  Linear-NL  Models  -  Adaptive  KIC  Probability 


Figure  7.  Chebyshev  Type  II  vs.  Adaptive  KIC  Probability 
Based  Force  from  Linear  and  Nonlinear  Models  for  Ringl, 
Ring2  and  Motor  Point  Sensor  Combined. 

Finally  the  estimated  skeletal  muscle  force  from  three 
sEMG  sensors  is  further  fused  with  adaptive  KIC  probability 
based  data  fusion  algorithm.  Figure  7  shows  the  comparison 
of  the  measured  and  Chebyshev  type  II  filter  with  the  final 
adaptive  KIC  probability  based  fusion  skeletal  muscle  force 


estimate  using  three  sEMG  sensors.  The  final  result  for  three 
sensors  is  the  best  estimate  of  skeletal  muscle  force  and  it  is 
evident  that  the  measured  signal  has  a  very  close  follow  up  by 
the  estimated  signal. 

The  results  show  that  there  is  a  decrease  in  the  percentage 
error  from  the  linear  and  nonlinear  model  fusion  based 
separate  outputs  to  the  fusion  based  combined  output  of  linear 
and  nonlinear  models  combined  for  all  three  sensors. 
However,  these  results  show  that  there  is  a  1 6%  improvement 
in  the  mean  fit  value  of  the  motor  point  signal  models  with 
the  adaptive  KIC  probability  based  data  fusion  algorithm  for 
multi-sensors  (three  in  this  case).  Figure  8  and  9  show  the 
validation  plots  of  this  approach  for  two  separate  sets  of 
sEMG  and  skeletal  muscle  force  data  where  green  signal  is 
the  Chebyshev  type  II  filtered  measured  force  signal  and  the 
blue  signal  is  estimated  using  this  approach. 


Validation  Plot  -  Separate  Experiment  Data  1 


2  4  6  8  10  12 

Time  (60  Seconds)  ^  lo'' 


Figure  8.  Validation  Plot  1  -  Chebyshev  Type  II  vs.  Estimated 
Force  Signal  using  Adaptive  KIC  Probability. 


Validation  Plot  -  Separate  Experiment  Data  2 


Figure  9.  Validation  Plot  2  -  Chebyshev  Type  II  vs.  Estimated 
Force  Signal  using  Adaptive  KIC  Probability. 

VI.  Conclusion  and  Future  Work 

Different  linear  and  nonlinear  models  are  obtained  using 
system  identification  (SI)  for  three  sets  of  data.  Linear  and 
nonlinear  models’  outputs  are  fused  separately  for  each  sensor 
and  then  fused  together  to  get  the  final  force  estimate  for  each 
sensor.  The  net  force  estimates  for  each  sensor  is  then  applied 
with  adaptive  KIC  probability  based  data  fusion  algorithm. 


The  final  estimates  of  the  skeletal  muscle  force  gives 
improved  results.  Future  work  will  focus  on  the  improved  data 
collection  techniques  and  capturing  data  at  higher  sampling 
rate  (6000  samples  per  second).  Also,  we  would  design  new 
model  selection  criteria  using  different  model  selection 
criteria  such  as  Akaike  Information  Criterion  (AIC),  Kullback 
Information  Criterion  (KIC)  and  the  Bayesian  Information 
Criterion  (BIC). 
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Abstract:  -  This  paper  presents  the  investigation  of  the  use  of  System  Identification  (SI)  for  modeling  sEMG- 
Finger  Force  relation  in  the  pursuit  of  improving  the  control  of  prosthetic  hands.  Finger  force  and  sEMG  data 
is  generated  by  having  the  subject  perform  a  number  of  random  motions  of  the  ring  finger  to  simulate  various 
force  levels.  Post-processing  of  the  sEMG  signal  is  performed  using  spatial  filtering.  The  linear  and  nonlinear 
spatial  filters  are  compared  based  on  the  ‘kurtosis’  improvements  and  also  are  based  on  the  fit  values  of  the 
models  obtained  using  system  identification.  Some  of  the  spatial  filter  masks  are  optimized  using  a  Genetic 
Algorithm  (GA)  for  the  constrained  and  unconstrained  cases.  The  resulting  model  fit  value  is  utilized  to  serve 
as  the  cost  function.  The  results  are  compared  to  the  reported  filter  mask  values  in  the  literature.  The 
unconstrained  GA  based  filter  mask  values  and  in  some  instances  the  constrained  GA  based  mask  values 
performed  better  than  the  filter  masks  reported  in  literature. 


Key-Words:  -  Spatial  Filtering,  System  Identification,  Surface  Electromyogram,  Array  Sensor,  Genetic 
Algorithm,  Hammerstein- Wiener. 


1  Introduction 

In  the  United  States  there  are  approximately  1.7 
million  people  living  with  limb  loss  [1].  It  is 
estimated  that  one  out  of  every  200  people  in  the 
U.S.  has  had  an  amputation  [2].  An  ideal  prosthetic 
hand  has  to  be  dexterous;  easy  to  manufacture,  must 
use  little  power  and  at  the  same  time,  must  be  of  low 
cost.  Building  such  a  prosthetic  hand,  which  can 
mimic  the  entire  gamut  of  motions  and  have  the 
functionality  and  dexterity  of  a  human  hand  exactly, 
has  eluded  researchers  so  far.  One  of  the  main 
strategies  used  in  making  a  prosthetic  hand  “user 
friendly”  is  to  use  the  electromyogram  (EMG) 
signal  to  control  a  prosthetic  device.  An  EMG  signal 
is  a  small  voltage  signal  (in  mV)  which  is  generated 
by  skeletal  muscles.  EMG  is  measured  using  fine 
wire  intramuscular  electrodes,  needle  electrodes,  or 
on  the  surface  of  the  skin  over  the  motor  point  using 
surface  electrodes.  Surface  electrodes  are  quick  and 
easy  to  apply,  do  not  need  medical  supervision, 
cause  minimal  discomfort  and  are  generally  suited 
for  superficial  muscles.  Needle  electrodes  on  the 
other  hand  require  trained  medical  professionals  for 
appropriate  placement  within  the  muscle.  This  paper 
looks  only  at  surface  electromyogram  signals 
(sEMG).  In  the  past,  multiple  methods  have  been 
investigated  for  extracting  useful  information  from 
EMG  signals.  Some  of  these  methods  include 
employing  low-pass  or  band-pass  filtering;  others 
have  also  used  notch  filtering  to  remove  power  line 
noise,  [3].  Whitening  filters  can  increase  the  quality 
of  the  amplitude  estimates  of  the  sEMG  signals,  [4]. 
Other  methods  include  Markov  models,  [5]  and 
fuzzy  logic  control,  [6]  -  for  classification  of  EMG, 


and  wavelet  processing,  [7].  Currently,  the  accepted 
standardized  method  on  how  EMG  signals  must  be 
recorded  and  analyzed  is  set  by  the  International 
Society  of  Electromyography  and  Kinesiology 
(ISEK)  [8].  sEMG  signals  are  influenced  by 
multiple  factors,  some  of  which  are;  a)  shape  of  the 
volume  conductor,  b)  the  thickness  of  the 
subcutaneous  tissue  layers,  c)  tissue 
inhomogeneities,  d)  distribution  of  the  motor  unit 
territories  in  the  muscle,  e)  size  of  the  motor  unit 
territories,  f)  distribution  and  the  number  of  fibers  in 
the  motor  unit  territory,  g)  length  of  the  fibers,  h) 
spread  of  the  endplates  and  tendon  junctions  within 
the  motor  units,  and  i)  spread  of  the  innervations 
zones  and  tendon  regions  among  motor  units.  The 
type  of  detection  system  used  also  plays  an 
important  part  in  influencing  the  sEMG 
measurements.  Some  of  the  factors  which  need  to  be 
taken  into  account,  with  the  detection  systems,  are  a) 
skin  electrode  contact  (impedance,  noise),  b)  spatial 
filtering  for  signal  detection,  c)  inter-electrode 
distance,  d)  electrode  size  and  shape,  and  e) 
inclination  of  the  detection  system  relative  to  the 
muscle  fiber  orientation,  [9]. 

2  Problem  Formulation 

As  multiple  factors  influence  sEMG,  it  is  impossible 
to  account  for  each  of  these  variables  while 
modeling  its  relation  to  the  force  generated.  Also, 
oversimplification  of  the  problem  at  hand  by 
neglecting  some  variables,  which  is  a  widely  used 
common  assumption,  will  cast  doubt  over  the 
usefulness  of  the  results  of  modeling.  Our  approach 
is  to  assume  a  black-box  model  in  order  to  deduce  a 


suitable  relation  or  model  strueture  for  the  two 
signals.  Here,  the  modeling  of  the  sEMG-finger 
foree  relation  is  not  based  on  root-mean-square,  or 
average  values  of  the  sEMG  signal,  henee,  we 
faeilitate  the  eapture  of  the  dynamieal  ehanges  in  the 
foree  levels.  Our  approaeh  of  using  Hammerstein- 
Wiener  models  has  been  found  to  be  of  merit  in  our 
previous  studies  [10,  1 1]  to  yield  satisfaetory  fits. 


3  Problem  Solution 

Spatial  Filtering 

The  data  eolleeted  is  from  a  nine  (3x3)  sensor  array 
and  rather  than  analyzing  the  data  only  at  the  motor 
unit,  we  eonsider  using  spatial  filters.  Spatial 
filtering  is  a  very  attraetive  ehoiee  as  it  ean  be  used 
to  either  amplify  the  signal  at  the  motor  unit  or 
extraet  useful  information  from  the  entire  grid. 
"Spatial  filtering"  is  broadly  defined  as  a  method 
whieh  eomputes  spatial  density  estimates  for  events 
that  have  been  observed  at  individual  loeations. 
These  filters  are  used  when  there  is  no  a  priori  eurve 
to  fit  to  a  data  series.  Instead,  it  relies  on  nearby  or 
adjaeent,  values  to  estimate  the  value  at  a  given 
point.  The  most  eommon  spatial  filters  are  the  low- 
pass  and  high-pass  spatial  filters.  These  are 
foeal  fiinetions  whose  operation  is  determined  by  a 
kernel  or  neighborhood  of  NxN  eells  around  eaeh 
pixel  or  grid  position  [12].  Grid  eells  “eovered”  by  a 
kernel  are  multiplied  by  the  matehing  kernel  entry 
and  then  the  weighted  average  is  ealeulated  and 
assigned  as  the  value  for  the  eentral  eell,  G.  For 
example,  an  asymmetrie  3x3  kernel  may  look  like 
the  one  shown  in  Equation  (1),  or  any  eombination 
of  the  weights.  Typieally  a,  b  are  positive  integers. 
If  a=b=\,  then  the  kernel  provides  a  simple 
smoothing  or  averaging  operation.  Filters  of  this 
type  are  sometimes  referred  to  as  low-pass  filters. 

a  a  a 


Symmetric  Kernel 


aba 


(1) 


a  a 


a 


The  filtered  grid  value  ‘G’  of  an  m=NxN  kernel 
matrix,  with  Q  set  of  eoeffieients  and  Pj  -  set  of 
souree  grid  values,  is  ealeulated  as; 


G  = 


m 

S  c  Pi 

i=\  I  * 
m 

i=\  " 


(2) 


Where,  B  is  often  set  to  0.  5  is  a  bias  term  to 
inerease  or  deerease  the  resulting  value  of  ‘G'.  This 
kernel  is  also  sometimes  referred  to  as  the  'filter 
mask’.  The  linear  spatial  filters  tested  in  this  paper 
are;  1)  Longitudinal  Single  Differential  (LSD),  2) 
Transverse  Single  Differential  (TSD),  3) 
Longitudinal  Double  Differential  (LDD),  4) 
Transverse  Double  Differential  (TDD),  5)  Normal 
Double  Differential  (NDD),  6)  Inverse  Binomial 
(IB2)  and  7)  Inverse  Reetangular  (IR)  Filter.  The 
mask  of  these  filters  and  the  eorresponding  resultant 
equations  on  applieation  of  the  mask  to  the  grid  data 
obtained  from  the  sEMG  array  arrangement  are 
given  below. 


EMG  Array  Information,  Spatial  Filter  Mask 
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0 
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0  0  0 
Result  Equation:  —  sEMG2  +  sEMGl 
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LSD  Equation  =  sEMGl-sEMG2;  TSD  Equation  = 
sEMGl-sEMG5;  we  ean  similarly  deduee  the 
equations  for  the  other  spatial  filters. 
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In  this  paper,  some  nonlinear  spatial  filters  have  also 
been  diseussed,  these  have  been  reported  in  the 
literature  [13],  these  are  1)  1-D  Nonlinear 

Transverse  spatial  filter  (NET),  2)  1-D  Nonlinear 
Longitudinal  spatial  filter  (NLL),  3)  2-D  Nonlinear 
spatial  filter  in  Two-  Orthogonal  Direetions 
(NLTOD)  and  4)  Nonlinear  spatial  filter  in  All  Four 
possible  Direetions  (NLAFD).  The  Nonlinear 
Spatial  Filters  use  the  Teager-Kaiser  Energy  (TKE) 
Operator  [14].  This  teehnique  is  a  threshold  ‘energy’ 
based  approaeh  where  outliers  are  first  deteeted  and 
then  replaeed  by  their  estimated  values.  General 
Form  of  Nonlinear  Spatial  Filter  using  the  Teager- 
Kaiser  (TKE)  operator  is  given  in  equation  (4), 
where  x(n)  denotes  the  loeation  of  the  sensor  in  the 
grid; 

^[x(n)]  =  x^  (n)  -  x(n  +  l)x(n  - 1)  (4) 

a)  1-D  Nonlinear  Transverse  Spatial  Filter  (NET); 
equation  (5) 

2 

'F  j  ^  [x(m,  fz)]  =  X  (m,n)  -  x(m -l,n)x(m (5) 

b)  1-D  Nonlinear  Longitudinal  Spatial  Filter  (NLL); 
equation  (6) 

2 

Tj  ^[x(m,  w)]  =  X  (m,n)  -  x(m,n -l)x(m,n -\-l)  (6) 

c)  Nonlinear  Spatial  Filter  in  Two  Orthogonal 
Directions  (NLTOD);  equation  (7) 


2 

=2x  (m,  n)  -  x(m  -  1,  n)x(m  +  l,n)  -  x(m,  n  -  l)x(m,  n  +  1) 

d)  Nonlinear  Spatial  Filter  in  all  Four  Direetions 
(NLAFD);  equation  (8) 

2 

^ d  4  “  h  n)x(m  +  1,  n) 

-x(m,  n  -  l)x(m,  n  +  \)-  x(m  - 1, 77  +  l)x(m  +  1, 72  - 1) 


-x(m  - 1, 77  -  l)x(777  +  1, 77  +  1) 

The  experiments  were  earned  out  on  a  healthy  male 
subjeet.  The  ring  finger  motor  point  was  loeated 
using  a  Musele  Stimulator,  manufaetured  by  Rieh- 


Mar  Corporation  (model  number  HV  1100).  The 
EMG  deteetion  system  used  was  a  Delsys,  Bagnoli- 
16  ehannel  EMG  (DS-160,  S/N-1116).  The  sensors 
used  for  measuring  the  surfaee  EMG  aetion 
potentials  were  three  pronged  DE  3.1  differential 
surfaee  eleetrodes.  The  material  for  the  eontaets  of 
the  eleetrode  is  99.9%  pure  silver,  the  eontaets  are 
10mm  long,  1mm  in  diameter  and  spaeed  10mm 
apart.  The  subjeets’  skin  was  prepared,  aeeording  to 
the  ISEK  standards,  before  the  sensors  were  plaeed 
over  the  motor  point.  The  eleetrodes  were  plaeed 
along  the  musele  fibers  (Flexor  Digitorum 
Superfieialis)  for  reeording  surfaee  EMG.  The 
referenee  eleetrode  was  plaeed  on  the  elbow  where 
there  is  no  sEMG  signal.  Nine  different  experiments 
were  eondueted  and  the  eorresponding  sEMG  signal 
was  measured  simultaneously  from  all  the  9  sensors. 
The  foree  generated  by  the  subjeet’s  fingers,  for  a 
given  motion,  was  measured  using  a  stress  ball  with 
a  foree  sensitive  resistor  (FSR)  mounted  on  it. 
Figure  1  shows  the  loeation  of  the  FSR  on  the  stress 
ball. 

System  Identification 

Equation  9  deseribes  the  Hammerstein- Wiener 
model  strueture: 

>v(0  =  /((g(0),  =  y{t)  =  h{x{t)),  (9) 

Fj,M) 

where,  w{t)  and  b{t)  are  internal  variables,  w{t)  has 
the  same  dimensions  as  u{t)  -  input,  and  x{t)  has  the 
same  dimensions  as  y{t)  -  output.  g()  and  hQ)  are  the 
input  and  output  non-linearity  funetions 
respeetively.  B{q)  and  F{q)  are  regression 
polynomials. 

Figure  2 A  and  2B  represent  the  Hammerstein- 

Wiener  models  individually  and  their  eombination 

respeetively.  The  model  fit  values  are  eomputed 

using  Equation  (10)  as  follows; 

1— ||j>— (10) 

— inn*  Ir  II  ^ 

j.-j> 

where,  y  is  the  estimated  output  by  the  model. 

The  linear  bloek  is  speeified  using  the  terms  -  the 
number  of  zeros  plus  one,  -  the  number  of  poles 
and  -  the  delay  from  the  input  to  the  output  in 

terms  of  the  number  of  samples.  The  eommonly 
used  nonlinear  estimators  for  Hammerstein- Wiener 
model  are,  a)  Dead  Zone,  b)  Pieeewise  Linear,  e) 
Saturation,  d)  Sigmoid  Network,  and  e)  Wavelet 
Network,  [15]. 

Genetic  Algorithm  (GA) 

Genetie  Algorithm  is  a  elass  of  evolutionary 
methods  for  solving  both  eonstrained  and 
uneonstrained  optimization  problems  that  are  based 
on  natural  seleetion. 


(b) 


Figure  2A:  a)  Hammerstein  model,  b)  Wiener  model 


Input 

u{t\ 


Output 

y{t) 


Figure  2B:  Hammerstein- Wiener  Model  Strueture 

This  is  the  same  rule  that  governs  biologieal 
systems.  In  GA,  the  population  of  individual 
solutions  is  modified  repeatedly.  A  solution  is  given 
by  a  set  of  parameters  (genes)  and  paekaged  as  a 
ehromosome.  Eaeh  step  or  iteration  the  GA  seleets 
individuals  (ehromosomes)  in  a  fashion  that  may 
inelude  some  randomness,  from  a  given  population, 
as  parents,  and  uses  them  to  produee  offspring  for 
the  next  generation.  Over  sueeessive  iterations  or 
generations,  the  population  evolves  and  finally 
reaehes  an  optimal  solution.  The  steps  that  make  up 
GA  are  as  follows: 

1)  Generate  a  random  population  of  ‘p' 
ehromosomes  -  these  ehromosomes  earry 
information  of  the  population  and  are  eonfined  in 
the  feasible  solution  spaee.  2)  Evaluate  the  objeetive 
or  fitness  funetion  /  (p)  for  eaeh  ehromosome.  3) 
Create  a  new  population  or  offspring  from  the  initial 
population  by  using  eertain  rules.  These  rules 
inelude  a)  Seleetion  -  seleetion  of  two  parent 
ehromosomes  from  the  population  aeeording  to  their 
fitness,  b)  Crossover  -  erossover  the  parents  to  form 
new  offspring,  if  no  erossover  is  performed  then  the 
offspring  is  an  exaet  eopy  of  the  parents,  e) 
Mutation  -  involves  the  ehanging  of  a  variable  in  a 
ehromosome  or  some  other  ehange  in  the  original 
ehromosome  as  defined  by  the  user,  d)  Aeeeptanee 
Condition  -  if  offspring  satisfies  the  aeeeptanee 
eondition,  inelude  offspring  in  the  new  population  or 
else  diseard.  4)  Use  the  offspring  as  the  parents  for 
the  generation  of  a  new  population.  5)  Continue 
until  the  end  eondition  is  satisfied.  Figure  4  presents 


a  graphical  interpretation  of  the  steps  in  GA.  In  this 
work,  GA  is  used  to  assist  in  finding  the  optimal 
values  of  the  filter  mask  for  the  filtration  of  the 
sEMG  signal  using  the  various  spatial  filters.  The 
cost  function  that  the  GA  tries  to  minimize,  is  the 
model  fit  obtained  from  system  identification  of  the 
sEMG-force  data  that  was  collected. 


Initial  Population 


Crossover 
Generation  1 


Mutated 
Generation  1 


output  in  terms  of  the  number  of  samples  for  the 
various  Hammerstein- Wiener  models. 


Types  of  Spatial  Filters 


Figure  5:  Kurtosis  plots  of  various  filters  for  exp3  -  y-axis 
numbers  are  for  the  various  filters  1-NLT,  2-NLL,  3-NLTO,  4- 
NLAFD,  5-LSD,  6-TSD,  7-LDD,  8-TDD,  9-NDD,  10-IB2,  11- 
IR 


Figure  4:  General  steps  in  a  binary  genetie  algorithm 

4  Results 

The  results  of  spatially  filtered  data  for  the  linear 
and  the  nonlinear  spatial  filters  were  first  compared 
based  on  the  '‘Kurtosis""  criteria,  [14].  ‘Kurtosis’  is  a 
measure  of  whether  the  data  sets  are  peaked  or  flat 
relative  to  a  normal  distribution.  That  is,  data  sets 
with  high  kurtosis  tend  to  have  a  distinct  peak  near 
the  mean,  decline  rather  rapidly,  and  have  heavy 
tails.  Data  sets  with  low  kurtosis  tend  to  have  a  flat 
top  near  the  mean  rather  than  a  sharp  peak.  A 
uniform  distribution  would  be  the  extreme  case.  The 
mathematical  expression  for  kurtosis  is  given  in 
Equation  1 1 . 

£[x=j’- 

Figure  5  shows  the  plot  obtained  for  the  various 
filters  based  on  the  kurtosis  measure.  The  y-axis  is 
the  kurtosis  improvements  which  is  the  ratio  of  the 
output  to  the  input  kurtosis.  It  is  evident  from  the 
plot  that  the  NET,  NEE,  NLTO  and  the  NLAFD 
spatial  filters  performed  very  well  as  compared  to 
the  linear  spatial  filters  under  investigation.  The  best 
kurtosis  improvements  were  obtained  for  experiment 
4-44  for  the  nonlinear  spatial  filters.  The  x-axis  in 
Figure  5  shows  the  numbers  allotted  to  the  various 
spatial  filters  investigated.  Based  on  these  results  we 
focused  our  attention  to  the  linear  spatial  filter 
masks  for  experiment  3,  which  exhibits  poor 
kurtosis  values.  The  filters  were  compared  based  on 
the  model  fit  values  obtained  from  various 
Hammerstein- Wiener  models.  The  Matlab^  code  for 
the  Hammerstein- Wiener  model  is:  nlhw(ze,  [ n^- 
uj^],  ....,  ...).  The  modeling  was  carried  out  by 
varying  n.  -  the  number  of  zeros  plus  one,  Ur-  the 
number  of  poles  and  -  the  delay  from  input  and 


In  all,  42  models  with  variations  in  and  were 
tested  while  the  value  of  was  kept  as  1 .  The  total 
number  of  models  estimated  were  7  (filter  types)  x  4 
(time  windows)  x  42  models  per  time  window  = 
1,176  models.  The  time  windows  used  for 
estimation  and  validation  of  the  models  were  called 
‘ze  ’  and  ‘zv '  respectively,  ‘ze  ’  contained  8000 
sample  points  and  ‘zv '  contained  data  points  shifted 
by  2000  sample  points.  For  example,  if  ‘ze’  was  a 
time  window  between  2-6  seconds  i.e.  samples 
4000-12000,  then  ‘zv'  was  between  3-7  seconds  i.e. 
6000-14000  samples.  These  models  were  computed 
using  the  filter  masks  available  in  literature.  On 
examining  the  fit  values  closely  we  found  them  to 
have  large  variation  from  one  model  order  to 
another.  One  of  the  reasons  of  this  could  be  due  to 
the  poor  correlation  in  the  estimation  and  validation 
data  sets,  on  account  of  the  large  variations  that 
were  achieved  in  the  force.  This  paper  does  not  list 
all  these  models  tested  but  identifies  and  reports 
only  the  significant  results  of  the  analysis.  We  found 
that  the  filters  tested  performed  poorly  in  the  initial 
time  window  of  2-7  seconds  for  experiment  3.  Some 
of  the  models  for  this  time  window  were  selected 
and  then  recomputed  using  GA  to  optimize  the  filter 
mask  with  the  fitness  function  being  the  fit  value  of 
an  identified  model  achieved  for  a  given  model 
order.  Table  1  shows  an  example  of  the  fits  that 
were  obtained  on  varying  the  parameters  of  the 
Hammerstein- Wiener  model.  The  highlighted 
models  (and  a  few  other  models)  were  selected 
randomly  to  be  optimized  using  GA.  We  had  two 
scenarios  under  GA  -1)  GA  Constrained  and  2)  GA 
-  Unconstrained.  The  first  scenario  GA  constrained 
optimized  only  the  mask  entry  a22  (location  of  the 
sEMG  sensor  on  the  motor  unit).  The  other  entries 
of  the  filter  mask  were  then  computed  from  this 
optimized  value.  In  the  second  scenario,  GA 
unconstrained  we  let  GA  optimize  all  the  entries  for 


various  masks.  The  GA  parameters  for  optimization 
were  as  follows:  number  of  iterations:  50;  initial 


Generation  1:  48;  Number  of  Chromosomes  kept  for 
mating:  24;  and  mutation  rate  was  set  to  4%. 


Model 

Number 

Ha 

Hb 

Hk 

LDD 

LSD 

TDD 

TSD 

NDD 

IB2 

IR 

ml 

2 

3 

1 

31.06 

41.39 

39.53 

-9.685 

45.55 

33.79 

35.38 

m2 

2 

4 

1 

31.86 

17.4 

39.36 

43.19 

36.84 

16.88 

23.89 

m3 

2 

5 

1 

23.54 

35.94 

30.09 

2.247 

39.78 

36.17 

38.16 

m4 

2 

6 

1 

3.266 

41.99 

41.28 

43.46 

10.83 

36.41 

36.7 

m5 

2 

7 

1 

31.58 

40.55 

44.65 

31.28 

2.593 

32.26 

36.34 

m6 

2 

8 

1 

37.84 

4.259 

21.89 

20.08 

8.036 

36.22 

36.57 

m7 

2 

9 

1 

31.42 

-0.1887 

35.78 

28.71 

38.11 

35.54 

35.82 

m8 

3 

3 

1 

36.59 

40.04 

36.17 

12.33 

4.478 

41.09 

35.81 

m9 

3 

4 

1 

20.74 

40.72 

31.53 

36.57 

29.76 

37.43 

38.76 

mlO 

3 

5 

1 

39.87 

11.53 

39.83 

30.24 

39.25 

35.15 

37.9 

! 

! 

; 

j 

! 

; 

! 

! 

! 

! 

m40 

7 

7 

1 

34.91 

10.18 

40.79 

35.21 

35.24 

33.42 

37.92 

m41 

7 

8 

1 

-0.1127 

36.28 

39.68 

40.26 

20.27 

35.88 

24.32 

m42 

7 

9 

1 

36.55 

-0.412 

25.24 

31.31 

35.4 

34.26 

39.82 

Table  1:  Example  of  System  Identifieation  Results  Using  Filter  Mask  from  Literature  -  Highlighted  Models  Optimized 


Longitudinal  Single  Differential  (LSD) 

Fit  % 

From 

Literature 

GA 

Constrained 

GA 

Uneonstrained 

ml 

41.39 

48.9135 

59.8055 

m4 

41.99 

41.5731 

68.4191 

m8 

40.04 

40.5924 

63.8523 

m9 

40.72 

45.2322 

56.5113 

Longitudinal  Double  Differential  (LDD) 

Fit  % 

From 

Literature 

GA 

Constrained 

GA 

Uneonstrained 

ml 

31.06 

42.8291 

61.3475 

m6 

37.84 

53.3134 

33.724 

ml2 

35.54 

44.2513 

51.7942 

m31 

39.44 

47.0034 

60.6489 

Transverse  Single  Differential  (TSD) 

Fit  % 

From 

Literature 

GA 

Constrained 

GA 

Uneonstrained 

m2 

43.19 

44.0017 

65.9038 

m4 

43.46 

43.0529 

58.2755 

mil 

44.24 

39.7867 

44.8431 

m31 

29.1 

43.5787 

47.6688 

Transverse  Double  Differential  (TDD) 

Fit  % 

From 

Literature 

GA 

Constrained 

GA 

Uneonstrained 

ml 

39.53 

41.5297 

59.8055 

m5 

44.65 

49.4667 

68.4191 

mlO 

39.83 

41.307 

63.8523 

ml5 

43.01 

43.3466 

56.5113 

Normal  Double  Differential  (NDD) 

Fit  % 

From 

Literature 

GA 

Constrained 

GA 

Uneonstrained 

ml 

45.55 

53.1512 

57.9496 

m3 

39.87 

47.1084 

60.7374 

m7 

38.11 

51.8065 

60.5535 

mil 

39.01 

46.881 

56.1193 

Inverse  Binomial  2  (IB2) 

Fit  % 

From 

Literature 

GA 

Constrained 

GA 

Uneonstrained 

ml 

33.79 

38.6076 

58.2365 

m3 

36.17 

38.9074 

58.1653 

m4 

36.41 

38.9957 

55.5179 

m8 

41.09 

47.2971 

55.0537 

Table  2:  Results  of  Constrained  and  Uneonstrained  GA  of  Highlighted  Models  from  Table  1 


From  the  results  in  Table  2  we  ean  see  that  the 
optimization  of  the  filter  mask  using  GA  worked  in 
almost  all  the  eases  ehosen.  GA  without  eonstraints 
performed  signifieantly  better,  in  most  eases,  than 
the  filter  masks  reported  in  literature  and  also  the 
mask  whieh  we  eomputed  using  GA,  whieh  only 
optimized  the  entry  (^22)  i.e.  the  weight  assoeiated 
with  the  sEMG  signal  at  the  motor  unit.  This 
restrietion  on  GA  would  leave  the  filter  mask 
symmetrieal.  But  looking  at  the  results  of  the  GA, 
we  ean  eonelude  that  the  filter  mask  need  not  always 
be  symmetrieal  for  analysis  of  sEMG,  espeeially  for 
data  reeorded  using  an  array.  Examples  of  the  filter 
mask  that  we  obtained  for  TDD,  model  m5  and 
NDD,  model  3  spatial  filters  are  given  below: 

"0  -41.5561  0l 


TDD  = 


0 


54.7329 


0 


0  -22  0 

0  -11.5790  0 


NDD  = 


-46.7773 


36.9276 


-11.8061 


0  -70.0491  0 


4  Conclusion 

The  linear  spatial  filter  masks  reported  in  literature 
had  poor  kurtosis  improvements  whieh  we 
optimized  using  GA,  these  were  eompared  based  on 
the  model  fit  values  aehieved  using  Hammerstein- 
Wiener  models.  The  fit  values  did  improve 
signifieantly  in  the  two  GA  seenarios  -  GA  with 
and  without  eonstraints.  The  GA  without  eonstraints 
performed  better  than  the  GA  with  eonstrains, 
whieh  brings  into  foeus  the  possibility  that  the 
sEMG  signal  distribution  over  the  entire  grid  eannot 
be  assumed  to  be  symmetrieally  distributed  and  that 
the  weights  assoeiated  with  the  sEMG  signal  at 
various  loeations  need  to  be  modified  depending  on 
probably  the  subjeet  and  also  based  on  the 
experimental  design.  This  is  in  eontrast  to  the 
reported  filter  mask  in  the  literature,  whieh  are  all 
symmetrie.  Almost  all  the  filter  masks  optimized 
resulted  in  a  signifieant  improvement  over  the 
masks  reported  in  literature. 
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Abstract:  -  Electromyogram  (EMG)  signals  have  been  used  for  control  of  prosthetic  devices  in  the  past. 
However,  most  of  the  control  schemes  currently  used  are  based  on  threshold  values  of  the  EMG  signal  as 
reference  to  actuate  the  prosthetic  hand.  Using  such  a  control  strategy,  it  is  not  possible  to  capture  the 
underlying  dynamics  of  the  relationship  between  EMG  signals  and  the  intended  finger  movements  and  forces. 
We  propose  to  use  system  identification  based  dynamic  models  which  are  extracted  from  recorded  EMG 
signals  and  the  corresponding  finger  forces.  A  key  influence  on  the  resulting  quality  of  such  models  is  the 
filtering  of  the  EMG  signals.  This  paper  presents  a  thorough  analysis  of  spatial  filtering  and  other  filtering 
methods.  The  different  filters  are  compared  on  the  basis  of  the  EMG-finger  force  model  fit  values  obtained 
using  System  Identification  using  various  Non-Linear  Hammerstein-Wiener  models.  The  nonlinear  spatial 
filters  gave  better  fit  values  as  compared  to  the  standard  filtering  techniques. 


Key-Words:  -  Spatial  Filtering,  Hammerstein-Wiener,  Surface  Electromyogram  (sEMG),  System 
Identification,  Sensor  Array,  Modeling. 


1  Introduction 

About  50%  of  the  people  who  need  upper  extremity 
prosthetics  do  not  use  them,  [1].  This  could  be  due 
any  one  of  the  common  following  reasons;  a) 
Dexterity,  b)  Comfort,  c)  Cost.  Despite  advances  in 
the  fields  of  manufacturing,  electronics,  signal 
processing,  sensor  design,  and  our  understanding  of 
biological  signals,  we  still  face  a  huge  challenge 
designing  a  prosthetic  device.  This  is  due  to  the  fact 
that  the  competition  of  such  a  device  is  with  one 
which  nature  has  gifted  us.  A  human  hand  is  without 
doubt  the  best  possible  design.  For  a  prosthetic 
hand,  to  encompass  all  of  the  human  hands  features 
and  capabilities  is  as  of  now  still  a  distant  reality. 
Electromyogram  (EMG)  signals  have  been  used  for 
quite  some  time  now  in  the  control  of  prosthesis. 
The  EMG  signal  is  a  small  voltage  signal  (in  mV), 
generated  by  skeletal  muscles.  This  signal  carries 
information  of  the  objective  the  user  would  like  to 
execute.  Using  surface  EMG  (sEMG)  signals, 
researchers  have  been  able  to  actuate  motors  on 
artificial  prosthetic  devices.  EMG  signals  can  be 
measured  using  intramuscular  electrodes,  needle 
electrodes,  or  by  placing  electrodes  on  the  surface  of 
the  skin.  The  purpose  for  which  the  sEMG  signal  is 
being  recorded  generally  determines  whether  it 
should  be  measured  within  the  muscle  using  needle 
electrodes  or  surface  measurement  using  electrodes 
on  the  skin  would  suffice.  If,  the  purpose  of 
recording  the  EMG  signal  is  to  look  for  diseases 
relating  to  a  particular  muscle,  one  might  be  better 
off  using  needle  electrodes.  On  the  other  hand,  if  it 
is  to  be  used  to  actuate  motors  on  a  prosthetic 


device,  which  a  user  might  want  to  take  off  and 
wear  without  the  need  of  medical  supervision, 
surface  EMG  would  suffice.  Measuring  the  EMG 
signal  on  the  surface  of  the  skin  is  also  less 
uncomfortable.  This  method  is  generally  suited  only 
for  superficial  muscles.  Even  though  recording 
(sEMG)  is  favorable,  it  is  plagued  with  many  issues, 
such  as  crosstalk  from  firing  of  multiple  motor 
points  in  the  vicinity  of  the  recording  location, 
which  can  cause  significant  corruption  of  the  signal 
at  that  site,  motion  artifacts,  and  poor  signal  if  the 
motor  unit  is  not  identified  correctly  etc.  Needle 
electrodes,  on  the  other  hand,  require  trained 
medical  professionals  for  appropriate  placement  of 
the  electrodes  in  the  muscle.  This  paper  investigates 
sEMG  signals  only  with  the  objective  to  extract 
intended  finger  forces.  The  sEMG-force  relationship 
is  modeled  using  Hammerstein-Wiener  models  to 
characterize  the  dynamics.  These  models  are 
required  to  characterize  the  controller  dynamics  for 
sEMG  based  prosthetic  hands.  We  look  to  overcome 
the  crosstalk  issue  in  the  measurement  by  using  an 
array  of  nine  (9)  sEMG  sensors,  and  utilizing  spatial 
filters  to  isolate  and  improve  the  quality  of  the 
signals  at  the  identified  site  for  EMG  recording. 
The  sensor  array  was  placed  on  the  motor  unit 
location,  which  was  identified  for  the  subject  using 
an  external  stimulator.  The  sensors  were  then  placed 
around  the  motor  unit  to  form  a  3x3  square  matrix. 
The  processed  signal  was  then  used  for  identifying 
various  dynamical  models  for  the  prediction  of  the 
force,  from  the  recorded  sEMG  signal,  that  was 
generated  during  various  voluntary  contractions  of 
the  subjects’  hand.  A  comparison  of  the  various 


outcomes  (model  fit  values  computed)  of  the  system 
identification  process,  using  signal  processing 
techniques  stated  in  the  ISEK  [2]  guidelines  and  the 
spatially  filtered  signals  are  presented  in  this  paper. 
The  experiments  were  conducted  for  long  durations, 
in  order  to  analyze  the  effects  of  the  muscle  fatigue 
on  the  model  structures. 

2  Problem  Formulation 

EMG  signal  should  ideally  be  measured  at  a  motor 
unit.  A  motor  unit  (MU)  consists  of  an  a- 
motoneuron  in  the  spinal  cord  and  the  muscle  fiber 
it  innervates.  sEMG  signals  are  influenced  by 
multiple  factors,  some  of  which  are;  a)  shape  of  the 
volume  conductor,  b)  the  thickness  of  the 
subcutaneous  tissue  layers,  c)  tissue 
inhomogeneities,  d)  distribution  of  the  motor  unit 
territories  in  the  muscle,  e)  size  of  the  motor  unit 
territories,  f)  distribution  and  the  number  of  fibers  in 
the  motor  unit  territory,  g)  length  of  the  fibers,  h) 
spread  of  the  endplates  and  tendon  junctions  within 
the  motor  units,  and  i)  spread  of  the  innervations 
zones  and  tendon  regions  among  motor  units.  The 
type  of  detection  system  used  also  plays  an 
important  part  in  influencing  the  sEMG 
measurements.  Some  of  the  factors  which  need  to  be 
taken  into  account,  with  the  detection  systems,  are  a) 
skin  electrode  contact  (impedance,  noise),  b)  spatial 
filtering  for  signal  detection,  c)  inter-electrode 
distance,  d)  electrode  size  and  shape,  and  e) 
inclination  of  the  detection  system  relative  to  the 
muscle  fiber  orientation,  [3].  Since  sEMG  is  plagued 
by  a  multitude  of  issues,  as  pointed  out  in  this 
section,  one  cannot  approach  this  problem 
realistically  by  trying  to  account  for  each  of  the 
variables  in  the  measurement,  nor  oversimplify  the 
problem  at  hand  by  assuming  a  simple  linear  or  a 
non-linear  relation  between  the  sEMG  signal  and  the 
corresponding  finger  force  generated.  Hence  the 
approach  presented  in  this  paper  is  to  assume  a 
black-box  model  in  order  to  deduce  a  suitable 
relation  or  model  structure  for  the  two  signals.  This 
approach  has  been  found  to  be  of  merit  in  our 
previous  studies  and  has  been  been  reported  in  [4]  & 
[5]  to  yield  satisfactory  fits. 

3  Problem  Solution 

"Spatial  filtering"  is  broadly  defined  as  a  method 
which  computes  spatial  density  estimates  for  events 
that  have  been  observed  at  individual  locations. 
These  filters  are  used  when  there  is  no  a  priori  curve 
to  fit  to  a  data  series.  Instead,  it  relies  on  nearby  or 
adjacent  values  to  estimate  the  value  at  a  given 
point.  These  filters  take  out  variability  in  a  data  set 
while  retaining  the  local  features  of  data.  Spatial 
filtering  is  principally  associated  with  digital  image 
processing.  This  method  may  be  applied  to  almost 
any  data  m  the  form  of  a  grid.  The  most  common 
^atial  filters  are  the  low-pass  and  high-pass  spatial 
filters.  These  are  focal  functions  whose  operation  is 
determined  by  a  kernel  or  neighborhood 
of  cells  around  each  pixel  or  grid  position  [6]. 
Grid  cells  ‘‘covered”  by  a  kernel  are  multiplied  by 
the  matching  kernel  entry  and  then  the  weighted 
average  is  calculated  and  assigned  as  the  value  for 
the  central  cell,  G.  For  example,  an  asymmetric  3x3 
kernel  may  look  like  the  one  shown  in  Equation  (1), 


or  any  combination  of  the  weights.  Typically  a,  b 
are  positive  integers.  If  a=b=\,  then  the  kernel 
provides  a  simple  smoothing  or  averaging  operation. 
The  weights  m  the  kernel  can  be  modified  for 
specific  cases  or  data  sets.  In  any  case  the  weighted 
average  is  divided  by  the  sum  of  the  elements  of  the 
kernel.  Filters  of  this  type  are  sometimes  referred  to 
as  low-pass  filters. 


Symmetric  Kernel  =  a  b  a  .  (1) 

a  a  a 

If  the  weights  in  the  kernel  is  similar  to  the  one  in 
Equation  (2)  and  a,  b,  c  are  positive  integers,  and  if 
the  following,  b>a>c,  is  true,  then  the  kernel  is 
described  as  a  Gaussian  filter  which  is  symmetric 
but  center-weighted. 

c  a  c 

Symmetric  Kernel  =  a  b  a  .  (^) 

c  a  c 

The  filtered  grid  value  ‘G’  of  an  m=NxN  kernel 
matrix,  with  Q  set  of  coefficients  and  Pi  -  set  of 
source  grid  values,  is  calculated  as: 

m 

^  i=\  I  ^  (3) 


where  B  is  often  set  to  0.  5  is  a  bias  term  to  increase 
or  decrease  the  resulting  value  of  ‘G'.  This  kernel  is 
also  sometimes  referred  to  as  the  'filter  mask’. 
Linear  Spatial  Filtering:  Linear  spatial  filtering 
would  modify  the  sEMG  array  data  j  by  replacing 
the  value  at  each  location  with  a  linear  function  of 


the  values  of  nearby  data  points.  Moreover,  this 
linear  function  is  assumed  to  be  independent  of  the 
data  point  locations  (k,  /),  where  (k,  1)  are  the  indices 
of  the  data  points  in  fi  which  is  represented  by  a 
composite  data  matrix.  This  kind  of  operation  can  be 
expressed  as  convolution  or  correlation.  For  spatial 
filtering,  ifs  often  more  intuitive  to  work  with 
correlation.  The  filtered  result  g(k,  1)  is  obtained  by 
centering  the  mask  over  pixel  {k,  1)  and  multiplying 
the  elements  of  /  with  the  overlapping  elements  of 
the  mask  and  then  adding  them  up.  In  other  words, 
the  objective  is  to  amplify  the  activity  of  motor 
unit/s  located  closest  to  the  recording  site  (ideally 
the  actual  motor  location  for  the  particular  finger) 
and  reducing  the  EMG  signal  generated  by  other 
motor  units  located  further  away  or  motor  nits  of 
other  fingers.  The  selectivity  of  surface  EMG 
recordings  can  be  increased  by  reducing  the 
electrode  size  (i.e.,  skin-electrode  contact  area  or 
inter-electrode  distance)  [7]  and/or  by  applying 
temporal  filters  [8].  More  recent  work  has  focused 
on  advances  in  the  design  of  surface  electrode  arrays 
[9-10]  to  extract  single  motor  unit  information  from 
sEMG.  A  large  number  of  traditional  [11-13]  and 
adaptive  [14]  linear  spatial  filters  have  been 
extensively  used  to  glean  more  information  out  of 
sEMG  signals  and  to  understand  it  much  better. 

For  this  paper,  the  experiments  were  carried  out  on  a 
healthy  male  subject  to  extract  dynamical  models 
describing  the  relationship  between  sEMG-force 
signals.  The  motor  points  were  located  using  a 
Muscle  Stimulator,  manufactured  by  Rich-Mar 
Corporation  (model  number  HV  1100).  The  motor 


location  of  the  ring  finger  was  chosen  for  the 
experiments.  The  EMG  detection  system  used  was  a 
Delsys,  Bagnoli-16  channel  EMG  (DS-160,  S/N- 
1116).  The  sensors  used  for  measuring  the  sEMG 
action  potentials  were  three  pronged  DE  3.1 
differential  surface  electrodes.  The  subjects’  skin 
was  prepared,  according  to  the  ISEK  standards, 
before  the  sensors  were  placed  over  the  motor  point. 
The  electrodes  were  placed  along  the  muscle  fibers 
(Flexor  Digitorum  Superficiahs)  for  recording 
sEMG.  Multiple  sEMG  sensors  in  an  array 
configuration  were  mounted  on  and  around  the 
identified  motor  unit,  as  shown  in  Figure  1.  The 
subjects’  hand  was  placed  on  a  fiat  surface;  the 
reference  electrode  was  placed  on  the  elbow  where 
there  is  no  sEMG  signal.  Sensor  CHI  was  placed  on 
the  identified  motor  unit  location.  CH2  and  CH3 
were  placed  along  the  muscle  fiber  in  front  and 
behind  CHI  respectively.  Channels  4-9  were  placed 
in  the  orientation  as  shown  in  Figure  1.  Nine 
different  experiments  were  conducted  and  the 
corresponding  sEMG  signal  was  measured 
simultaneously  from  all  the  nine  sensors.  The  force 
generated  by  the  sulhect’s  fingers,  for  a  given 
motion,  was  measured  using  a  stress  ball  with  a 
force  sensitive  resistor  (FSR)  mounted  on  it. 


Figure  1:  Experimental  Setup  -  Loeation  of  sEMG  sensors 


The  change  in  the  resistance  of  the  FSR  is  directly 
proportional  to  the  force  being  applied.  Figure  2 
shows  the  location  of  the  FSR  on  the  stress  ball. 
Experiments  1  and  2  were  used  to  check  for  any 
spurious  signals  that  might  be  recorded  due  to  the 
slight  angle  at  which  the  subjects’  hand  was  held. 
Experiments  3  to  6  were  done  using  a  stress  ball 
with  a  lesser  stiffness  as  compared  to  experiments  7, 
8&9. 


Figure  2:  Force  sensitive  Resistor  and  Thumb  Restrain 


Also,  a  thumb  restrain  was  used  for  experiments  5-9. 
The  thumb  restrain  is  showed  in  the  Figure  2.  The 
stress  ball  was  changed  as  we  were  also  interested  in 
looking  at  the  change  in  the  sEMG  signal  when 
fatigue  occurs,  and  also  how  it  would  affect  the 


modeling  for  the  relation  between  force-sEMG 
using  System  Identification  (SI). 

The  linear  spatial  filters  tested  in  this  paper  for 
isolating  the  motor  unit  action  potentials  (MUAPsI 
are;  1)  Longitudinal  Single  Differential  (LSD),  2) 
Transverse  Single  Differential  (TSD),  3) 
Longitudinal  Double  Differential  (LDD),  4) 
Transverse  Double  Differential  (TDD),  5)  Normal 
Double  Differential  (NDD),  6)  Inverse  Binomial 
(IB2)  and  7)  Inverse  Rectangular  (IR)  Filter.  The 
mask  of  these  filters  and  the  corresponding  resultant 
equations  on  application  of  the  mask  to  the  grid  data 
obtained  from  the  sEMG  array  arrangement  are 
given  below. 

EMG  Array  Information,  Spatial  Filter  Mask 
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LSD  Equation  =  sEMGl-sEMG2;  TSD  Equation  = 
sEMGl-sEMG5.  We  can  similarly  deduce  the 
equations  for  the  other  spatial  filters. 
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In  this  paper,  nonlinear  spatial  filters  have  also  been 
discussed  these  have  been  reported  in  literature  [15]. 
These  are  1)  1-D  Nonlinear  Transverse  spatial  filter 
(NET),  2)  1-D  Nonlinear  Longitudinal  spatial  filter 
(NLL),  3)  2-D  Nonlinear  spatial  filter  in  Two- 
Orthogonal  Directions  (NLTOD)  and  4)  Nonlinear 
spatial  filter  in  All  Four  possible  Directions 
(NLAFD).  The  nonlinear  spatial  filters  use  the 
Teager-Kaiser  Energy  (TKE)  Operator,  [16].  This 
technique  is  a  threshold  ‘energy’  based  approach 
where  outliers  are  first  detected  and  then  replaced  by 
their  estimated  values.  The  nonlinear  spatial  filters 
with  the  TKE  operator  incorporated  are  given  as 
follows;  The  general  form  of  nonlinear  spatial  filter 
using  the  (TKE)  operator  is  given  in  Equation  (4); 

=  (ji)  — x(ji  +  \)x{n-\)  (4) 

a)  1-D  Nonlinear  Transverse  Spatial  Filter  (NET); 
Equation  (5) 

2 

'F  j  ^  [x(m,  fz)]  =  X  {m,n)  -  x{m -\,n)x{m +  \,n)  (5) 

b)  1-D  Nonlinear  Longitudinal  Spatial  Filter  (NLL); 
Equation  (6) 

2 

Tj  ^[x(m,  w)]  =  X  (m,  w)  -  x(w,  w  - l)x(m,  w  +  1)  (6) 

c)  Nonlinear  Spatial  Filter  in  Two  Orthogonal 
Directions  (NLTOD):  Equation  (7) 


(10) 


W"*’  ”)]  =  '^d,2m  W"*’  ”)]  +  '^d,n  ”)]  (7) 

2 

=2x  (m,  -  x(w  -  1,  n)x(m  +  1,  ^)  -  x(m,  n  -  l)x(w,  ^  +  1) 

d)  Nonlinear  Spatial  Filter  in  all  Four  Direetions 
(NLAFD):  Equation  (8) 

2 

^ d  A  ~  ~  n)x{m  +  1,  ^2) 

(8) 

-x(m,  n  -  l)x(m,  27  +  1)  -  x{m  -  1, 22  +  l)x(222  +  1, 22  -  1) 

-x(272  -  1,  22  -  \)x(m  +  1,  22  +  1) 

4  Simulation  Results 

Plots  of  the  raw  data  gathered  are  shown  in  Figure  3. 
The  plots  shown  in  Figure  3  represent  the  raw  data 
eolleeted  from  three  ehannels  of  the  grid,  Channels 
1,4&5. 

(CHI) 


Samples  - ^ 


Figure  3:  sEMG  Raw  Signal  Channels  1,  4  and  5 

The  data  shown  above  is  for  eomparison  of  the 
sEMG  obtained  from  various  loeation  of  the 
subjeet’s  arm.  Notiee  the  ehange  espeeially  in  the 
amplitude  of  the  sEMG  at  Channel  1,  4  &  5.  Figure 
4  shows  the  plot  of  the  filtered  sEMG  using  the 
various  spatial  filters.  In  addition  to  these  1 1  spatial 
filters,  the  sEMG  data  was  also  filtered  using  4  other 
filters  -  Bessel,  Butterworth,  Chebyshev  Type  I  and 
Chebyshev  Type  II  filters.  The  filter  eharaeteristies 
of  these  4  filters  were  in  aeeordanee  to  the  ISEK 
standards.  The  relation  of  sEMG-Foree  was 
modeled  using  Non-Linear  Hammerstein- Wiener 
models.  This  modeling  method  has  been  proven  to 
work  in  the  past  [4],  [5]  in  assuming  a  blaek-box 
model  strueture  for  the  system.  In  order  to  model  the 
sEMG-Foree  relation,  the  filtered  data  from  the 
various  experiments  was  split  into  various  four  (4) 
time  windows. 

Equation  9  deseribes  the  general  Hammerstein- 
Wiener  model  strueture: 

<t)  =  f({g{t)),  6(0  =  4^w(0,  y(t)  =  h(x(t)\  (9) 

where,  w{t)  and  b{t)  are  internal  variables,  w{t)  has 
the  same  dimensions  as  u{t)  -  input,  and  x{t)  has  the 
same  dimensions  as3;(^)  -  output.  g()  and  /z()  are  the 
input  and  output  non-linearity  funetions 
respeetively.  B(q)  and  F(q)  are  regression 
polynomials.  The  model  fit  values  are  eomputed 
using  Equation  (10) 


as  follows; 
fit  =  100^ 

where,  y  is  the  estimated  output  by  the  model. 
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Figure  4:  Spatially  Filtered  sEMG  at  Motor  unit  Ring  Finger  a) 
NET,  b)  NEE,  e)  NETOD,  d)  NEAFD,  e)  ESD,  f)  TSD,  g) 
FDD,  h)  TDD,  i)  NDD,  j)  IB2,  k)  IR 

The  time  windows  used  for  estimation  and 
validation  of  the  models  were  ealled  ‘ze’  and  ‘zv' 
respeetively.  ‘ze  ’  eontained  8000  sample  points  and 
‘zv'  eontained  data  points  shifted  by  2000  sample 
points.  For  example,  if  ‘ze’  was  a  time  window 
between  2-6  seeonds  i.e.  samples  4000-12000,  then 
‘zv'  was  between  3-7  seeonds  i.e.  6000-14000 
samples.  Thus  the  Hammerstein- Wiener  method 
uses  ‘ze  ’  to  estimate  the  model  strueture  and  based 
on  this  information  prediets  the  next  2000  sample 
points.  The  data  was  filtered  using  the  various  filters 
mentioned  in  the  previous  seetions.  We  would  like 
to  stress  onee  again  the  point  that  the  foree  was 
varied  randomly  and  the  subjeet  was  in  no  way 
trying  to  aehieve  maximum  voluntary  eontraetions 
during  eaeh  eyele.  A  eyele  is  defined  as  the  subjeet 
starting  without  any  foree  on  the  stress  ball, 
squeezing  it  (to  any  foree  level)  and  then  going  baek 
to  no  foree.  The  subjeet  has  to  keep  the  finger  in 
eontaet  with  the  foree  ball  throughout  this  eyele. 


A  plot  of  the  variations  in  force  achieved  for  3 
experiments  is  shown  in  Figure  5.  The  Matlab™ 
code  for  the  Hammerstein- Wiener  model  is: 
nlhw(ze,  ...)•  The  modeling  was 

carried  out  by  varying  n  -  the  number  of  past  output 
terms  used  to  predict  the  current  output,  ni  -  the 
number  of  past  input  terms  used  to  predict  the 
current  output  and  the  delay  from  input  and 
output  in  terms  of  the  number  of  samples  for  the 
various  Hammerstein- Wiener  models. 


Figure  5:  Force  levels  experiment  3  (blue),  5 (red)  &  7(green) 


the  later  time  windows.  This  case  was  especially 
interesting  as  the  subject  had  fatigued  due  to  the 
repetitive  experiments,  but  the  Hammerstein- Wiener 
models  did  successfully  capture  the  variations  in  the 
sEMG  signal.  The  Hammerstein- Wiener  models 
performed  very  well  and  we  obtained  fit  values  in 
the  high  sixties. 


Figure  7:  Measured  data  (black)  a)  Bessel  (blue)  56.36%  and  b) 
NLTO  (red)  60.13%  for  exp  3  time  window  2-7seconds. 


42  models  with  variations  in  and  were  tested 
while  the  value  of  nj^  was  kept  as  1.  The  total 
number  of  models  estimated  were  15  (filter  types)  x 
4  (time  windows)  x  42  models  per  time  window  x  4 
experiments  =  10,080  models.  This  paper  does  not 
list  all  these  models  but  identifies  and  reports  only 
the  significant  results  of  the  analysis. 
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Figure  6:  Fit  %  for  Hammer  stein- Wiener  Models  -  Using 
Bessel  and  NLTO  Filters  (time  window  2-7  sec,  exp3) 


Figure  8  shows  the  model  fit  values  obtained  for 
these  later  data  windows.  As  can  be  seen  from  the 
plots,  contrary  to  our  expectations  the  Hammerstein- 
Wiener  Models  performed  very  well  and  produced 
very  good  fit  values. 
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■  NLTO 

■  NLT 

■  TDD 
K  NDD 

■  NLAFD 


Figure  8:  Fit  Values  Obtained  for  Different  Hammerstein- 
Wiener  Models  -  Bessel,  NLTO  NLT,  TDD,  NDD,  NLAFD 
Filters  (time  window  20-25  sec,  exp5) 


As  an  example,  for  experiment  3,  for  time  window 
of  2-7  sec,  the  fit  values  obtained  by  varying 
between  2-7  and  between  3-9,  are  shown  in 
Figure  6.  The  fit  values  ranged  from  33-56%  for  the 
Bessel  filter  and  from  20-60%  for  the  NLTO  filter. 
The  best  values  obtained  for  this  time  window  were 
56.36%  and  60.13%  by  the  Bessel  and  the  NLTO 
filters  respectively.  The  model  output  plot  for  these 
values  is  shown  in  Figure  7.  The  large  variation  in 
the  model  fit  values  can  be  attributed  to  the  fact  that 
the  two  data  sets  have  poor  correlation  between  one 
another.  The  other  filters  used  also  predict  the  future 
variations  in  force  but  the  fit  percentages  were  in  the 
range  of  30-48%.  A  key  objective  of  this  research  is 
help  develop  a  control  regime  which  in  not  based  on 
threshold  values  of  force  can  incorporate  the 
dynamics  in  the  force.  This  would  help  to  control 
the  response  of  the  artificial  limb  to  be  closer  to  that 
of  the  actual  hand.  Similarly  we  tested  various 
models  for  the  other  experiments  too.  Another  set  of 
results  which  gave  very  high  values  of  fit  was  for 


Figure  9  shows  the  model  output  plots  for  some  of 
the  filters  mentioned  in  Figure  8. 


Figure  9:  Measured  Data  Black  -  a)  TDD  (70.28%),  b)  NDD 
(68.09%),  c)  NLT  (68.26%),  d)  NLAFD  (72.16%),  Filters 


4  Conclusion 

The  Hammerstein- Wiener  models  worked  very  well 
in  eapturing  the  dynamies  of  the  foree  levels  for  the 
various  experiments  eondueted.  This  method  of 
modeling  eould  help  in  improving  the  eontrol  over 
the  motors  used  in  prosthetie  deviees  to  mimie  the 
aetual  ehanges  foree  levels  in  a  real  hand.  This 
method  also  performed  very  well  in  the  seenarios 
where  the  subjeet  did  fatigue  but  the  affeets  were 
sueeessfully  modeled  by  the  Hammerstein-Wiener 
models.  The  nonlinear  and  linear  spatial  filters 
(TDD,  NDD  and  NLT,  NLTO  and  NLAFD)  did 
outperform  the  other  filtering  methods  used 
espeeially  for  the  later  time  windows.  The  only 
other  filter  whieh  had  a  eomparable  performanee  to 
the  spatial  filters  was  the  Bessel  filter.  Further 
investigation  into  redueing  the  wide  range  of  the  fit 
values  obtained  needs  to  be  performed.  One  of  the 
possible  methods  to  pursue  would  be  to  use  Genetie 
Algorithm  to  optimize  the  model  parameters  and 

and  also  the  number  of  iterations  used  for  the 

modeling  of  sEMG-foree  levels.  One  of  the  possible 
reasons  for  poor  fit  values  eould  also  be  attributed 
to  the  model  trying  to  over- fit  the  data  sets. 
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Abstract:  -  This  paper  presents  a  novel  approach  to  control  the  motion  of  a  smart  prosthesis  using  surface 
electromyographic  (sEMG)  signals.  Currently,  all  sEMG  based  prosthetic  hands  are  controlled  based  on  pre¬ 
programmed  motion  sets,  which  are  initiated  when  some  threshold  value  of  the  measured  sEMG  signal  is 
reached.  In  this  paper,  we  present  an  approach  that  utilizes  System  Identification  (SI)  in  order  to  obtain  a 
dynamic  finger  angle  model.  Such  a  model  allows  for  instantaneous  control  for  the  finger  motions.  The 
algorithm  presented  relays  on  an  array  of  nine  sEMG  sensors.  The  sEMG  and  angle  data  is  filtered  using  a 
nonlinear  Teager-Kaiser  Energy  (TKE)  operator  based  nonlinear  spatial  filter  and  a  Chebyshev  type-II  filter 
respectively.  The  filtered  signals  are  smoothed  using  a  smoothing  spline  curve  fitting.  The  smoothed  sEMG 
data  is  used  as  input  and  the  respective  smoothed  finger  angle  data  is  used  as  output  for  a  system  identification 
routine  to  obtain  multiple  linear  and  nonlinear  models.  To  achieve  better  estimates  of  the  finger  angles,  an 
adaptive  probabilistic  Kullback  Information  Criterion  (KIC)  for  model  selection  based  data  fusion  algorithm  is 
applied  to  the  linear  and  nonlinear  model’s  outputs.  Final  fusion  based  output  of  this  approach  results  in 
improved  estimates  of  finger  angles. 

Key-Words:  -  sEMG,  Prosthetics,  System  Identification,  Teager-Kaiser  Energy  operator,  KIC. 

1  Introduction  surface  or  by  needle  electrodes  that  are  injected 

The  United  States  had  1.6  million  people  with  the  subjects  arm.  Choosing  the  sEMG  as  a 

amputations  during  2005,  [1].  This  number  is  control  input  eliminates  the  problems  associated 
continuously  on  increase  due  to  the  ongoing  wars  in  surgeries  and  regular  hygiene  for  the  user  of 

Afghanistan  and  Iraq,  [2].  Hence,  one  of  the  prime  implanted  electrodes.  sEMG  signal  amplitudes 

reasons  for  the  enlarged  attention  in  the  field  of  range  between  -5  and  +5  [mV].  The  sEMG  signal 

prosthetic  is  to  facilitate  the  increased  demand  for  changes  with  different  limb  movements  and  applied 

efficiently  and  highly  dexterous  prosthesis.  Because  forces.  This  justifies  the  use  of  sEMG  signals  for  the 

of  the  lack  of  tactile  or  proprioceptive  feedback  for  position  and  force  control  of  prosthesis.  Current 

grasping  in  prosthesis,  almost  30-50%  of  the  upper  prosthetics  using  EMG  or  sEMG  sensors  utilize  this 

extremity  amputees  choose  not  to  use  their  computing  some  threshold  value  -  for 

prosthetic  hand  on  regular  bases  [3,  4].  The  control  example  the  RMS  value  -  to  activate  a  pre- 

of  a  prosthetic  plays  a  key  role  in  the  usefulness  and  programmed  mofion  and/or  force  set  of  the  artificial 

ultimately  in  the  acceptance  of  the  device  by  a  user.  hand.  The  resulting  motion  is  only  initiated  by  the 

Since  full  dexterity  is  still  out  of  reach  for  current  user,  but  not  controlled  thereafter.  This  is  quite 

prosthetics,  the  precision  and  effectiveness  of  a  different  than  what  a  healthy  subject  uses  to  control 

prosthetics  takes  on  greater  value.  The  controller  his/her  hand.  For  non-amputees,  the  motion  of  the 

implemented  must  be  capable  of  regulating  the  Angers  is  controlled  at  every  instance,  which  allows 

intended  finger  forces  and  finger  motion  of  the  complex  motion  sets  to  be  executed.  To  mimic 

artificial  hand.  The  reference  value  for  these  outputs  characteristic,  we  propose  to  use  dynamic 

is  given  by  the  amputee’s  mind/intention,  expressed  models  relating  sEMG  data  with  finger  motion.  The 

by  the  generated  surface  electromyographic  (sEMG)  potential  of  such  models  is  obvious  from  the 

signal  of  the  remaining  skeletal  arm  muscles.  In  this  operational  point  of  view,  but  also  allows  the 

work,  we  assume  that  the  amputation  is  transradial,  incorporation  of  muscle  fatigue  dynamics  to  be 

and  hence  sufficient  muscle  mass  is  accessible  for  included  in  the  control  algorithm  [9-13]. 

sEMG  data  acquisition.  EMG  can  be  measured  on 


Previous  research  works  give  different  methods 
to  extract  the  information  from  the  sEMG  signals 
[5].  These  methods  use  wavelet  analysis,  artificial 
neural  networks,  and  other  feature  extraction 
methods  to  make  use  of  sEMG  for  prosthetic  control 
[5].  Research  work  as  reported  in  [6]  presents 
sEMG  as  an  autoregressive  (AR)  model  with  the 
delayed  intramuscular  EMG  signal  as  the  input.  In 
our  work,  we  rely  only  on  sEMG  since  no  injected 
electrodes  will  be  used  to  obtain  EMG  signals. 
Hence  the  task  is  to  develop  a  model  and  an 
estimation  scheme  for  describing  the  dynamics  of 
the  skeletal  muscle  force  and  finger  angles  from  the 
sEMG  signals.  Some  of  the  recent  efforts  in  this 
direction  are  evident  in  the  research  work  of  [7-13]. 

Present  research  focus  on  the  dynamic  modeling 
and  estimation  of  the  angles  of  the  proximal 
interphalangeal  (PIP)  joint  of  the  index  finger  with 
the  corresponding  sEMG  signal.  An  array  of  nine 
sEMG  sensors  is  used  to  record  sEMG  signals  and 
joint  angles  are  recorded  using  a  wheel 
potentiometer  from  the  arm  of  a  healthy  subject, 
which  respectively  is  explained  in  detail  in  Section  2 
and  3.  Both  the  signals  are  filtered  and  smoothing 
spline  curve  fitted  with  0.993  as  smoothing 
parameter.  The  dynamic  modeling  is  achieved  using 
the  approach  of  System  Identification  (SI)  where 
smoothed  sEMG  data  is  the  input  and  the  smoothed 
joint  angle  data  is  the  output.  Multiple  linear  and 
nonlinear  models  are  obtained.  To  achieve  better 
estimate  of  the  finger  angles,  an  adaptive 
probabilistic  Kullback  Information  Criterion  (KIC) 
for  model  selection  based  data  fusion  algorithm  is 
applied  to  the  linear  and  nonlinear  models  outputs. 
Final  fusion  based  output  of  this  approach  results  in 
improved  estimates  of  finger  angles. 

2  Experimental  Set-Up 

An  experimental  set-up  is  designed  to 
simultaneously  acquire  the  sEMG  from  the  motor 
point  of  the  index  finger  and  the  joint  angle  of  the 
PIP  joint  of  the  index  finger.  Nine  DE-3.1  sEMG 
sensors  of  the  DELSYS®  Bagnoli-16  EMG  system 
are  placed  in  a  three-by-three  array  [14];  the 
arrangement  covers  the  four  directional  spatial 
distributions  of  the  sEMG  signal.  The  middle  three 
sEMG  sensors  were  attached  directly  on  the  skin 
surface  above  the  motor  point  of  the  index  finger  of 
a  healthy  subject.  Using  a  lOk-Ohm  wheel 
potentiometer,  an  angle  measurement  device  is 
designed  to  measure  the  joint  angles  of  the  PIP  joint 
of  the  index  finger  of  a  healthy  subject.  Appropriate 
sEMG  electrode  attachment  point  for  the  motor 
point  of  the  index  finger  was  identified  using  a  wet 


probe  muscle  stimulator  at  the  EDS  (RICH-MAR, 
HV  1000). 


Fig.  1:  Experimental  Set-Up. 


Prior  to  placing  the  sEMG  sensors,  the  skin 
surface  of  the  subject  was  prepared  according  to 
International  Society  of  Electrophysiology  and 
Kinesiology  (ISEK)  protocols.  An  Interlink 
Electronics  FSR  0.5”  circular  force  sensor  on  a 
stress  ball  is  used  to  press  with  the  movement  to 
introduce  some  resistance  to  the  movement  of  the 
PIP  joint  of  the  index  finger.  Experimental  set-up  is 
shown  in  Fig.  1  where  nine  sensors  are  shown  on  a 
healthy  subject  forearm,  with  an  angle  measurement 
device  on  the  PIP  joint  of  the  index  finger  and 
having  a  stress  ball  for  force  measurements.  The 
various  signals  are  sampled  at  a  rate  of  2000  Hz 
using  Lab  VIEW™  in  conjunction  with  DELSYS® 
Bagnoli-16  EMG  and  NI  ELVIS™.  With  this 
experimental  set-up  we  conducted  several 
experiments  of  30  seconds,  45  seconds  and  60 
seconds  durations. 

3  Signal  Pre-Processing 

The  recorded  sEMG  signal  for  the  index  finger  is 
filtered  using  nonlinear  spatial  filtering  for  nine 
channel  surface  EMG.  The  nonlinear  spatial  filter  is 
obtained  from  the  “Nonlinear  Teager-Kaiser  Energy 
(TKE)  Operator,”  [14].  Equation  (1)  gives  the  TKE 
operator  in  the  time  domain  on  sEMG  signal  [14]. 

T^[x(n)]  =  x^(n)  -  x(n  +  1)  *  x(n  -  1).  (1) 

Here,  is  the  TKE  operator  and  x(n)  is  the  time 
domain  sEMG  signal  at  location  n.  The  four- 
directional  nonlinear  spatial  filter  can  be  derived 
from  the  TKE  operator.  Equation  (2)  gives  the  four- 
directional  nonlinear  spatial  filter. 

T^^  4[x(m;n)]  =  4  *  x^(m,7i)  —  x(m  -  l,n)  * 
x(m  +  l,n)  —  x(m,  n  -  1)  *  x(m,  n  +  1)  - 
x(m  -  1,  n  +  1)  *  x(m  +  1,  n  -  1)  -  x(m  -  1,  n  - 
1)  *  x(m  +  l,n  +  1).  (2) 


Index  Finger  Raw  sEMG  at  Motor  Point 


ill  111  ii 

ikiiii 

Wftfl 

Wlf 

|ffW| 

2 

4-Dire( 

:tional  Spatiall; 

6  1 

y  Filtered  9-sEM( 

3 

J  Sensor  Array 

10  1: 

Signal 

2 

xio'' 

iiiiiii.i 

iiyiii 

liiiiL 

iiiJjJiii 

ijillii. 

Uiiiii 

2  4  6  8  10  12 

Time 


Fig.  2:  Raw  and  Spatially  Filtered  sEMG  Signal 
from  Index  Finger. 
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Fig.  3:  Raw  and  Chebyshev  Type  II  Filtered  PIP 
Joint  Angle  for  Index  Finger. 


Fig.  2  shows  a  eomparison  between  the  measured 
and  nonlinear  spatial  filtered  sEMG  signals.  A 
Chebyshev  type  II  infinite  impulse  response  (HR) 
low  pass  filter  with  a  550  Hz  pass  band  frequeney  is 
used  to  filter  the  PIP  joint  angle  data.  Fig.  3  shows 
the  eomparison  between  the  measured  and 
Chebyshev  type  II  filtered  skeletal  musele  foree 
signal. 


4  Smoothing  Spline  Curve  Fitting 

Any  data  ean  be  eurve  or  surfaee  fitted  using  the 
MATLAB®  Curve  Fitting  Toolbox™  [15]. 
Smoothing  spline  whieh  is  a  pieeewise  polynomial 
eomputed  from  a  smoothing  parameter  (p)  of  0.993 
is  fitted  to  the  filtered  sEMG  and  angle  data. 
Smoothing  parameter  (p)  is  a  number  between  0 
and  1 .  Change  in  the  value  of  p  from  0  to  1  results 
in  the  ehange  in  smoothing  spline.  For  p  =  0  the 
smoothing  spline  is  a  least-square  straight-line 
approximation  to  the  data,  whereas  for  p  =  1  it 
gives  the  "natural"  eubie  spline  interpolant  to  the 
data  [15]. 

For  the  speeified  weight  (Wj)  and  smoothing 
parameter  (p)  a  smoothing  spline  s  is  formed 
whieh  minimizes  the  parameter  J  given  by  Equation 
(3). 


7  =  p  Ei  Wj(yj  -  s(Xj))2  +  (1  -  p)  J 

(3) 

where  and  are  predietor  and  response  data 
respeetively.  The  smoothing  parameter  p  should  be 
ehosen  to  make  the  error  £(5)  =  ^i(yi  ~ 

s 

and  roughness  J(^^)^dx  small.  Here  in  this  work 
the  smoothing  parameter  p  is  ehosen  as  0.993  [15]. 

5  System  Identification 

System  Identifieation  (SI)  is  a  tool  to  model  a 
dynamie  system  based  on  input-output  data  [16].  In 
this  researeh,  we  use  the  SI  to  model  two  signals 
whieh  are  smoothing  spline  eurve  fitted.  The  sEMG 
is  the  input  to  the  system  and  the  intended  PIP  joint 
angle  is  the  output.  Multiple  linear  and  nonlinear 
models  are  obtained  for  modeling  of  sEMG  and  PIP 
joint  angle  signals  for  the  index  finger  of  the 
dominant  hand  of  a  healthy  subjeet.  Five  linear  and 
three  nonlinear  models  are  obtained  for  the  input 
and  output  data  set.  Table  I  and  II  gives  the 
struetures  of  the  linear  and  nonlinear  models 
respeetively. 

The  model  order  of  the  various  models  used  in 
this  work  are  as  follows:  linear  models  for  the  input 
and  output  data  set,  OE  model  of  order  16,  ARX 
model  of  order  18,  ARMAX  model  of  model  order 
16,  State-Spaee  model  with  subspaee  method 
(N4SID)  of  order  18  and  a  State-Spaee  model  with 
predietion  error/maximum  likelihood  method  (PEM) 
of  order  12  are  obtained  using  SI.  Table  I  gives  the 
strueture  of  all  the  linear  models.  In  table  I  y  is 
output,  t  is  time,  6(c?),  F(q),  A(q),  C(q),  D(q), 
are  polynomials,  q  is  a  baekward  shift  operator,  u  is 
input,  is  delay  and  e  is  error  [17].  For  State- 
Spaee  models:-  x  is  state,  t  is  time,  75  is  sampling 
time,  u  is  input,  e  is  error,  A,B,K,C,  and  D  are 
system  matriees,  and  y  is  output  [17]. 


TABLE  I 

LINEAR  MODELS  AND  THEIR  STRUCTURES 


Linear  Model 

Name 

Linear  Model  Strueture 

Output  Error 

yit)  =  ^u(t  -  ni,)  +  e(t) 

ARX 

A((?)y(t)  =  B(q)u(t  -  rifc)  +  e(t) 

ARMAX 

Mq)yit')  =  -  rifc)  + 

C((?)e(t) 

State-Spaee  - 
subspaee  method 

x(t  +  Ts)  =  Ax(t)  +  Bu(t)  +  Ke(t) 

y(t)  =  Cx(t)  +  Du(t)  +  e(t) 

State-Spaee  - 
predietion 
error/maximum 
likelihood  method 

x(t  +  Ts)  =  Ax(t)  +  Bu(t)  + 
Ke(t) 

y(t)  =  Cx(t)  +  Du(t)  +  e(t) 

Table  II  gives  the  stmetures  of  nonlinear  models. 
The  nonlinear  models  for  the  input  and  output  data 
set  are  obtained  as,  the  nonlinear  Wiener- 
Hammerstein  models  with  nonlinearity  estimators  of 
‘pieeewise  linear  -  pwlinear,’  ‘sigmoidnet,’  and 
‘wavelet  network.’ 

In  Table  II,  for  the  nonlinear  Hammerstein- 
Wiener  model  u(t)  and  y(t)  are  the  inputs  and 
outputs  for  the  system,  respeetively.  /  and  h  are 
nonlinear  fiinetions  that  eorresponds  to  the  input  and 
output  nonlinearity,  respeetively.  w(t)  and  x(t)  are 
internal  variables.  w(t)  has  the  same  dimension  as 
u(t).  x(t)  has  the  same  dimension  as  y(t).  B(q) 
and  F(q)  in  the  linear  dynamie  bloek  are 
polynomials  in  the  baekward  shift  operator.  For 
nonlinear  Hammerstein- Weiner  model  with  wavelet 
network  as  nonlinearity  estimator,  k(s)  as  a  wavelet 
funetion,  and  is  a  row  veetor  sueh  that  (x  — 
7/^)  is  a  sealar.  If  only  the  input  nonlinearity  is 
present,  the  model  is  ealled  the  Hammerstein  model. 
If  only  the  output  nonlinearity  is  present,  the  model 
is  ealled  the  Wiener  model  [17]. 

TABLE  II 


NONLINEAR  MODELS  AND  THEIR  STRUCTURES 


Nonlinear  Model  Name 

Nonlinear  Model  Strueture 

Nonlinear  HW  - 
Pieeewise  Linear  - 
pwlinear 

w(t)  =  /(u(t)), 
x(t)  =  •'  w(t), 

FjiW 

y(t)  =  /i(x(t)); 

Nonlinear  HW  - 
Sigmoidnet 

ypW  =/(y(t-l),y(t- 
2),y(t  —  3),  —  l),u(t  — 

2),...); 

sigmoid  funetion. 

Nonlinear  HW  - 
Wavelet  Network 

g(x)  =  ELi  cckK(fikix  -  Yk)) 

6  Adaptive  Data  Fusion 

Data  fusion  of  multiple  outputs  of  the  linear  and 
nonlinear  models  is  done  by  assigning  a  partieular 
probability  to  eaeh  individual  output  [18].  This 
method  gives  good  estimation  of  the  PIP  joint 
angles.  The  goodness  of  the  fit  of  eaeh  linear  and 
nonlinear  model  output  ean  be  eomputed  using  SI 
model  fit  value,  whieh  is  given  by  Equation  (4). 

FIT  =  [1  -  |r  -  f  \/\Y  -  r  I  ]  *  100.  (4) 

In  Equation  (4)  Y  is  measured,  Y  is  estimated  and 
Y  is  mean  output  signal.  The  model  seleetion 
eriterion  used  in  this  paper  is  Kullbaek  Information 
Criterion  (KIC)  whieh  has  shown  to  perform  well 
for  sEMG  sensor  data  fusion  [9-13].  The  sum  of  two 
direeted  divergenees,  whieh  is  the  measure  of  the 


models  dissimilarity,  is  known  as  Kullbaek’ s 
symmetrie  or  J-divergenee  [19],  as  given  by 
Equation  (5). 


KIC(ipt)=^logRt  + 


n-pi-2  ^ 


(.n-pd 

2 


)  +  ^(n)- 


(5) 


where  g(n)  =  n  *  login  12'). 

The  fusion  algorithm  as  given  by  [18]  is  applied 
for  data  fusion  of  the  outputs  of  the  linear  and 
nonlinear  models  obtained  using  SI: 

(I)  Find  the  linear  and  nonlinear  models  outputs 
Ml,  M2, ,  M/^  for  /c  number  of  outputs. 

(II)  Compute  the  residual  square  norm 

Rt  =  \\Y-^i  0,||2  =  ||r-f  ||2, 
where  0^  =  and 
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(III)  Caleulate  the  model  eriteria  eoeffieient  using 
Equation  (5). 

(IV)  Compute  the  model  probability  p(Mi\Z)  = 
e-h 

— - r?  where  I  is  model  seleetion  eriterion,  i.e. 


KICipO. 

(V)  Compute  the  fused  model  output  Yf  = 

2|L\p(Mi|Z)Yi. 

(VI)  Compute  the  overall  model  from  Yf  and 


skeletal  musele  foree  data. 


In  this  algorithm  the  eomputation  from  step  (II) 
to  (VI)  is  adaptive  i.e.  the  residual  square  norm, 
KlC(Pi),  model  probability  p(Mi|Z),  and  fused 
model  output  Yf  are  being  updated  with  time  or  for 
eaeh  data  point. 


7  Results  and  Discussion 

The  sEMG  signals  from  the  sensor  array  and  angle 
signals  of  PIP  joint  of  index  finger  are  filtered; 
smoothing  spline  eurve  fitted  and  modeled  using 
multiple  linear  and  nonlinear  models.  First  the 
outputs  of  linear  and  nonlinear  models  are  fused 
separately  and  then  the  resultant  outputs  are  fused 
using  an  adaptive  KIC  based  probability.  This 
approaeh  gives  improved  estimates  of  the  finger 
angles  of  the  PIP  joint  of  the  index  finger  of  the 
dominant  hand  of  a  healthy  subjeet.  Results  are 
presented  in  the  following  figures.  Fig.  4  shows  the 
overlapping  plot  of  the  measured-eurve  fitted  angle 
vs.  data  fusion  based  angle  using  linear  models.  Fig. 
5  shows  the  overlapping  plot  of  the  measured-eurve 


fitted  angle  vs.  data  fusion  based  angle  using 
nonlinear  models. 


Curve  Fitted  Angle  Vs.  Data  Fusion  Angle  Using  Linear  Models 
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Fig.  4:  Curve  Fitted  Vs.  Data  Fusion  Based  Angle 
Using  Linear  Models. 


Curve  Fitted  Angle  Vs.  Data  Fusion  Using  Nonlinear  Models 
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Fig.  5:  Curve  Fitted  Vs.  Data  Fusion  Based  Angle 
Using  Nonlinear  Models. 


Curve  Fitted  Angle  Vs.  Data  Fusion  Using  Linear  -  NL  Models 
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Fig.  6:  Curve  Fitted  Vs.  Data  Fusion  Based  Angle 
Using  Linear-Nonlinear  Models. 

Fig.  6  shows  the  overlapping  plot  of  the  eurve 
fitted  angle  vs.  data  fusion  based  angle  using  linear- 
nonlinear  models.  It  is  elearly  evident  that  the  data 
fusion  based  output  follows  the  measured-eurve 
fitted  output.  Mean  pereentage  error  of  the  linear, 
nonlinear  and  linear-nonlinear  models  data  fusion 
based  angles  are  2.5191e-005,  -4.5807e-006,  and 
8.1 167e-006  respeetively. 

Fig.  7  shows  the  validation  plot  for  a  different 
experimental  data  where  the  measured-eurve  fitted 
and  the  linear-nonlinear  modeled  data  fusion  based 
angle  signal  shows  a  elose  follow  up.  Mean 
pereentage  error  of  the  linear,  nonlinear  and  linear- 


nonlinear  models  data  fusion  based  angles  are 
2.8202e-005,  3.3191e-005,  and  6.8079e-006 

respeetively. 


Validation  Plot  1  -  Curve  Fitted  Angle  Vs.  Data  Fusion  Based  Angle 
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Fig.  7:  Validation  Plot  -  Curve  Fitted  Vs.  Data 
Fusion  Based  Angle  Using  Linear-Nonlinear 
Models. 

8  Conclusion  and  Future  Work 

The  dynamie  modeling  of  the  filtered  and  smoothed 
sEMG  and  PIP  joint  angle  of  the  index  finger  is 
aehieved  using  SI  with  sEMG  is  the  input  and  the 
joint  angle  is  the  output.  Multiple  linear  and 
nonlinear  models  are  obtained  for  the  input  and 
output  data.  To  aehieve  a  better  estimate  of  the 
finger  angles,  an  adaptive  probabilistie  Kullbaek 
Information  Criterion  (KIC)  for  model  seleetion 
based  data  fusion  algorithm  is  applied  to  the  linear 
and  nonlinear  models  outputs.  Final  fusion  based 
output  of  this  approaeh  results  in  improved 
estimates  of  finger  joint  angles.  The  approaeh  is 
validated  using  a  different  set  of  experimental  data. 

As  this  initial  study  shows  potential  in  the  pursuit 
of  eontrolling  an  artifieial  hand  on  an  instantaneous 
basis,  we  will  further  this  work  in  the  future  by 
improving  the  data  eolleetion  teehniques  and 
optimizing  the  experimental  proeedure  as  well  as 
optimizing  the  smoothing  parameter  for  the 
smoothing  spline  eurve  fitting. 

Acknowledgement 

This  researeh  was  sponsored  by  the  US  Department 
of  the  Army,  under  the  award  number  W81XWH- 
10-1-0128  awarded  and  administered  by  the  U.S. 
Army  Medieal  Researeh  Aequisition  Aetivity,  820 
Chandler  Street,  Fort  Detriek  MD  21702-5014.  The 
information  does  not  neeessarily  refleet  the  position 
or  the  poliey  of  the  Government,  and  no  offieial 
endorsement  should  be  inferred.  For  purposes  of 
this  artiele,  information  ineludes  news  releases, 
artieles,  manuseripts,  broehures,  advertisements, 
still  and  motion  pietures,  speeehes,  trade 
assoeiation  proeeedings,  ete. 


References: 

[1]  K.  Ziegler-Graham,  E.  J.  MaeKenzie,  P.  L. 
Ephraim,  T.  G.  Travison,  and  R.  Brookmeyer, 
Estimating  the  Prevalenee  of  Limb  Loss  in  the 
United  States  -  2005  to  2050,  Archives  of  Physical 
Medicine  and  Rehabilitation,  Vol.  89,  Mareh  2008, 
pp.  422-429. 

[2] P.  O'Connor.  (2009,  February  15).  Iraq  war  vet 
deeides  to  have  seeond  leg  amputated  [Online]. 
Available:http://www.eolumbiamissourian.eom/stori 
es/2009/02/15/soldier-who-lost-leg-iraq-mav-lose- 
other/ 

[3]  D.  J.  Atkins,  D.  C.  Y.  Heard,  and  W.  H. 
Donovan,  Epidemiologie  overview  of  individuals 
with  upper-limb  loss  and  their  reported  researeh 
priorities.  Journal  of  Prosthetics  and  Orthotics,  Vol. 
8,  No.  1,  1996,  pp.  2-11. 

[4]  D.  H.  Sileox,  M.  D.  Rooks,  R.  R.  Vogel,  and  L. 
L.  Fleming,  Myoeleetrie  prostheses.  A  long-term 
follow-up  and  a  study  of  the  use  of  alternate 
prostheses.  The  Journal  of  Bone  and  Joint  Surgery, 
Vol.  75-A,  No.  12,  Deeember  1993,  pp.  1781-1789. 

[5]  M.  B.  I.  Reaz,  M.  S.  Hussain  and  F.  Mohd- 
Yasin,  Teehniques  of  EMG  signal  analysis: 
deteetion,  proeessing,  elassifieation  and 
applieations.  Biological  Procedures  Online,  Vol.  8, 
Mareh  2006,  pp.  11-35. 

[6]  Y.  Zhou,  R.  Chellappa,  and  G.  Bekey, 
Estimation  of  intramuseular  EMG  signals  from 
surfaee  EMG  signal  analysis,  IEEE  International 
Conference  on  Acoustics,  Speech,  and  Signal 
Processing  1986,  Vol.  11,  1986,  pp.  1805-1808. 

[7]  P.  K.  Artemiadis  and  K.  J.  Kyriakopoulos, 
EMG-based  position  and  foree  eontrol  of  a  robot 
arm:  Applieation  to  teleoperation  and  orthosis,  in 
Conf  Rec.  2007  lEEE/ASME  Int.  Conf  on 
Advanced  Intelligent  Mechatronics,  Zurieh,  Sept. 
2007,  pp.  1-6. 

[8]  P.  K.  Artemiadis  and  K.  J.  Kyriakopoulos, 
EMG-Based  Position  and  Foree  Estimates  in 
Coupled  Human-Robot  Systems:  Towards  EMG- 
Controlled  Exoskeletons,  in  Experimental  Robotics, 
Springer  Tracts  in  Advanced  Robotics,  Vol.  54, 
Berlin  Heidelberg:  Springer- Verlag,  2009,  pp.  241- 
250. 

[9]  P.  Kumar,  C.  Potluri,  A.  Sebastian,  S.  Chiu,  A. 
Urfer,  D.  S.  Naidu,  and  M.  P.  Sehoen,  An  Adaptive 
Multi  Sensor  Data  Fusion  with  Hybrid  Nonlinear 
ARX  and  Wiener-Hammer  stein  Models  for  Skeletal 
Musele  Foree  Estimation,  in  Proc.  The  14th  World 
Scientific  and  Engineering  Academy  and  Society 
(WSEAS)  International  Conference  on  Systems, 
Corfu  Island,  Greeee,  2010,  July  22-24. 

[10]  P.  Kumar,  A.  Sebastian,  C.  Potluri,  A.  Urfer, 
D.  S.  Naidu,  and  M.  P.  Sehoen,  Towards  Smart 


Prosthetie  Hand:  Adaptive  Probability  Based 
Skeletal  Musele  Fatigue  Model,  in  Conf  Rec.  32nd 
Annual  International  Conference  of  the  IEEE 
Engineering  in  Medicine  and  Biology  Society, 
Buenos  Aires,  Argentina,  Aug.  31  -  Sept.  4,  2010. 

[11]  P.  Kumar,  C.  Potluri,  A.  Sebastian,  S.  Chiu,  A. 
Urfer,  D.  S.  Naidu,  and  Mareo  P.  Sehoen,  Adaptive 
Multi  Sensor  Based  Nonlinear  Identifieation  of 
Skeletal  Musele  Foree,  WSEAS  Transactions  on 
Systems,  Vol.  9,  Issue  10,  Oetober  2010,  pp.  1051- 
1062. 

[12]  P.  Kumar,  C.  Potluri,  M.  Anugolu,  A. 
Sebastian,  J.  Creelman,  A.  Urfer,  S.  Chiu,  D.  S. 
Naidu,  and  M.  P.  Sehoen,  A  Hybrid  Adaptive  Data 
Fusion  with  Linear  and  Nonlinear  Models  for 
Skeletal  Musele  Foree  Estimation,  in  Proc.  5th 
Cairo  International  Conference  on  Biomedical 
Engineering,  Cairo,  Egypt,  Dee.  16-18,  2010. 

[13]  P.  Kumar,  C.  H.  Chen,  A.  Sebastian,  M. 
Anugolu,  C.  Potluri,  A.  Fassih,  Y.  Yihun,  A.  Jensen, 

Y.  Tang,  S.  Chiu,  K.  Bosworth,  D.  S.  Naidu,  M.  P. 
Sehoen,  J.  Creelman  and  A.  Urfer,  An  Adaptive 
Hybrid  Data  Fusion  Based  Identifieation  of  Skeletal 
Musele  Foree  with  ANFIS  and  Smoothing  Spline 
Curve  Fitting,  in  Proc.  2011  IEEE  International 
Conference  on  Fuzzy  Systems,  Taipei,  Taiwan,  June 
27-30,  2011. 

[14]  P.  Zhou,  N.  L.  Suresh,  M.  M.  Lowery,  and  W. 

Z.  Rymer,  Nonlinear  Spatial  Filtering  of 
Multiehannel  Surfaee  Eleetromyogram  Signals 
During  Low  Foree  Contraetions,  IEEE  Transactions 
on  Biomedical  Engineering,  Vol.  56,  No.  7,  July 
2009,  pp.  1871-1879. 

[15]  MATLAB®  Curve  Fitting  Toolbox™  User's 
Guide.  The  MathWorks,  Ine.  2010. 

[16]  L.  Ljung,  System  Identification:  Theory  for  the 
User.  2nd  edition,  Printiee  Hall  PTR,  1999,  Chap.  1, 
pp.  1-15. 

[17]  L.  Ljung,  System  Identification  Toolbox^^  7 
User's  Guide,  The  MathWorks,  Ine.,  2010. 

[18]  H.  Chen  and  S.  Huang,  A  Comparative  study 
on  Model  Seleetion  and  Multiple  Model  Fusion,  in 
Proc.  7th  International  Conference  on  Information 
Fusion,  New  Orleans,  USA,  July  25-28,  2005,  pp. 
820-826. 

[19]  A.  K.  Seghouane,  and  M.  Bekara,  A  Small 
Sample  Model  Seleetion  Criterion  Based  on 
Kullbaek’s  symmetrie  Divergenee,  IEEE 
Transactions  on  Signal  Processing,  Vol.  52,  No.  12, 
2004,  pp.  3314-3323. 


A  REVIEW  ON  SENSORY  FEEDBACK  FOR  sEMG  BASED 

PROSTHETIC  HANDS 


Madhavi  Anugolu,  Chandrasekhar  Potluri,  Adnan  Ilyas,  Parmod  Kumar  ,  Steve  Chiu,  Naney  Devine,  Alex 

Urfer,  andMareo  P.  Sehoen,  Senior  Member  IEEE 


Abstract-77zA  paper  addresses  issues  concerning  the 
integration  of  artificial  limbs  with  amputees.  From  the 
reported  literature,  it  is  evident  that  the  afferent 
feedback  to  prosthetic  users  can  help  with  their  ability  to 
control  the  device.  In  addition,  incorporation  of  such  a 
feedback  system  increases  the  ownership  sensation  of 
amputees  with  their  artificial  limbs.  This  paper  includes 
an  overview  of  research  findings  on  the  development  of 
non-invasive  sensory  feedback  (afferent)  systems  for 
hand  amputees.  The  reviewed  stimulators  for  the  afferent 
system  are  based  on  vibration  and  electrical  systems, 
and  a  combination  of  the  two  methods. 
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1.  Introduction 

Aeeording  to  the  information  provided  by  the  National 
Limb  Loss  Information  Center,  [1],  in  the  year  of  2005, 
1.6  million  persons  were  living  in  the  United  States  with 
the  loss  of  a  limb.  It  is  estimated  that  by  the  year  2050 
this  number  will  more  than  double  to  3.6  million.  Henee, 
prostheties,  sueh  as  artifieial  hands,  and  their  advanees 
in  funetionality  and  performanee  will  remain  an  aetive 
researeh  topie. 
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Functionality  can  be  achieved  by  incorporating  some 
kind  of  a  sensory  feedback,  which  allows  the  user  to 
acquire  external  information  through  the  artificial  hand. 
Furthermore,  the  functionality  of  prosthesis  can  be 
improved  by  using  a  close  to  natural  control  mechanism. 
Research  has  shown  that  the  adaptation  of  the  prosthetic 
arm  is  conditional  to  a  system  that  provides  distally 
referred  sensations  of  touch  and  joint  movements  [2].  It 
is  postulated  that  to  achieve  greater  dexterity  and 
performance,  prostheses  without  a  sensory  feedback 
system  will  be  obsolete,  [3-5].  It  was  assumed  for  a 
long  time  that  the  replacement  of  a  natural  arm  with 
intelligent  prosthetic  arm  is  an  impossible  task.  The 
main  discrepancy  lied  in  the  insufficient  analysis  of  the 
concept  of  sensory  feedback  and  by  not  taking  into 
account  the  knowledge  of  physiology  of  kinesthesis  [6]. 
However  with  the  passage  of  time,  and  as  the 
technology  matured,  these  factors  were  taken  into 
account  and  later  formed  the  base  for  a  modern 
prosthetic  hand.  The  sensory  feedback  has  opened  the 
new  doors  to  the  life  of  disable  subjects  compared  to  the 
earlier  days.  By  using  the  sensory  feedback,  natural 
ambiences  can  be  provided  to  the  prosthetic  hand  users. 
It  will  help  the  user  to  have  more  control  on  the  hand 
and  can  be  fiilly  embedded  into  the  work  as  a  normal 
person  without  any  disability  [7]. 

Sensory  feedback  can  be  obtained  by  the  use  of  different 
implantable  electrodes,  such  as  needle  or  cuff  electrodes. 
For  robotic  hands,  [8]  used  this  principle  to  excite  the 
responsible  nerves  directly.  They  implanted  the 
electrodes  in  fascicles  of  the  nerves  of  amputees.  The 
stimulation  through  these  electrodes  gives  the  feedback 
information  on  grip  strength  and  position  of  the  limb. 
This  is  not  a  closed-loop  system  and  has  some 
limitations  in  terms  of  optimization. 

External  sensors  and  switches  are  usually  used  in 
controlling  functional  neuromuscular  simulation  systems 
(FNS).  They  pose  problems  such  as  donning,  and 
calibration.  For  implementation  artificial  sensors  are 
difficult  to  build  and  are  insufficiently  bio  compatible. 
Now-a-days  with  the  advancement  of  electrical 
interfacing  with  nerves  and  muscles,  natural  sensors  are 
being  considered  as  an  alternative  source  of  feedback 
and  command  signals  for  FNS.  For  high-level  control 
natural  or  artificial  sensors  can  equally  perform  for 


decision  making  methods.  Surface  electromyography 
(sEMG)  signals  are  being  1000  times  larger  than  electro 
neuro  organs  are  easier  to  measure,  but  have  not 
provided  reliable  indicators  so  far.  Characteristics  like 
muscle  fatigue  are  not  indicated  by  these  which  are  in 
FNS  systems  [9].  Andrew  Y.J.  Szeto  [10]  explained 
about  the  electrocutaneous  stimulation  for  sensory 
communication  in  rehabilitation  engineering.  Some 
procedures  for  implementing  electrotactile  displace  and 
generating  reliable,  pain  free  sensations  with  a  useful 
communication  bandwidth.  This  paper  presents  an 
overview  of  what  technologies  have  been  developed  in 
recent  years  and  tries  to  forecast  the  direction  of  future 
research  based  on  the  current  state  of  knowledge  for 
advancing  sensory  feedback  based  prosthetic  hands. 

II  BIOLOGICAL  BACKGROUND 

Some  efforts  have  been  made  in  recent  years  to  address 
sensory  feedback  for  the  prosthetic  users,  [11].  The 
sensory  feedback  system  interacting  with  the  prosthetic 
and  sensory  cortex  needs  to  be  capable  of 
communicating  with  both  systems  simultaneously,  avoid 
issues  of  fatigue,  assimilation,  as  well  as  be  capable  of 
sensing  through  the  mechanical  hand  various  types  of 
signals,  such  as  pressure,  texture,  temperature,  shear 
forces,  and  surface  conditions.  In  the  following,  we 
present  a  brief  review  of  the  inner  workings  of  sensation 
through  healthy  human  skin.  There  are  numerous 
afferent  receptors  in  the  human  skin  to  sense  different 
sensation  ranging  from  touch  to  temperature.  In 
particular,  there  are  cutaneous  mechanoreceptors, 
thermoreceptors,  nociceptors,  bulboid  corpuscles  and 
chemoreceptors. 

Cutaneous  Mechanoreceptors  are  free  nerve  endings, 
sensing  touch,  pressure,  and  stretch.  They  are  classified 
into  four  main  types  in  the  human  skin: 

1.  Ruffini’s  end  organs  detect  touch,  pressure  and 
tension  deep  in  the  skin.  They  are  located  all  over 
the  skin  and  are  rather  slowly  adapting  nerve 
endings  and  sensitive  to  skin  stretch.  Ruffini’s  end 
organs  are  mainly  helpful  with  sense  of  and  control 
of  finger  position  and  movement;  they  are  also 
useful  for  detecting  slippage  of  objects  along  the 
surface  of  the  skin.  Hence  they  help  control  grip 
force. 

2.  Meissner’s  corpuscle  (or  tactile  corpuscle)  is  a 
mechanoreceptor  (nerve  ending).  The  location  of 
Meissner’s  corpuscles  is  the  glabrous  skin.  They 
detect  changes  in  texture  (most  sensitive  if  vibration 
occurs  below  or  around  50  Hz),  are  receptive  to  light 
touch  sensation.  Meissner’s  corpuscles  are  dynamic 


in  nature,  which  results  into  rapid  adaptation  to 
external  stimuli. 

3.  Pacinian  corpuscles  are  fewer  in  number  compared 
to  Meissner  and  Merkel’s  discs,  but  adapt  very 
rapidly.  The  location  of  Pacinian  corpuscles  are  in 
subcutaneous  tissue,  interosseous  membranes. 
Pacinian  corpuscles  detect  rapid  vibrations  (about 
200-300  Hz).  They  are  nerve  endings  in  the  skin 
which  are  sensitive  to  pain  and  deep  pressure 
(poking),  and  are  also  dynamic  (adapt  to  stimuli). 

4.  Merkel’s  discs  are  located  in  all  of  the  human  skin 
and  in  hair  follicles.  Merkel’s  disc  detects  sustained 
touch  and  pressure  and  can  distinguish  shapes  and 
textures.  These  receptors  are  good  for  touch  and 
pressure.  Their  adaptation  rate  is  rather  slow  as  they 
are  static  in  nature. 

The  location  of  the  four  mechanoreceptors  is  shown  in 

Figure  1. 


Figure  1:  Mechanoreceptors  location  in  human  skin 
[12]. 


Thermoreceptors:  are  sensory  neurons  that  sense 
changes  in  temperature.  Heat  is  sensed  through 
unmyelinated  C-fibers,  which  possess  a  low  conduction 
velocity.  This  result  into  the  transmission  of  sensed 
information  transmitted  to  the  brain  within  a  few 
seconds.  Cold  is  sensed  using  C-fibers  and  thinly 
myelinated  A-delta  fibers,  which  conduct  the 
information  to  the  brain  faster  (within  one  second)  [8]. 
For  warm  receptors,  the  warming  effect  is  translated  into 
an  increase  in  action  potential  discharge  rate,  while 
cooling  results  in  a  decrease  of  the  discharge  rate.  For 


cold  receptors  this  is  inverted,  where  the  action  potential 
firing  rate  is  increased  when  cooling  occurs  and 
decreased  when  warming  occurs.  There  is  some 
literature  [13] which  notes  that  above  45®C,  some  cold 
receptors  also  respond  with  an  action  potential  discharge 
due  to  the  increased  temperature  (paradoxical  response 
to  heat). 

Cutaneous  Nociceptors:  is  a  skin  receptor  responsible  of 
detecting  damaging  stimuli  and  alarming  the  system  by 
creating  the  perception  of  pain.  There  are  also  thermal 
nociceptors  which  generate  heat  pain  for  temperatures 
above  42®C. 

While  healthy  subjects  have  access  to  all  the  information 
gathered  by  these  receptors,  individuals  with 
amputations  have  to  relearn  how  to  collect  information 
about  an  object  they  touch  with  the  prosthetic.  Recent 
research  has  shown  that  sensory  feedback  of  contact 
information  from  the  prosthetic  with  its  surroundings 
improves  the  user’s  ability  to  control  and  adapt  to  the 
prosthetic  [14].  Currently,  most  work  addressing  the 
inclusion  of  feedback  for  the  prosthetic  user  addresses 
only  very  basic  elements  such  as  tactile  feedback  about 
finger  pressure. 

III.  SENSORY  FEEDBACK  TYPES 

Holmes,  [14]  addressed  the  mental  representation  for 
sensory  inputs  of  the  human  body  within  the  brain.  This 
input  from  the  periphery  has  a  strong  effect  on  the 
perceptual  awareness  of  body  parts,  natural  or  appended 
prosthesis  for  identifying  its  own  body  and  for 
identifying  artificial  limbs.  With  sensory  inputs,  control 
and  handling  of  the  prostheses  are  improved.  Some 
efforts  have  been  made  in  recent  years  to  address 
sensory  feedback  for  the  prosthetic  users.  For  example, 
[15]  used  electrical  stimulation  to  communicate  pressure 
or  position  of  the  prosthesis  in  order  to  provide  a  closed- 
loop  control  of  the  hand.  The  most  successful  methods 
for  communicating  peripheral  inputs  were  Electrical 
Surface  Simulation  (ESS)  and  Mechanical  Surface 
Simulation  (MSS),  [16,  17].  Research  shows  that 
electro-tactile  stimulators  allow  the  distinction  of  59 
different  sensations;  the  mechanical  vibrator  is  able  to 
transmit  16  different  sensations,  [18]. 

Tactile  sensors  can  be  split  into  two  types:  active  and 
passive.  In  the  general  scenario,  tactile  sensory  user 
interfaces  passive  touch  i.e.,  stimulation  is  made 
passively  on  the  surface  of  the  skin.  In  some  instances, 
in  which  when  an  object  needs  to  be  identified  active 
touch  comes  into  picture.  This  active  touch  utilizes 
distinct  shapes  and  texture  and  encodes  this  sensory 
information  which  helps  to  identify  the  object  without 


visual  contact.  In  the  active  touch  scenario  shape 
encoding  is  very  important,  [19]. 

The  tactile  sensors  can  be  used  with  electrical, 
pneumatic,  and  electro-mechanical  devices.  In  the 
following  sections  the  two  most  prevailing  sensory 
feedback  systems  are  discussed. 

Mechanical  Stimulation 

In  the  case  of  electro-mechanical  (vibro  tactile)  devices, 
a  mechanical  vibration  or  touch  is  produced  and  super- 
positioned  onto  a  healthy  skin  area  with  functional 
mechano-receptors.  The  vibro  tactile  displays  are 
classified  into  two  basic  types.  They  are  pins  and  large 
point  contact  stimulators,  [20]. 

The  pin  type  vibro  tactile  displays  based  on  piezoelectric 
bimorph  pins  are  convenient  and  simple  to  use.  They  are 
non-invasive  with  good  two  point  discrimination.  These 
pin  types  are  very  good  in  presenting  fine  cues  for 
surface  texture  edge  and  line  detection  when  used  as  an 
array,  [21].  In  contrast,  large  contact  point  stimulators 
are  very  simple  vibrators  that  are  pressed  against  the 
skin  surface.  They  yield  much  lower  resolution  when 
compared  to  the  pin  type.  But  the  advantage  with  these 
types  of  simulators  is  that  they  can  be  distributed  over 
large  section  of  the  body.  Therefore  multiple 
simultaneous  cues  for  surface  texture,  edge  and  line 
detections  [22]  can  be  produced. 

The  mechanical  stimulation  uses  pneumatic  devices 
such  as  bladders  or  pockets  which  can  be  inflated  or 
deflated,  [23].  Hence  they  create  a  pulsing  sensation  that 
the  user  can  easily  feel.  These  devices  can  either  be 
attached  directly  or  to  other  devices  that  are  used  to 
complete  the  tasks.  The  main  advantages  of  these 
pneumatic  devices  (bladders)  -  when  compared  to  vibro 
tactile  displays  -  are  localization  i.e.,  they  have 
significantly  low  interference  with  the  nearby  bladders, 
the  pump  mechanism  can  be  mounted  remotely  such  that 
the  control  devices  will  require  a  minor  modification.  A 
variety  of  sensory  information  of  the  stimulus  can  be 
generated  by  altering  the  configuration  or  shape  of  these 
bladders  [23,  24]. 

A  number  of  studies  have  been  conducted  using  the 
mechanical  vibrator  as  basis  [11,  15,  25,  and  26].  This 
approach  generally  leads  to  a  higher  acceptance  rate  by 
the  user  as  well  as  an  increased  users’  performance  (time 
and  efficiency  of  use).  However,  there  are  some 
limitations  with  mechanical  stimulation,  mechanical 
vibration  is  limited  to  16  sensations  when  used  as  a 
source  of  sensory  feedback,  they  are  bulkier  and  hard  to 
control,  and  the  pneumatic  tactile  displays  include  leak 
control,  and  air  compressibility  issues. 


Electrical  stimulation 

In  order  to  design  better  prostheses  with  vibro  taetile 
feedbaek,  eleetrieal  stimulation  of  the  museles  is 
neeessary.  By  applying  the  eleetrieal  eurrents  paralyzed 
museles  ean  be  made  to  eontraet.  These  eleetrieally 
elieited  musele  eontraetions  are  eontrolled  in  sueh  a  way 
that  the  prosthesis  aequires  its  full  funetionality.  This 
teehnique  is  ealled  ‘Tunetional  eleetrieal  stimulation”. 
There  is  a  lot  of  ongoing  researeh  on  FES  systems  to 
restore  the  funetionality  of  the  upper  and  lower 
extremity  prosthesis  [27].  Kajimoto  et.  (3/,[28]  used  an 
eleetrode  array  with  a  partieular  distribution  of  the 
eleetrode’s  eharge  to  eommunieate  with  the  user,  the 
sensation  of  pressure  at  the  fingertips.  Their  smart  toueh 
prototype  eonsists  of  optieal  sensors  to  eapture  an  image 
and  eonvert  that  into  taetile  information  and  displays 
through  eleetrieal  stimulation.  Using  an  eleetro -taetile 
system  makes  it  possible  to  aeeess  seven  (7)  different 
elasses  of  meehanoreeeptors,  two  (2)  elasses  of  thermo 
reeeptors,  four  (4)  elasses  of  noeioeeptors,  and  three  (3) 
elasses  of  proprioeeptors  within  the  human  skin,  [28,  29, 
30,  31,  32,  33].  To  utilize  the  possible  59  sensations 
from  eleetrieal  stimulations,  Szeto  et.  al  [32]  used 
eleetro-taetile  stimulations  by  ehanging  frequeney  and 
intensity  of  the  feedbaek.  In  [34],  the  authors  used 
interferential  stimulation  to  transit  spatial  movement  of 
the  hand.  Eleetrieal  stimulation  is  deseribed  in  literature 
by  using  voltage -regulated  stimulation,  [34].  Voltage- 
regulated  systems  are  sensitive  to  ehanges  in  the 
amputee’s  skin  impedanee.  In  referenee  [35],  this 
problem  was  addressed  by  ereating  a  voltage -regulated 
stimulator  with  a  high  frequeney  biphasie  waveform. 
This  approaeh  lead  to  the  avoidanee  of  sensitivity 
(ability  to  diseriminate  objeets)  drop  off.  Array  sensors 
have  been  used  sueeessfiilly  for  different  purposes  [36, 
37].  As  above  mentioned,  work  presented  in  [28]  utilize 
an  eleetrode  array.  A  rather  large  array  was  used  by 
[38],  where  144  eleetrodes  are  used  on  a  blind  person’s 
tongue  in  order  to  provide  some  spatial  awareness  of 
his/her  surroundings.  Eleetrode  arrays  for  feedbaek  have 
numerous  advantages  and  ean  help  tailor  the  sensory 
feedbaek  system  to  the  skin  area  ehosen. 

IV  CONCLUSION  AND  FUTURE  WORK 


In  this  paper,  we  addressed  issues  that  eoneem  the 
integration  of  artifieial  limbs  to  the  amputees.  There 
are  two  systems  of  note  that  ean  be  used  to  strueture  an 
afferent  system.  The  two  systems  are  either  based  on 
vibration  or  on  eleetrieal  stimuli  or  a  eombination  of  the 
two  methods.  Eleetrieal  Stimulation  provides  the  better 


performanee  eompared  to  the  meehanieal  stimulation, 
measured  by  the  type  and  variety  of  possible  sensations 
generated  and  pereeived  by  the  meehanoreeeptors  in  the 
human  skin.  Designing  a  prosthetie  hand  with  a  sensory 
feedbaek  teehnique  will  inerease  the  aeeeptability  by  the 
user  of  the  prosthetie  hand  and  henee  the  eontrol  of  the 
hand,  [39,  40]. 
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Abstract:  This  paper  presents  a  surface  electromyographic 
(sEMG)-based,  optimal  control  strategy  for  a  prosthetic 
hand.  System  IdentiHcation  (SI)  is  used  to  obtain  the 
dynamic  relation  between  the  sEMG  and  the  corresponding 
skeletal  muscle  force.  The  input  sEMG  signal  is  preprocessed 
using  a  Half-Gaussian  filter  and  fed  to  a  fusion-based 
Multiple  Input  Single  Output  (MISO)  skeletal  muscle  force 
model.  This  MISO  system  model  provides  the  estimated 
finger  forces  to  be  produced  as  input  to  the  prosthetic  hand. 
Optimal  tracking  method  has  been  applied  to  track  the 
estimated  force  profile  of  the  Fusion  based  sEMG-force 
model.  The  simulation  results  show  good  agreement  between 
reference  force  profile  and  the  actual  force. 

I.  Introduction 

Currently  there  are  more  than  2  million  Amerieans  that 
have  a  missing  limb.  The  number  of  Amerieans  with 
missing  limbs  inereases  185,000  people  a  year  [1].  As  a 
result  of  this  rising  number  of  people  that  need  prostheses, 
researeh  is  being  foeused  on  ereating  more  intuitive 
prostheties.  There  has  been  aetive  researeh  to  design  a 
prosthetie  hand.  But  even  today  there  is  no  prosthetie  hand 
at  an  affordable  eost  with  position  and  taetile  foree  eontrol 
[2].  It  is  evident  from  the  past  researeh  that  the  human- 
eentered  roboties  should  be  autonomous  with  a  high  level 
of  funetionality,  eomfort  and  ease  of  use  [3].  A  natural 
means  of  eommunieation  is  required  for  human-eentered 
roboties  [4],  and  in  the  ease  of  eleetromyographie  (EMG) 
based  prostheses,  one  natural  means  of  interfaee  between 
the  human  arm  and  prosthesis  is  the  surfaee  EMG  (sEMG) 
itself  The  EMG  signal  is  present  beeause  of  the 
neuromuseular  aetivity  in  the  body.  The  sEMG  signals  are 
eaptured  noninvasively  and  give  aeeess  to  physiologieal 
proeesses  responsible  for  the  eontraetion  of  museles.  Sinee 
the  sEMG  signal  is  amplitude  modulated  and  time 
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dependent,  and  dynamie  in  nature,  spatially  and 
temporally  frequeney  eneoded  [5].  Usually  sEMG 
measurements  are  based  on  single  sensor  data.  For  this 
work  we  used  an  array  of  three  sEMG  sensors  and  a  foree 
sensing  resistor  (FSR)  to  aequire  the  EMG  signal  and  the 
eorresponding  skeletal  musele  foree.  The  data  from  the 
three  sEMG  sensors  are  fused  using  a  fusion  algorithm  to 
have  a  better  estimation  of  skeletal  musele  foree  from  the 
eorresponding  sEMG  signal  when  eompared  to  single 
sensor  data  [6]. 

This  paper  uses  the  sEMG-foree  fusion  model  as 
referenee  profile.  A  Linear  Quadratie  Traeking  (LQT) 
teehnique  is  employed  to  the  prosthetie  hand  to  traek  the 
foree  profile.  This  paper  is  struetured  as  follows.  The 
experimental  set  up  is  given  in  Seetion  II,  Seetion  III 
provides  referenee  foree  model  and  Seetion  V  provides 
dynamies  of  the  hand.  Seetion  VI  details  the  results  and 
diseussion  and  in  the  last  seetion  some  eonelusions  are 
provided. 

II.  Experimental  Set-Up 

Experiments  were  eondueted  on  a  right-handed  healthy 
male  subjeet.  Using  a  musele  simulator  (Rieh-Mar 
Corporation  HV  1100),  motor  units  were  marked  and 
sEMG  sensors  were  plaeed  aeeordingly  [6].  One  sEMG 
sensor  was  plaeed  on  the  motor  point  of  the  subjeet’ s  ring 
finger  and  two  sensors  were  plaeed  at  points  adjaeent  to  it. 
Prior  to  plaeing  the  sEMG  sensors,  the  skin  surfaee  of  the 
subjeet  was  prepared  aeeording  to  International  Soeiety  of 
Eleetrophysiology  and  Kinesiology  (ISEK)  protoeols  [7]. 
Both  sEMG  and  musele  foree  signals  were  aequired 
simultaneously  using  Lab  VIEW™  8.2  at  a  sampling  rate 
of  2000  Hz.  The  sEMG  data  was  eaptured  by  a 
DELSYS®  Bagnoli-16  EMG  system  with  DE-2.1 
differential  EMG  sensors.  The  foree  information  was 
eolleeted  by  a  NI  ELVIS  with  an  Interlink  Eleetronies  FSR 
0.5”  eireular  foree  sensor. 

III.  Reference  Force  Model 

In  this  present  work  the  foree  signal  is  extraeted  from 
the  sEMG  signals  obtained  from  the  array  of  the  three 
sEMG  sensors  loeated  on  the  arm.  The  data  from  the  three 
sensors  are  eolleeted  around  the  eorresponding  individual 
motor  unit  loeation  at  the  transradial  arm  loeation  (flexor 
digitorum  superfieialis)  and  is  reetified  and  filtered  using  a 
Half-Gaussian  filter  given  by 

/  EMG^\ 

p{,EMG\x)  =  2  X  ,  (1) 


where  p(EMG\x)  is  a  eonditional  probability  density 
funetion,  x  is  a  latent  driving  signal  and  EMG  is  the 
reetified  signal  from  the  sensors. 

The  preproeessed  sEMG  data  from  the  three  sensors  are 
fused  using  a  sensor  fusion  algorithm  to  faeilitate  the 
extraetion  of  the  best  finger  foree  estimates.  Sensor  fusion 
is  aeeomplished  in  the  frequeney  domain  using  a  simple 
elitism  based  Genetie  Algorithm  (GA).  The  SI  method  is 
used  to  identify  the  dynamieal  relationship  between  the 
sEMG  data  from  the  three  sensors  and  the  eorresponding 
finger  foree.  In  this  fusion  algorithm,  Output  Error  (OE) 
models  are  used  to  aehieve  the  SI.  The  OE  models  are 
eonstrueted  for  eaeh  individual  data  set.  The  OE  model 
strueture  is  given  as  follows. 


where  Z's  and  P's  are  the  zeros  and  poles  respeetively  of 
the  individual  transfer  funetion  and  n  is  the  order  of  the 
system. 

Feeding  the  new  data  sets  to  the  MI  SO  transfer  funetion 
(//(s))  results  in  an  estimated  fusion  based  foree  Y. 


IV.  DYNAMICS  OF  PROSTHETIC  HAND 

The  dynamie  equations  of  motion  for  the  hand  are 
obtained  from  the  Eagrangian  approaeh  as  [8,9,10,11,12, 
13] 


A  ^ 

dt  \dqj  dq 


(5) 


where  q  and  q  represent  the  angular  veloeity  and  angle 
veetors  of  joints  respeetively;  L  is  the  Eagrangian;  t  is  the 
given  torque  veetor  at  joints.  The  Eagrangian  L  is  given  as 


Where  B  and  E  are  the  polynomials,  q  is  shift  operator, 
e(t)  is  output  error,  y(t)  is  system  output,  u  is  input,  nk  is 
the  system  delay  and  t  is  time  index. 

Using  the  three  resulting  OE  models  and  the  fusion 
algorithm  given  by  [6],  a  eorresponding  eontinuous-time 
model  is  eonstrueted  as  given  by  the  transfer  funetion  as 


L  =  T-V,  (6) 

where  T  and  V  are  denoted  as  kinetie  and  potential 
energies  respeetively.  Substituting  (6)  into  (5),  we  get  the 
following  dynamie  equations 

Miq)q  +  Ciq,  q)  +  Giq)  =  T,  (7) 


F(5)  5-/+/n^5-/-l  +  -+A  '  ^  ^ 

Similar  to  the  diserete-time  ease ,  nb  and  nf  determine 
the  orders  of  the  numerator  and  denominator.  For  multi¬ 
input  systems,  nb  and  n/ are  row  veetors.  h,/are  the 
eoeffieients  of  the  numerator  and  denominator 
polynomials  respeetively. 


where  M(q)  deseribes  the  inertia  matrix;  C(q,q)  is  the 
eoriolis/eentripetal  veetor  and  G(q)  is  the  gravity  veetor. 
(7)  ean  be  written  as 

M(q}q  +  N(q,q)  =  T  ,  (8) 

where  N(q,q)  =  C(q,q)  +  Giq)  represents  nonlinear 
terms. 


A  MISO  transfer  funetion  is  eonstrueted  based  on  the 
poles  of  three  individual  OE  models  eorresponding  to  eaeh 
sensor.  GA  is  used  to  find  the  eorresponding  zeros.  The 
seareh  area  is  limited  to  the  unit  eirele,  beeause  a  diserete 
time  model  is  used  (and  the  resulting  MISO  model  is 
deereased  to  minimum  phase).  The  number  of  zeros  is  at 
most  the  number  of  poles.  The  number  of  potential  zeros  is 
set  to  the  order  of  the  eorresponding  denominator.  The 
square  error  of  the  resulting  MISO  system  H(s)  (see 
Appendix)  and  the  reeorded  foree  signal  is  set  as  an 
objeetive  funetion.  The  objeetive  funetion  /  is  eonstrueted 
as  follows, 

f  =  -Y{tfdt  =  ^1'  (p'^{t)dt,  (3) 

where  to  and  tf  are  the  initial  and  final  time  values,  Y (t) 
is  the  fusion  model  estimated  foree  and  Y (t)  is  the  aetual 
foree  from  the  FSR. 

The  MISO  system  H{s)  is  eonstrueted  as  follows, 

Z2,i5^+Z2,25^~^  +  ---Z2,n+1 
P2,l^^^P2,2S^~^  +  '"P2,n+l 

\p3,iS^+P3,2S^-l  +  -P3,n+l/ 


Feedbaek  linearization  teehnique  is  used  to  eonvert  the 
nonlinear  dynamies  represented  by  (8)  into  a  linear  state- 
variable  system  [8].  In  order  to  obtain  the  alternative  state- 
spaee  equations  of  the  dynamies,  the  position/veloeity 


state  x(t)  of  the  joint  is  defined  as 
x(t)  =  [q'(t)  q'(t)]'  ,  (9) 

and  rewriting  (8)  as, 

^q(t)  =  -M-^(q(t))[N(q(t),q(t)) -T(t)]  (10) 

Therefore,  from  (9)  and  (10),  a  linear  system  in 
Brunovsky  eanonieal  form  is  obtained  and  represented  as 

^  [o  o]  [?] 

The  eontrol  input  veetor  u(t)  given  by 
u(t)  =  -M-^(q(t))[N(q(t).q(t))  -  T(t)].  (12) 


As  the  prosthetie  hand  is  required  to  traek  the  desired 
foree  profile  (/^(t)  deseribed  under  the  referenee  foree 
model,  the  traeking  error  e(t)  is  defined  as 


e(f)  =  qd(0  -q(t)- 


(21) 


(13) 

Here,  q^Ct)  is  the  desired  angle  veetor  of  the  joints  and 
ean  be  obtained  by  the  referenee  foree  model  [6];  q(t)  is 
the  aetual  angle  veetor  of  the  joints.  Differentiating  (13) 
twiee,  we  get, 

e(0  =  qd(f)  -  q(f)  .  e(t)  =  qait)  -  qit).  (14) 

Substituting  (10)  into  (14)  gives 

e(0  =  qd(t)  +  M-^(q(t))[N(q(t),q(t))  (15) 

From  (15)  the  eontrol  funetion  u(t)  ean  be  defined  as 

u(t)=  qa(t)  +  M~^{q(t))[N{q(t),q(t))  (16) 

This  is  often  ealled  the  feedbaek  linearization  eontrol 
law,  rewriting  (16)  as, 

T(t)  =  M{q(t})[qa(t}  -  u(t)  +  N{q(t),q(t})].  (17) 

Using  (14)  and  (16),  the  state  veetor  x(t)  = 
[e' (t)e' (t)]' ,  the  state-spaee  model  ean  be  represented  as 

"  [o  ol  [?] 

Now,  (18)  is  in  the  form  of  a  linear  system  sueh  as 
x(t)  =  i4x(t)  +  Bu(t)  .  (19) 


u*(t)  =  —R  P(t)x*(t)  =  —K(t)x*(t). 

where  K(t)  =  —R~^(t)B'P(t)  is  ealled  Kalman  gain 
and  P(t),  is  the  solution  of  the  matrix  differential  Rieeati 
equation  (DRE) 

P{t)  = 

-P{t)A  -  A' Pit)  -  Qit)  +  Pit)BR-^it)B'Pit)  (22) 
Satisfying  the  final  eondition 

p(t  =  tf)  =  0.  (23) 

Henee  the  optimal  state  x*  is  the  solution  of 

x*(t)  =  [^4  -  BR-^it)B'Pit)]x*it).  (24) 

Therefore,  with  the  optimal  eontrol  u*(t),  the  required 
torque  T*(t)  ean  be  ealeulated  by 

T‘(t)  =  M{q(t)){qd(t)  -  w*(t))  +  N(q(t),q(t)).  (25) 

The  torque  T*(t)  is  eonverted  into  foree  by 

Foit)  =  T*it)/L,  (26) 

where  Foit)is  the  total  foree  output  of  the  index  finger 
and  L  is  the  length  of  the  finger.  In  this  present  work  L  is 
taken  as  2.5  inehes. 

VI.  RESULTS  AND  DISCUSSION 
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Fig.  1  Bloek  Diagram  of  Optimal  Controller  for 
Prosthetie  Hand. 


OPTIMAL  TRACKING 


Figure  1  shows  the  bloek  diagram  representation  of  the 
finite-time  linear  quadratie  optimal  eontroller  for  the 
prosthetie  hand.  The  objeetive  of  the  eontroller  is  for  the 
prosthetie  hand  finger  to  traek  optimally  the  foree  model. 

For  the  linear  system  (19),  the  finite-time  linear 
quadratie  optimal  eontrol  problem  ean  be  formulated  by 
defining  the  performanee  index  /  [14]  as 

]  =  -  j/^[x'(t)  Qit)xit)  +  u'(t)P(t)u(t)]  dt  (20) 

2  Cq 

where  Qit)  is  the  error  weighted  matrix;  and  P(t)  is 
the  eontrol  weighted  matrix.  The  optimal  eontrol  u*(t)  is 
deseribed  by 


Figure  2  shows  the  fusion  model  foree  T(t)  and  the 
foree  output  from  the  eontroller  F^it).  It  is  evident  that  the 
optimal  eontroller  ean  traek  the  ehanges  in  the  foree 
profile  and  follow  the  trends  in  referenee  foree  profile. 


Fig.  2.  Fusion  Referenee  Model  Foree  and  Aetual  Foree 


Figure  3  shows  the  error  between  the  model  foree  Y  it) 
and  the  foree  output  from  the  eontroller  F^it)  for  two 
different  sets  of  results  shown  in  Figs.  2  and  4.  This  figure 
shows  that  the  error  eonverged  to  zero  in  a  very  short  time 
and  the  error  is  hovering  between  zero  throughout  the  time 
interval.  In  some  instanees  the  foree  output  of  the 
eontroller  F^  it)  eannot  traek  the  rapidly  ehanging 
referenee  foree  profile  during  short  intervals.  The  Pearson 
eorrelation  eoeffieient  (see  Appendix)  for  the  referenee 


?(t)  and  controller  output  force  F^it)  profile  is  0.8714. 
Figure  4  shows  the  validation  with  a  different  reference 
force  ?(t)  profile  and  it  yields  0.8707  correlation,  thus 
showing  good  agreement  between  the  reference  model 
force  and  the  actual  force. 


Fig.  3.  Error  between  the  Model  Force  and  the  Actual 
Force 


VII.  Conclusion  and  future  work 

A  fusion-based  sEMG-force  model  was  utilized  to 
estimate  the  force  profile  that  a  prosthetic  hand  should 
track.  This  fusion  enables  to  get  better  force  estimates  than 
the  single  sensor  data.  The  dynamics  of  the  hand  was 
obtained  and  the  controller  for  optimal  tracking  between 
the  reference  model  and  the  hand  was  designed.  The 
proposed  design  gives  good  performance  when  tested  on  a 
prosthetic  hand,  based  on  tracking  a  reference  force 
profile.  In  future,  we  plan  to  implement  this  proposed 
control  strategy  on  a  micro  controller  for  real  time  control. 
It  would  be  interesting  to  implement  both  the  force  and 
position  control  using  this  control  strategy.  Finally,  we 
plan  to  use  the  hand  prototype  with  five  fingers. 

Appendix 

The  resulting  MISO  transfer  function  H(s)  is  constructed 
as. 

From  Ui  to  output, 

5^  -  3.8435^  +  7.7295^  -  10.785^  +  10.65^  -  7.4175^  +  3.6035^  -  0.97955  +  0.1192 
5^^  -  4.0285^  +  6.3255®  -  4.1215^  -  1.5455^  +  5.875^  -  5.4335^  +  2.285  -  0.3496 

From  U2  to  output, 

5^"-  4.3395^  +  9.0055*'-  12.425^  +  12.225^-  8.1175=' +  3.4275^  -  0.9134  5  +  0.1424 
58-  4.028  5^  +  6.32556-  4.121  5^-  1.54554  +  5.8753-  5.43352  +  2.28  5  -  0.3496 


From  U3  to  output, 

5®-  3.522  5^  +  6.655  5®-  8.864  5®  +  8.183  5^-  5.365  5®  +  2.423  5®-  0.557  5  +  0.09585 
58-  4.028  5^  +  6.325  5®-  4.1215^-  1.545  5^  +  5.87  5^  -  5.433  5^  +  2.28  5  -  0.3496 

where  U2,  U3  are  the  data  from  three  sensors. 

Pearson  correlation  coefficient  is  given  by, 

C0i7(X,r)  E[iX  -  -  Hy)] 

Px.Y  =  corr{X,  Y)  = - = - 

OxOy  OxCTy 

Where  X,  Y  are  Random  Variables,  fix  and  fiy  are 
expected  values,  dx,  Oy  are  standard  deviations 
respectively.  E  is  expected  value  operator. 
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Abstract —  This  paper  focuses  on  determining  the  sensitivity 
of  the  number  of  data  points  used  in  computing  the 
Kullback  Information  Criterion  (KIC)  for  the  use  in 
sensor  data  fusion.  The  primary  objective  of  the  sensor 
fusion  is  to  improve  the  extraction  of  dynamic  models 
relating  Surface  Electromyogrphic  (sEMG)  signals  with 
the  corresponding  skeletal  muscle  force  signals.  The 
proposed  approach  utilizes  a  pre-processing  of  the  sEMG 
data  with  a  Half-Gaussian  filter.  System  Identification 
techniques  are  employed  to  extract  a  relationship  between 
the  sEMG  and  the  skeletal  muscle  force.  In  this  paper 
linear  and  non-linear  models  are  inferred  from  the  fused 
data  to  describe  the  sEMG/force  relationship.  In  order  to 
optimize  the  number  of  data  points  for  finding  the 
optimum  KIC,  a  Genetic  Algorithm  (GA)  is  used. 

Keywords-Kullback  Information  Criterion,  Genetic  Algorithm, 
Half-Gaussian  filter,  Prostheses, 

I.  Introduction 

According  to  the  National  Limb  Loss  Information  Center 
analysis;  there  are  two  million  people  with  missing  upper  body 
limbs  living  in  the  United  States,  [1].  This  number  is 
increasing  due  to  ongoing  war  engagements,  and  it  is 
estimated  that  this  number  will  reach  3.6  million  by  the  year 
2050.  A  lot  of  effort  has  been  placed  on  research  dealing  with 
advanced  prosthetic  devices.  However,  up  to  date  there  are  no 
prosthetic  devices  available  that  mimic  the  full  functionality  of 
a  human  hand.  Moreover,  the  available  prosthetics  are  rather 


costly.  There  are  multiple  types  of  hand  prostheses.  One  of 
these  types  is  based  on  measuring  surface  Electromyographic 
(sEMG)  signals  to  initiate  the  actuation  of  the  robotic  hand, 
[2].  Since,  sEMG  signals  are  spatially  distributed,  the  sEMG 
probes  will  pick  up  signals  from  other  motor  units  stemming 
from  different  muscle  groups.  This  phenomenon  is  called 
crosstalk,  which  is  a  major  cause  for  the  difficulty  in 
extracting  hand  finger  motion  and  force  intends.  EMG  signals 
are  generated  by  the  simultaneous  firing  of  several  motor  units 
during  muscle  contraction,  [3].  Before  reaching  the  skin 
surface,  the  sEMG  signal  passes  through  numerous  layers  of 
tissues  [3],  which  leads  to  noise  and  interference  in  the  signal 
acquisition.  The  random  nature  of  the  EMG  signal  represents 
an  added  complexity  in  studying  it.  All  of  these  issues  make  it 
rather  complex  to  distinguish  the  content  of  the  EMG  signal 
against  noise  and  interference.  The  content  of  the  EMG  signal 
can  be  identified  based  on  amplitude,  frequency,  and 
amplitude-frequency  methods.  The  EMG  signal  is  time  and 
amplitude  modulated  as  well  as  spatially  and  temporally 
frequency  encoded,  [4].  In  [5]  a  novel  approach  was 
introduced  to  differentiate  the  onset  of  the  muscle  contraction. 
In  their  study.  Continuous  Wavelet  transforms  are  used  to 
identify  the  action  potential  of  the  individual  motor  units.. 

In  this  work,  an  array  of  three  sEMG  sensors  is  used  to 
improve  the  accuracy  of  the  sensed  information.  The  objective 
is  to  infer  the  intended  finger  force  of  a  transradial  hand 
amputee  using  sEMG  signals  collected  at  the  forearm  location. 
Array  sensors  use  multi-channel  EMG  electrodes  which  can 
be  embedded  into  a  small  surface  area  in  order  to  capture  the 


electrical  muscle  activity  from  a  set  of  muscles  fibers  at  the 
skin  level. 

In  [6],  a  multi-channel  methodology  is  proposed  where 
elements  of  the  sensor  array  are  discarded  based  on  the  quality 
of  the  signal.  In  the  present  work,  a  sensor  fusion  is  utilized 
that  is  based  on  the  Kullback  Information  Criterion  (KIC), 
System  Identification  (SI),  and  a  Genetic  Algorithm  (GA) 
based  optimization  scheme. 

Contrary  to  other  prosthetic  hand  designs,  in  this  work,  we 
seek  to  model  the  sEMG  and  finger  force  relationship  in  a 
dynamic  fashion.  While  other  smart  prosthetics  use  simple 
root  mean  square  (RMS)  values  to  initiate  a  pre-programmed 
motion  and  force  command  set,  in  this  work,  we  use  the 
measured  sEMG  signal  to  infer  directly  the  intended 
instantaneous  fingertip  forces.  We  acquire  data  using  three 
sEMG  sensors  and  the  corresponding  skeletal  muscle  force 
data  with  one  force  sensing  resistor  (FSR).  The  forces  are 
generated  with  the  corresponding  finger,  i.e.  the  proximal 
interphalangeal  (PIP)  joint  of  the  index  finger.  The  sEMG  and 
force  data  are  filtered  using  a  GA  based  optimized  Half- 
Gaussian  Bayesian  filter  and  a  Chebyshev  Type  II  filter, 
respectively.  For  three  sEMG  sensors,  three  Output  Error  (OE) 
models  of  order  6,  6,  and  10  and  nonlinear  Wiener- 
Hammerstein  models  of  order  10,  10  and  10  are  obtained 
using  system  identification.  The  OE  model’s  outputs  are  fused 
with  a  Kullback  Information  Criterion  (KIC)  based  data 
fusion.  KIC  uses  a  set  number  of  data  points  to  compute  the 
likelihood  of  the  models  influence  on  the  output.  The  authors 
have  not  found  in  the  literature  a  study  that  indicates  what  the 
optimal  number  of  data  points  is  for  computing  the  KIC 
coefficient.  Hence,  in  this  work  we  utilize  a  GA  based 
optimization  on  the  number  of  data  points  to  be  used  for  the 
computation  of  the  KIC  coefficient.  The  optimization  is  based 
on  the  correlation  of  the  fused  model  output  and  the  actual 
finger  force.  This  paper  is  organized  as  experimental  design, 
signal  pre-processing  and  system  identification,  Kullback 
information  criterion,  genetic  algorithm,  results  and  discussion 
and  conclusion  follow  this  section. 

II.  EXPERIMENT  DESIGN 

To  acquire  the  sEMG  signals,  experiments  are  carried  out 
on  a  healthy  male  subject  in  order  to  collect  the  data  from 
three  sEMG  sensors  corresponding  to  one  individual  motor 
point  and  locations  in  close  proximity  to  this  motor  point.  The 
motor  point  on  Flexor  Digitorum  Superficialis  (EDS)  muscle 
is  identified  by  using  a  wet  probe  point  muscle  stimulator 
(Rich-Mar  Corporation,  model  number  HV  1100.).  For  the 
acquisition  of  sEMG  data  from  the  skin  surface,  a  Delsys®, 
Bagnoli-16  channel  EMG  system  along  with  DE  2.1  pronged 
differential  surface  electrodes  is  used.  The  measurement  set¬ 
up  is  depicted  in  Fig.  1.  This  acquisition  system  has  the 
capability  of  amplifying  the  signal  internally  and  reducing  the 
acquisition  noise.  The  force  data  is  measured  by  an  Interlink™ 
Electronics  0.5”  circular  FSR.  Both  the  force  and  sEMG 
signals  are  acquired  at  2000  samples  per  second  using 
Lab  VIEW™. 


CPU  and  Monitor 


Figure  1 .  Measurement  set-up  for  aequiring  sEMG  and  fingertip  foree  data. 


III.  SIGNAL  PRE-PROCESSING  AND  SYSTEM 
IDENTIFICATION 

The  force  data  is  filtered  using  a  low-pass  Chebyshev  Type 
II  filter,  which  has  a  cut  off  frequency  of  550  Hz.  Since  the 
Bayesian  filters  can  monitor  the  rapid  changes  in  the  signal,  a 
Bayesian  Half-Gaussian  filter  is  used  to  filter  the  sEMG  data, 
see  Equation  (1).  A  Bayesian  filtering  method  may  potentially 
provide  a  good  EMG  signal  for  classification  purposes,  [7]. 
The  filter  has  not  been  investigated  in  terms  of  the  use  for 
system  identification,  where  the  output  forces  generated  by  the 
hand  are  modeled  based  on  the  measured  sEMG  data.  The 
Half-Gaussian  filter  is  given  by: 

exp] - ^ — [ 

piEMGM  =  2  ^  ^  (1) 

where  p{EMG\x)  is  the  conditional  probability,  x  is  the  latent 
driving  signal,  and  EMG  is  the  acquired  data.  The  EMG  signal 
is  modeled  for  the  conditional  probability  of  the  rectified 
EMG  signal  as  a  filtered  random  process  with  random  rate. 
The  likelihood  function  for  the  rate  evolves  in  time  according 
to  a  Fokker-Planck  partial  differential  equation,  [8].  The 
discrete  time  Fokker-Planck  equation  is  given  by  (2): 

p(^x,t-)-  ap(^x- £,t -  /?(x,^-l)  + 

api^x-\- £,t P P)  p(^x,t 

Here,  a  and  P  are  two  free  parameters,  where  a  is  the 
expected  rate  of  gradual  drift  in  the  signal,  and  P  is  the 
expected  rate  of  sudden  shifts  in  the  signal.  The  unknown 
driving  signal  x  is  discretized  into  bins  of  width  a.  These  two 
free  parameters  (a,P)  of  the  non-linear  Half-Gaussian  filter 
model  are  optimized  for  the  acquired  EMG  data  using  an 
elitism  based  GA. 

A  system  identification  technique  is  used  to  infer  the 
mathematical  relationship  between  the  measured  sEMG  data 
and  the  corresponding  finger  force  data.  In  this  work,  both 
linear  parametric  models  and  non-linear  models  are  used.  In 
particular,  output  error  models  and  Wiener-Hammerstein 


models  are  used.  For  both  of  these  cases,  sEMG  data  is  used  as 
the  input  and  the  corresponding  collected  fingertip  force  data  is 
the  output.  The  model  orders  for  the  various  models  are 
selected  as  6,  6  and  10  for  the  three  OE  models  M2  and 
M3,  corresponding  to  the  each  sensor  location.  For  the  Wiener- 
Hammerstein  (WH)  models,  the  orders  are  selected  as  10,  10 
and  10. 

The  linear  parametric  OE  model  structure  is  given  by 

y(0  =^w(t-nfe)  +  e(t),  (3) 

where  y  is  the  output  vector,  t  is  the  discrete  time  index, 

F(q),  A(q),  C(q),  and  are  polynomials,  q  is  a  backward 
shift  operator,  u  is  the  input,  is  the  delay  order,  and  e  is  the 
error. 


The  structure  of  the  non-linear  Wiener-Hammerstein  model 
is  given  by  Fig  2. 


The  correlation  is  computed  for  the  actual  force  and  fusion 
model  estimated  force.  The  Pearson  correlation  coefficient 
given  by  [9]  is  restated  below: 


Px,Y  =  corr{X,Y) 


COV(X,Y}  ^  E[{X-HxXY-tiY)] 

axCTy  o-xo-y 


(8) 


where  X,  Y  are  random  variables,  Mr  ^re  expected 

values,  standard  deviations  respectively.  E  is  the 

expected  value  operator. 


IV.  KULLB ACK  INFORMATION  CRITERION  DATA 
FUSION 

The  Kullback  Information  Criterion  (KIC)  is  a  symmetric 
measure  used  in  this  work  for  the  fusion  of  sEMG  sensor  array 
data.  Kullback’ s  symmetric  or  J-divergence  can  be  used  to 
measure  the  dissimilarity  in  models,  [10].  The  mathematical 
form  of  the  KIC  is  given  as: 


Figure  2.  Wiener  Hammerstein  bloek  diagram. 


The  linear  part  of  the  corresponding  equation  is  given  by 


KICipd=^\ogRi  +  ^^^-nxp^^  +  g(n)  (9) 

where,  n  is  the  number  of  data  points  pi  is  the  order  of  the 
model,  i/;  is  the  digamma  function,  and  g(n)  =  n  *  log  -. 

After  computing  the  KIC  for  each  of  the  three  models,  the 
following  fusion  algorithm  is  utilized  in  order  to  get  the 
overall  estimated  finger  force  y  ,  [11,  12]: 


yt(0  =  {f)udt-nk) 


(4) 


The  non-linear  equation  for  a  one-dimensional  polynomial 
is  given  by 

y  =  Fix)  (5) 

where  'F'  is  a  single-variable  polynomial  function  of 'x'. 


7.  Identify  the  OE/WH  models  M^,M2  using  sEMG 
data  (u)  as  input  and  fingertip  force  data  (y)  as  output,  for 
k  number  of  sEMG  sensors. 

2.  Compute  the  residual  square  norm 

R.  =  =  ||j;-j)||^  where  <9.  ={o^O.}  ^O^y  , 


and  O  = 


T 

y,+i 


y,-. 

T 


F(x)  =  c(l)x’^  +  c(2)x’^  ^  +  — I-  c(n)x  +  c(ji  +  1)  (6) 


The  polynomials  are  estimated  using  the  Matlab®  System 
Identification  toolbox.  In  this  process,  the  collected  input  and 
output  data  are  utilized  to  estimate  the  corresponding 
parameters  of  the  assumed  model  structures  (OE  and  WH)  with 
the  predefined  model  orders.  The  model  orders  were  selected  in 
a  trial-by  error  approach,  observing  which  combination 
provides  for  the  best  model  fit  value.  This  fit  value  is  computed 
using  the  following  equation: 


=  100 


|y-y| 

|y-y| 


(7) 


where  y  is  the  estimated  finger  force  using  the  identified 
models,  and  y  is  the  mean  output  signal. 


3.  Calculate  the  model  criteria  coefficient  using  (9). 

4.  Compute  the  model  probability  as  given  by 

p{M-  I  Z)  =  ,  where  /  is  the  model  selection 

He-’ 

7=1 

criteria  coefficient,  i.e.  KIC{p.) . 

k 

5.  Compute  the  fused  model  output  j)  ^  =  X  /^(M  -  |  Z)y  - 

7  i=l 


According  to  the  literature,  for  (9),  the  standard  number  of 
data  points,  n,  is  set  to  30.  However,  there  appears  to  be  no 
investigation  on  what  the  optimum  value  is  for  achieving  a 


good  fusion  output.  In  this  paper,  we  are  interested  in  finding 
an  optimum  value  for  n  with  regard  to  the  identification  and 
fusion  results  applied  to  finger  force  data  and  sEMG  data.  In 
particular,  the  search  for  an  optimum  value  is  also  limited  -  in 
order  to  preserve  the  computational  efficiency  -  to  a  range  of 
I5<n<l60. 

V.  GENETIC  ALGORITHM 


the  optimum  solution  to  overcome  local  minimums  and  locate 
the  global  minimum/optimum.  This  process  of  selection, 
mating,  and  mutation  is  repeated  a  number  of  times  until  the 
best  performing  candidate  solution  converges  to  some 
stationary  value.  The  flow  chart  representation  of  the  genetic 
algorithm  is  shown  in  Fig.  3. 

VI.  RESULTS 


The  objective  function  for  the  optimization  of  the  number 
of  data  points  used  in  the  KIC  fusion  based  algorithm  is 
formulated  by  the  squared  accumulative  absolute  value  of  the 
error  between  the  estimated  and  measured  muscle  force  data 
and  the  corresponding  correlation  between  the  resulting 
estimated  force  j)^  and  the  actual  force  y  .  In  particular,  the 
cost  function  is  given  by 

J  =  +v[corr\y,yjy  (8) 

where,  X  and  Pare  weighting  coefficients  and  corr()  is  the 
correlation  function. 


Fig.  4  and  depicts  a  sample  of  collected  sEMG  data,  and  the 
proposed  filtering  process  of  the  same  sEMG  data  using  a  Half 
Gaussian  Bayesian  filter.  Two  different  sampling  frequencies 
are  utilized  for  the  sEMG  data  collection.  Fig.  5  and  6  depict 
the  predicted  finger  force  obtained  by  using  the  linear  output 
error  model  and  the  actual  finger  force  for  the  cases  of  2000 
Hz  and  1000  Hz  sampling  rates.  In  case  of  2000  samples/sec, 
the  correlation  between  the  actual  force  and  estimated  force  is 
91%  and  the  error  is  0.0070,  where  as  in  case  of  using  1000 
Hz  the  correlation  between  the  actual  force  and  the  estimated 
force  is  86%  and  the  error  is  0.0108. 
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Figure  3.  Flow  chart  representation  of  a  genetic  algorithm. 


The  objective  function  is  used  in  a  elitism  based 
continuous  number  genetic  algorithm.  Genetic  algorithms  are 
evolutionary  algorithms  that  simulate  Darwin’s  survival  of  the 
fittest  principle.  The  initial  population  of  the  candidate 
solutions  is  randomly  generated  and  represented  as 
chromosomes  (where  the  genes  are  formed  as  each  parameter 
of  the  solution).  These  chromosomes  are  evaluated  based  on 
an  objective  function  and  ranked  in  terms  of  its  fitness.  A 
subset  of  the  next  generation  of  candidate  solutions  is  selected 
based  on  their  performance  with  the  objective  function.  The 
remaining  set  of  the  new  generation  is  produced  by  a  mating 
process,  where  the  best  performing  candidate  solutions 
comprise  the  subset  of  the  parents.  In  addition  to  the  mating 
process,  a  mutation  rate  is  also  imbedded  in  the  generation  of 
the  new  population.  The  mutation  rate  enables  the  search  for 


Filtered  sEMG  Signal 


Figure  4.  Unfiltered  and  filtered  sEMG  data  acquired  at  2000  sample/sec. 


Figure  5.  Measured  foree  vs.  estimated  foree  using  Output  Error  Models. 


Figure  6.  Measured  foree  vs.  estimated  foree  for  down  sampled  data  using 
Output  Error  Models. 


Figure  7.  Aetual  foree  and  fusion  model  estimated  foree  using  non-linear 
Wiener-Hammerstein  model. 

For  the  non-linear  Wiener-Hammerstein  models,  the 
correlation  between  the  actual  force  and  the  estimated  force  is 
independent  of  the  sampling  rate  and  is  89%  for  both  cases, 
1000  Hz  and  2000  Hz. 


The  literature  addressing  the  use  of  the  KIC  for  the  purpose  of 
data  fusion,  the  number  of  data  points  used  has  been  set  to 
some  small  number,  i.e.  quite  often  one  finds  w  =  30  . 
However,  there  is  no  analysis  existing  to  support  this 
selection.  Using  the  proposed  GA  and  objective  function  as 
defined  in  Equation  8,  and  the  two  model  structures  to 
characterize  the  sEMG  relationship  to  skeletal  muscle  force, 
the  resulting  quality  of  the  extracted  OE  and  WH  models  is 
rather  insensitive  to  the  number  of  data  points  used  to  compute 
the  KIC.  In  this  paper,  the  search  area  has  been  confined  to  a 
range  of  145  data  points  and  the  conclusions  are  to  be  made 
only  for  this  range.  The  extended  range  has  not  been  a  topic  of 
this  investigation  and  may  hold  improved  results.  However, 
the  computational  cost  increases  substantially  with  larger 
numbers  of  data  point  for  the  computation  of  the  KIC,  which 
is  reflected  in  longer  computation  times,  and  is  unpractical  for 
modelling  sEMG  signals  of  muscle  forces. 


Figure  8.  Actual  force  and  fusion  model  estimated  force  using  non-linear 
Wiener-Hammerstein  model  for  down  sampled  data. 


Figure  9.  Minimum  cost  for  GA  using  100  generations. 


The  minimum  cost  as  defined  by  Equation  8  for  a  GA 
using  100  generations  is  shown  for  each  iteration  in  the  Fig.  9 


TABLE  1.  COMPARISION  OF  OE  MODEE  PROBABIEITY  FOR  THREE 
SENSORS 


n 

pmzl 

pmz2 

pmz3 

corr 

30 

0.0059 

0.0059 

0.9882 

0.9151 

50 

0.0163 

0.0163 

0.9673 

0.9153 

75 

0.0311 

0.0311 

0.8832 

0.9155 

100 

0.0584 

0.0584 

0.8832 

0.9156 

For  Table  I  and  Il,pmzl,pmz2,pmz3  -  are  the  individual 
probabilities  of  the  models  M^,  M2  and  M3 ,  corr-  stands  for 
the  correlation  between  actual  force  and  estimated  force. 


in  the  fusion  algorithm  is  small  and  hence  small  numbers  can 
be  utilized  in  order  to  facilitate  computational  efficiency. 
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TABEE  11.  COMPARISION  OF  WH  MODEE  PROBABIEITY  FOR  THREE 
SENSORS 


n 

pmzl 

pmz2 

pmz3 

corr 

30 

0.3502 

0.3502 

0.2995 

0.8869 

50 

0.3565 

0.3565 

0.2869 

0.8893 

75 

0.4019 

0.4019 

0.1962 

0.8925 

100 

0.4273 

0.4273 

0.1454 

0.8928 

From  Table  I  and  Table  II,  we  can  infer  that  the  highest 
correlation  is  at  the  optimum  value.  However,  the  sensitivity 
with  respect  to  the  number  of  data  points  ‘n'  used  in  the  fusion 
algorithm  is  minimal.  This  implies  that  the  selection  of  the 
number  of  data  points  ‘n'  has  little  influence  on  the  fusion 
algorithm  and  can  be  chosen  small  in  order  to  preserve 
computational  efficiency. 

VII.  CONCLUSION 

In  summary,  this  paper  is  an  extension  of  our  previous  work  in 
order  to  find  the  optimum  data  points  used  in  computing  the 
KIC  for  the  use  in  a  fusion  technique.  This  addresses  a  void  in 
the  current  literature  where  KIC  is  used  for  model  probability 
and  model  fusion.  The  optimum  number  of  data  points  is 
found  in  this  paper  using  a  GA,  with  an  objective  function  that 
incorporates  the  extracted  linear  and  nonlinear  models  relating 
sEMG  data  and  skeletal  muscle  force  data.  The  sEMG  data  is 
pre-processed  using  a  Half-Gaussian  filter,  where  as  the  linear 
models  are  OE  models  and  the  non-linear  models  used  in  this 
investigation  are  WH  models.  The  primary  conclusion  of  this 
work  is  that  the  sensitivity  of  the  number  of  data  points  used 
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A  sEMG-SKELETAL  MUSCLE  FORCE  DATA  FUSION  BASED  ON 
MINIMUM  DESCRIPTION  LENGTH  CRITERION 


Madhavi  Anugolu,  Chandrasekhar  Potluri,  Steve  Chiu,  Alex  Urfer,  Jim  Creelman  and  Marco  P.  Schoen 


Ahstract-This  paper  provides  a  method  of  fusing  the 
sEMG/skeletal  muscle  force  sensor  array  data  using  a 
Minimum  Description  Length  (MDL)  data  fusion  algorithm. 
The  sEMG  data  and  the  corresponding  skeletal  muscle  force 
data  are  acquired  from  a  test  subject.  A  nonlinear  Bayesian 
Half-Gaussian  filter  is  utilized  to  filter  sEMG  data  and  the 
skeletal  muscle  force  signal  is  filtered  by  using  a  Chebyshev 
Type-II  filter.  A  System  Identification  Technique  is  employed 
to  derive  the  mathematical  relationship  between  the  sEMG 
(input)  and  the  skeletal  muscle  force  (output)  data.  We 
implemented  linear  and  nonlinear  parametric-  Auto- 
Regressive  with  exogenous  input  (ARX),  Auto-Regressive 
Moving  Average  with  exogenous  input  (ARMAX),  Output 
Error  (OE)  and  Weiner  Hammerstein  modeling.  The 
estimated  model  output  from  the  three  sensors  are  combined 
by  using  a  probabilistic  based  Minimum  Description  Length 
(MDL)  fusion  algorithm.  The  results  are  thought  provoking 
and  the  overall  fused  output  has  better  correlation  with  the 
actual  force  when  compared  with  the  individual  sensor 
estimated  force. 

Keywords:  sEMG,  hand  prostheses,  data  fusion,  system 
identification,  minimum  description  length  criterion 


1.  INTRODUCTION 

In  the  United  States,  there  are  more  that  2  million  amputees 
and  according  to  the  statistics  provided  by  the  National  Limb 
Loss  information  Center,  this  number  will  reach  3.6  million 
by  2050  [1]. 
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The  etiologies  of  hand  amputations  include  cardiovascular 
disease,  congential  deformities,  nerve  injuries,  tumors,  and 
trauma  [2].  Over  the  past  few  decades,  numerous  research  and 
clinical  studies  have  concentrated  on  the  field  of  prosthetics. 
Even  today,  however,  most  individuals  with  upper  extremity 
and  hand  amputations  have  difficulty  acquiring  an  affordable 
prosthesis  which  allows  for  good  functional  hand  motion.  [3] 
Due  to  recent  advances  in  technology,  a  great  interest  has 
emerged  in  the  design  of  a  better  hand  prosthesis  controlled 
by  integrated  Electromyographic  (EMG)  signaling.  In  general, 
the  EMG  signal  is  a  composition  of  action  potentials  produced 
by  the  electrical  activity  of  the  muscle  groups.  This  signal 
depends  on  the  flow  of  ions  such  as  sodium  (Na+),  calcium 
(Ca++),  and  potassium  (K+).  These  signals  can  be  measured 
either  by  inserting  the  needle  electrodes  into  the  muscle 
tissues  or  by  affixing  the  surface  electrodes  to  the  skin. 

In  this  work,  we  used  surface  Electromyographic  (sEMG)  data 
since  it  does  not  require  any  surgical  monitoring.  The  sEMG 
signals  can  be  used  in  various  engineering  and  clinical 
applications [4,  5].  One  must  be  careful  in  analyzing  sEMG 
signal  [6].  Especially  in  engineering  application,  sEMG  can 
be  used  to  control  the  position  and  force  of  the  prosthetic  hand 
[7].  The  sEMG  signal  amplitude  varies  from  person  to  person 
and  it  depends  on  the  applied  force.  Some  other  factors  like 
cross-talk  from  different  muscle  groups,  and  biochemical 
reactions  in  the  muscle  fibers  influence  the  sEMG/skeletal 
muscle  force  relationship.  Therefore,  these  factors  contribute 
to  randomness  and  complexity  of  the  sEMG  signal. 


From  our  particular  perspective,  it  is  desirable  to  combine  the 
data  from  the  array  of  sensors.  So,  in  this  work,  we 
implemented  a  Minimum  Description  Length  (MDL)  criterion 
to  fuse  the  sEMG/skeletal  muscle  force  data  from  the  three 
sensors.  After  collecting  the  data,  the  sEMG  signals  are 
filtered  using  a  Genetic  Algorithm  (GA)  based  nonlinear 
Bayesian  Half-Gaussian  filter.  The  skeletal  muscle  force  data 
is  filtered  by  using  a  Chebyshev  Type-II  filter.  Considering 
the  sEMG  as  input  and  skeletal  muscle  force  as  output. 
System  Identification  (SI)  technique  is  utilized  to  extract  the 
dynamic  relationship  between  the  sEMG  data  and  its 
corresponding  skeletal  muscle  force  data.  The  estimated 
output  models  are  fused  with  a  probabilistic  based  Minimum 
Description  Length  (MDL)  criterion. 


II  EXPERIMENTAL  DESIGN 


For  this  work,  the  experiments  were  conducted  on  a  healthy 
male  subject  to  acquire  the  sEMG  and  its  corresponding 
skeletal  muscle  force  signal.  Prior  skin  preparation  was  done 
by  following  the  ISEK  standards  [8].  A  muscle  point 
stimulator  manufactured  by  Richmar  Corporation™  was  used 
to  identify  the  muscle  motor  point.  For  this  particular 
experiment,  the  ring  finger  motor  location  on  the  flexor 
muscle  was  chosen.  Fig.  1  illustrates  the  experimental  design. 
Three  sensors  were  placed  on  the  skin  surface,  one  on  the  ring 
finger  flexor  digitorium  superficials  muscle  motor  point  and 
the  other  two  adjacent  to  it.  A  Delsys  Banglo-16,  was  used  to 
capture  the  sEMG  signal  and  the  Force  Sensitive  Resistor 
(FSR)  was  used  to  acquire  the  corresponding  skeletal  muscle 
force  signals.  Both  the  signals  were  acquired  through 
LAB  VIEW  at  a  sampling  rate  of  2000  sample/sec. 


CPU  and  Monitor 


where  p(EMG\x)  is  the  conditional  probability,  x  is  the  latent 
driving  signal,  and  EMG  is  the  acquired  data.  According  to 
Fokker-Planck  partial  differential  equation,  the  likelihood 
function  for  the  rate  evolves  in  time  [10].  The  discrete  time 
Fokker-Planck  equation  is  given  by  (2) 

p[x,t-)  «  ap(x-s,t  +  /?(x,^-l)  + 

ap(x  +  -l)  +  +  (l- p(x,t -l) 

Here,  a  and  P  are  two  free  parameters,  where  a  is  the 
expected  rate  of  gradual  drift  in  the  signal,  and  P  is  the 
expected  rate  of  sudden  shifts  in  the  signal.  The  unknown 
driving  signal  x  is  discretized  into  bins  of  width  a.  These  two 
free  parameters  (a,P)  of  the  non-linear  Half-Gaussian  filter 

model  are  optimized  for  the  acquired  EMG  data  using  an 
elitism  based  GA.  A  Chebyshev  Type-II  filter  with  550  Hz 
cutoff  frequency  is  used  to  filter  to  skeletal  muscle  force 
signal. 

Linear  and  nonlinear  System  Identification  Models: 

System  Identification  uses  statistical  methods  to  implement 
the  dynamic  relationship  between  the  measured  input/output 
data.  This  is  done  by  altering  the  parameters  within  a  given 
model  until  its  output  tracks  the  measured  input,  [11].  System 
identification  is  an  alternative  to  the  physical  based  modeling 
[11].  In  this  work,  linear  parametric  models-  Auto-Regressive 
with  exogenous  input  (ARX),  Auto-Regressive  Moving 
Average  with  exogenous  input  (ARMAX),  Output  Error  (OF) 
and  nonlinear  models-  Wiener  Hammerstein  are  implemented 

The  output  error  model  structure  is 


Fig.  1:  Experimental  Set-up 

III.  THEORITICAL  BACKGROUND 

The  sEMG  data  acquired  from  the  surface  of  the  skin  is 
rectified  and  filtered  using  a  GA  based  nonlinear  Bayesian 
Half-Gaussian  filter.  In  our  previous  work  [9]  we  explored 
different  filters  for  sEMG  filtration.  We  concluded  that  the 
Bayesian  Half-Gaussian  filter  works  better  when  compared  to 
other  filters  like  Butterworth,  Chebyshev,  Bayesian  Poisson. 
As  mentioned  earlier,  sEMG  depends  on  various  factors.  The 
relationship  between  the  actual  force  and  the  resulting  sEMG 
after  filtration  can  be  given  by  the  conditional  probability 
density  function  (EMG\x)  .  Under  the  assumption  that  the 
conditional  probability  of  the  rectified  EMG  signal  is  a 
filtered  random  process  at  a  random  rate  the  Half-Gaussian 
filter  is  given  by: 


(1) 


y(t)=^u(t-n,)  +  e(t)  (3) 

The  ARX  model  is  a  random  process.  It  predicts  the  output 
based  on  the  previous  output.  Its  mathematical  notation  is 
given  by  equation  (4) 

=  Biq)u(t  -  rifc)  +  e(t)  (4) 


Based  on  the  given  data,  the  ARMAX  model  predicts  the 
future  values  in  a  series.  The  mathematical  notation  is  given 
by  Equation  (5).  It  consists  of  two  parts,  the  autoregressive 
part  and  the  moving  average  part. 

Aiq)y(.t)  =  Biq)u(t  -  n^)  +  C(t)e(t)  (5) 

In  Equations  (3),  (4)  and  (5),  y  is  output,  t  is  time,  B(q),  F(q), 
A(q),  G(q),  D(q),  are  polynomials,  q  is  a  backward  shift 
operator,  u  is  input,  nk  is  delay  and  e  is  error 


p(EMG\x)  =  2 


Nonlinear  Wiener  Hammerstein 

A  model  with  a  fixed  nonlinearity  at  the  input  is  called  a 
Hammerstein  model.  When  the  nonlinearity  is  at  the  output  is 
called  a  Wiener  model.  The  combination  of  these  both  is  the 
Wiener-Hammerstein  model,  [11].  The  structural 
representation  of  the  Weiner-  Hammerstein  model  is  given  in 
Fig.  2,  [12].  It  consists  of  two  nonlinear  blocks  with  a  linear 
block  in  series. 


Fig.  2:  Weiner-Hammerstein  model  structural  representation 


1.  Identify  the  models  M2  ...  using  sEMG  data  (u)  as 
input  and  fingertip  force  data  (y)  as  output,  for  k  number 
of  sEMG  sensors. 

2.  Calculate  the  residual  square  norm 

R.  =  =  ||j;-j)||^  where  0.  ^  Oj"y  , 


3.  Model  criteria  coefficient  is  calculated  using  Equation 

(9). 

4.  Compute  the  model  probability  as  given  by 


and  O  = 


T 

yp.i 


The  mathematical  depiction  of  the  modeling  is  given  by, 
wit)  =  fiuit)) 

x{t)=  ‘•‘^^w{t-nk)  +  e{t)  , 

FjM) 

yit)  =  hixit))  , 
where  u{t)  is  the  sEMG  signal  and  y(t)  is  the  skeletal  muscle 
force  signal.  /  and  h  are  nonlinear  functions,  w(t)  and  x(t) 
are  internal  variables,  Bj  i(q)  and  Fj  i(q)  are  polynomials,  q  is 
the  back  shift  operator,  and  e(t)  is  the  output  error. 

Minimum  Description  Length  (MDL)  Criterion 

In  1978,  the  Minimum  Description  Length  (MDL)  concept 
was  introduced  by  Jorma  Rissanen  [13].  The  fundamental 
idea  behind  the  MDL  principle  is  based  on  the  algorithmic 
complexity  of  Solomonoff,  Kolmogorov  and  Chaitin  [14].  In 
this  work,  we  are  inspired  by  [15]  and  used  the  Minimum 
Description  Length  criterion  to  fuse  the  estimated  models.  It 
is  given  by 

MDLipi)  =  f  logCa^)  +  ^logF;  +  ,  (9) 

where  F;  =  -  Rd/iPi&l)  , 

Li  =  ^log(^)  , 

3^  =Fi  I 

‘  t(n-Pi)  ■ 

Based  on  [9  and  15],  the  following  fusion  algorithm  is 
implemented  for  sEMG-skeletal  muscle  models. 


(6) 

(7) 

(8) 


p(Mi  \  Z)  =  ,  where  /  is  the  model  selection 

H  e  ^ 

7=1 

criteria  coefficient,  i.e. 


5.  Compute  the  fused  model  output))  ^  =  Z  p{M-  \  Z)y- 

J  i=\  ^  ^ 


RESULTS  AND  DISCUSSION 

Fig  3.  shows  the  raw  sEMG  data  acquired  from  the  surface  of 
the  skin  Vs  the  sEMG  filtered  data  by  using  Bayesian  Half- 
gaussian  filter. 


UnflteredsEMG 


Fig. 3:  Raw  sEMG  data  Vs  filtered  Data 

Fig.  4  depicts  the  actual  skeletal  muscle  force  data  Vs  the 
filtered  force  data  using  Chebyshev  type-II  filter. 


Actual  Force 


Fig.  4:  Actual  force  and  filtered  force  using  Chebyshev  Type- 
II  filter 


Fig.  5.  Actual  force  and  the  overall  estimated  force  for  the 
Output  Error  (OE)  Models 


TABLE  I:  INVIDUAL  ESTIMATED  LINEAR  PARAMETRIC  MODELS 
AND  THE  OVERALL  FUSED  OUTPUT 


SI  Models 

Ml 

M2 

Ms 

% 

ARX 

12.77 

17.57 

33.5 

43.2 

ARMAX 

11.6 

14.6 

35 

46.1 

OE 

54.42 

60.39 

64.96 

75.6 

Table  I  gives  the  individual  estimated  model  correlation 
values  (Ml,  M2,  M3)  of  the  three  sensors. 
Yf  gives  the  overall  fused  force  correlation  values  for  the  linear 
parametric  models.  The  individual  models  are  computed  by 
using  the  SI  technique  -  ARX,  ARMAX,  OE.  In  all  the  cases, 
the  values  are  high  for  M3  which  is  the  estimated  model 
output  for  the  sensor  placed  on  the  motor  unit.  All  the  three 
models  are  fused  by  using  the  above  proposed  Minimum 
Description  Length  based  fusion  algorithm.  Even  thought,  the 
fusion  algorithm  shows  improvement  in  the  overall  correlation 
value,  the  proposed  fusion  algorithm  worked  best  for  the 
linear  Output  Error  (OE)  models. 


TABLE  II:  INVIDUAL  ESTIMATED  NONLINEAR  MODELS  AND  THE 
OVERALL  FUSED  OUTPUT 


SI  Models 

Ml 

M2 

Ms 

% 

WH 

52.37 

56.8 

60.35 

70.32 

Table  II  gives  the  individual  estimated  nonlinear  Wiener 
Hammerstein  models  and  the  overall  fused  output  using  a 
MDL  criterion  based  fusion  algorithm.  Fig  5  gives  the  plots  of 
the  actual  skeletal  muscle  force  and  the  overall  fused  output 
from  the  MDL  fusion  algorithm  for  OE  models. 


IV  CONCLUSION  AND  FUTURE  WORK 

In  this  paper,  we  addressed  a  methodology  to  fuse  the 
sEMG/skeletal  muscle  force  data  using  a  Minimum 
Description  Length  (MDL)  criterion  based  fusion  algorithm. 
Compared  to  the  individual  estimated  models,  the  fusion- 
based  output  is  showing  improvement  in  correlation  with  the 
actual  force. 

In  the  future,  we  are  planning  to  implement  the  same  criteria 
for  the  spectral  models  [17]  and  to  work  on  larger  data  sets 
and  apply  this  proposed  fusion  algorithm  to  them  for 
generalization. 
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Abstract:  -  This  paper  presents  a  novel  approach  of  a  surface  electromyographic  (sEMG)-based,  real-time 
Model  Reference  Adaptive  Control  (MRAC)  strategy  for  joint  angle  estimation  and  control  of  a  prosthetic  hand 
prototype.  The  proposed  design  is  capable  of  decoding  the  pre-recorded  sEMG  signal  as  well  as  the  sensory 
force  feedback  from  the  sensors  to  control  the  joint  angle  of  the  prosthetic  hand  prototype  using  a  PIC 
32MX360F512L  microcontroller.  The  input  sEMG  signal  is  rectified,  filtered  using  a  Half-Gaussian  filter  and 
fed  to  a  Kullback  Information  Criterion  (KIC)  based  fusion  algorithm,  which  give  the  overall  estimated  joint 
angle  (position).  This  estimated  angle  is  given  as  input  to  the  prosthetic  hand  prototype.  Then  the  MRAC  along 
with  a  two  stage  proposed  embedded  design  is  used  for  the  position  control  of  the  prosthetic  hand.  For  the  real¬ 
time  operation,  the  measured  angle  data  at  the  joint  is  fed  back  to  the  controller.  The  data  is  transmitted  to  the 
computer  through  a  universal  asynchronous  receiver/transmitter  (UART)  interface  of  the  proposed  embedded 
design.  The  experimental  results  in  real  time  show  good  performance  in  controlling  the  angle  of  the  prosthetic 
hand  prototype. 


Key-Words:  -  sEMG,  Data  fusion,  Kullback  Information  Criterion,  MRAC,  Angle  control 


1  Introduction 

For  60  years,  there  has  been  active  research  going 
on  in  the  area  of  Prostheses.  Due  to  the 
unavailability  of  prosthetic  devices  with  full  human 
hand  functionality  at  an  affordable  price,  more  than 
30%  of  upper  extremity  amputees  chose  not  to  use 
a  prosthetic  device  on  regular  basis  [1,  2].  Besides 
that,  most  of  the  available  prosthetic  devices  do  not 
have  tactile  or  proprioceptive  feedback  [3].  Previous 
researchers  insisted  that  human-centered  robots 
must  be  independent  with  a  great  functionality, 
comfort  and  ease  of  use  [4].  In  rehabilitation 
robotics,  human-machine  interface,  which  requires  a 
natural  means  of  communication,  is  an  interesting 
domain  [5].  The  electromyographic  (EMG)  signal  is 
the  electric  potential  generated  by  muscles.  There 
are  two  kinds  of  EMG  signals:  Intramuscular 
(needle)  EMG  and  the  Surface  EMG  (sEMG). 
Under  the  assumption  that  amputation  is  transradial 
and  which  does  not  require  surgery,  we  relied  on 
sEMG  signals  in  this  work  whose  amplitude  ranges 
from  -5  to  +5  (mV).  sEMG  signals  are  acquired 
from  the  surface  of  the  skin,  as  they  penetrate 
through  various  tissue  layers  [6].  Thus,  they  tend  to 
create  cross-talk,  interference  and  noise.  The  sEMG 
is  a  temporally  and  spatially  composed  signal  [7]. 


Due  to  the  complexity  and  nonlinearity  of  the 
human  hand,  the  control  of  a  multi-fmgered 
prosthetic  hand  is  a  challenging  task  [8].  From  the 
past  research,  it  is  clear  that  the  most  widespread 
approach  for  controlling  the  prosthetic  hand  is  by 
using  a  position  or  force  control  [9].  The 
challenging  task  involved  in  this  work  is  the 
prediction  of  the  Proximal  Inter  Phalangeal  (PIP) 
joint  angle  corresponding  to  the  sEMG  signal. 

In  this  paper,  we  used  a  three-by-three  array  of 
sEMG  sensors  and  a  wheel  potentiometer  device  to 
acquire  the  EMG  signal  and  the  corresponding  PIP 
joint  angle.  The  data  from  the  array  of  sEMG 
sensors  were  fused  using  a  probability  based  fusion 
algorithm  in  order  to  have  a  better  estimate  [10].  A 
real-time  embedded  MRAC  control  system  with 
sensory  feedback  was  implemented  to  accomplish 
the  goal  of  this  design.  Considering  the  probability 
based  fused  joint  angle  estimate  as  input  to  the  real¬ 
time  control  system,  a  two  stage  embedded  platform 
with  a  simple  MRAC  strategy  was  chosen  for  the 
PIP  joint  angle  control  of  the  prosthetic  hand 
prototype. 


Fig.l:  Experimental  set-up. 


Fig.l.  illustrates  the  experimental  design  used  in  this 
work  for  eapturing  the  sEMG  signal  and  the 
eorresponding  joint  angle  of  the  PIP  joint  of  the 
index  finger.  Prior  to  plaeing  the  sEMG  sensors  on 
the  skin  surfaee,  the  test  subjeet  was  prepared 
aeeording  to  ISEK  standards  [11].  The  motor  point 
was  identified  by  using  a  wet  probe  musele  point 
stimulator  (Riehmar  HV-1000).  Nine  DE-3.1  sEMG 
sensors  of  the  DELSYS  Bagnoli-16  EMG  system 
were  arranged  on  the  skin  surfaee  in  a  three-by-three 
array.  The  middle  row  of  sensors  was  plaeed  on  the 
motor  point  of  the  index  finger.  An  angle 
measurement  deviee  was  designed  using  a  10k- 
Ohm  wheel  potentiometer  shown  in  Fig.l.  It  was 
used  to  measure  the  PIP  joint  angle.  Foree  Sensitive 
Resistor  (FSR)  was  mounted  on  the  stress  ball  and 
was  used  to  measure  the  foree.  All  the  data  was 
aequired  at  a  sampling  rate  of  2000  samples/see. 

3  Proposed  Design 

The  objeetive  of  the  proposed  design  is  to  traek  a 
joint  angle  of  the  prosthetie  hand  as  elosely  as 
possible.  Here,  the  joint  angle  signal  is  inferred  from 
the  sEMG  signals  obtained  from  the  array  of  the 
sEMG  sensors  loeated  at  the  arm. 

Sensor  fusion  is  done  in  the  time  domain  for  the 
sEMG  data  using  a  probability  based  Kullbaek 
information  eriterion  (KIC)  fusion  algorithm.  The 
data  from  the  nine  sensors  were  eolleeted  around  the 
eorresponding  individual  motor  unit  at  the 
transradial  arm  loeation  (flexor  digitorum 
superfieialis)  and  before  fusing  the  sEMG  signals 
are  reetified  and  filtered  using  a  Half  -Gaussian 
filter,  as  given  by  (1). 


exp 


f  EMG^\ 

V 


^2nx^  ’ 


(1) 


where  p(EMG\x)  is  a  eonditional  probability 
density  funetion,  x  is  a  latent  driving  signal. 

A  System  Identifieation  (SI)  tool  was  used  to 
determine  the  dynamie  relationship  between  the 
input-output  data.  The  sEMG  signal  was  used  as 
input  and  the  eorresponding  PIP  joint  angle  as 
output.  In  partieular,  nonlinear  Wiener  Hammerstein 
one-dimensional  polynomial  models  were  obtained 
for  the  sEMG/joint  angle  data. 


The  mathematieal  representation 

of  the 

modeling  is  given  by, 

w(t)  =  /(u(t)) 

(2) 

x(t)  =  w(t  nk)  +  e(t) 

(3) 

y(t)  =  h(x(t)) 

(4) 

where  u(t)  is  the  sEMG  signal  and  y(t)  is  the  PIP 
joint  angle,  f  and  h  are  nonlinear  funetions,  w(t) 
and  x(t)  are  internal  variables,  Bj  i(q)  and  Fj  i(q) 
are  polynomials,  q  is  the  baek  shift  operator,  and 
e(t)  is  the  output  error.  From  (3),  the  WH  model 
strueture  utilizes  a  linear  OE  model,  whieh  is  given 

by, 

y(.t)  =  ^u(t  -  nk)  +  eit)  (5) 

where  nk  is  the  system  delay  and  t  is  time  index 

The  resulting  nine  WH  models  were  fused  together 
by  using  a  probabilistie  KIC  algorithm  [12].  It 
assigns  a  partieular  probability  to  eaeh  model  [13]. 
The  overall  estimated  model  output  and  the 
individual  models  outputs  were  eompared  by  using 
the  Pearson’s  eorrelation  eoeffieient. 

From  the  previous  researeh,  it  was  shown  that  the 
KIC  algorithm  performs  better  than  the  other  eriteria 
[10,  12].  KIC  is  an  asymmetrie  measure  of  the 
models’  dissimilarity  whieh  ean  be  obtained  by  the 
sum  of  the  two  direeted  divergenees  known  as  J- 
divergenee  or  Kullbaek’ s  symmetrie  [14].  It  is  given 
by 

KICipd  =  ^logRi  +  ^^j^-mp(^)  +  g(n-)  (6) 

Where  g(n)  =  n^ \og(n / 2) ,  I//  -  digamma  funetion. 

The  probability  based  fusion  algorithm  given  by 
[12,  13]  is  applied  to  the  nonlinear  models  obtained 
by  using  an  SI  teehnique  with  the  following  steps: 


p(EMG\x)  =  2  X 


1:  The  WH  models  are  obtained  by  considering  the 
sEMG  data  u(t)  as  input  and  joint  angle  Y  as 
output, 

2:  Calculate  the  residual  square  norm  i.e., 

K  =7-0  ,.4  =  \\Y-Yj 

where  0.  =  |o/  O. }  0^7  ,and 


the  error  e  =  Y  —  Y^  was  calculated  by  the 
difference  of  the  model  reference  output  7^  and  the 
actual  output  Ooint  angle  generated  by  the  prosthetic 
hand).  Different  MRAC  stability  issues  were 
addressed  in  [14,  15]. 

Reference  Model  Derivation 

The  dynamic  equations  of  motion  for  the  hand  are 
obtained  from  the  Lagrangian  approach  as  [16] 

^  [0  ol  '''  III 


3:  Compute  the  model  criteria  coefficients  using  (6). 

4:  The  model  probability  can  be  computed  using 
p{MXt)\Z)  =  -^ 

J=1 

5:  The  fused  model  output  can  be  calculated  using 


Fig.2:  Block  diagram  representation  of  Model 
Reference  Adaptive  Controller  (MRAC) 


The  control  input  vector  u(t)  was  given  by 

u(t)  =  -  T(t)].  (9) 

As  the  prosthetic  hand  is  required  to  track  the 
desired  angle  profile  qa(t)  described  under  the 
reference  angle  model,  the  tracking  error  e(t)  is 
defined  as 

e(.t)  =  qd(.t)  -  q(t).  (10) 

Here,  is  the  desired  angle  vector  of  the 

joints  and  can  be  obtained  by  the  reference  angle 
model  [17];  q(t)  is  the  actual  angle  vector  of  the 
joints.  Differentiating  (10)  twice,  we  get, 

eit)  =  4d(t)  -  qit)  ,  e(t)  =  ^ciCO  -  9(0-  (H) 
Substituting  q(t)into  (11)  gives 


A  simple  MRAC  based  scheme  (Fig.  2)  is  utilized 
for  compensating  the  dynamics  of  the  prosthetic 
hand.  During  the  development  of  the  artificial  hand, 
changes  were  being  undertaken  to  the  mechanical 
design  and  drive  trains  of  the  hand  that  affect  the 
dynamics  of  the  finger  motion  of  the  prosthesis.  In 
addition,  the  uncertain  characteristics  of  the 
kinematic  and  actuator  interaction  could  have  led  to 
a  different  performance  than  expected.  Therefore,  a 
simple  MRAC  controller  was  developed  in  order  to 
maintain  some  performance  stability.  For  updating 
the  controller  parameter  6,  the  MIT  rule  was  used. 

=  -reYm  .  (7) 

According  to  the  MIT  rule  [15],  the  gain 
parameter  y  was  selected  to  achieve  the  desired 
performance.  In  this  work  y  was  taken  as  3.0  and 


e(t)  =  qd(t)  +  M  ^{q(,t))[N{q(t),qit))  -  t(12) 

From  (12)  the  control  function  u(t)can  be  defined 
as 

u(t)  =  (jdit)  +  M-'^{q(t))[N(q(t),q(t))  - 
T(t)].  (13) 

This  is  often  called  the  feedback  linearization 
control  law,  rewriting  (13)  as, 

T(t)  = 

M{q(t))[qd(t)  -  u(t)  +  N{q(t),q(t))]  (14) 

Using  (11)  and  (13),  the  state  vector  x(t)  = 
[e'(t)e'(t)Y,  the  state-space  model  can  be 
represented  as 


(15) 

Now,  (15)  is  in  the  form  of  a  linear  system  such 
as 

x(t)  =  Ax(t)  +  Bu(t)  .  (16) 

Implementation: 

The  proposed  control  design  was  implemented  on 
a  PIC  32MX360F512L  microcontroller  in  two 
stages:  “Signal  Processing”  and  “Motor  Actuation”. 
The  Signal  Processing  stage  enables  the  execution 
and  implementation  of  real-time  control  strategies. 
A  dsPIC  block  set  was  used  to  generate  the  C  code 
for  the  PIC  32  from  Simulink®.  The  dsPIC  block  set 
generates  a  .hex  file,  and  this  file  was  imported  in 
MPLAB®  to  program  the  PIC  32. 

Signal  Processing  Stage: 

From  the  many  modules  available  on  PIC  32,  the 
following  four  modules  were  utilized  for  the 
implementation  of  the  signal  processing  stage: 
Analog  Input  Module,  Digital  Output  module. 
Output  Compare  module,  and  URAT  module. 

The  sensory  feedback  joint  angle  data  from  the 
wheel  potentiometer  was  acquired  through  the 
Analog  Input  module.  Based  on  the  selected  control 
strategy  for  the  motor  actuation  stage,  the  digital 
control  signals  were  generated  by  the  Digital  Output 
module  of  the  PIC  32.  The  changes  in  the 
reference/command  signal  were  detected  by  this 
module.  A  pulse  width  modulated  (PWM)  wave 
with  a  specific  duty  cycle  was  generated  by  the 
Output  Compare  module  based  on  the  error.  The 
angle  data  from  the  microcontroller  to  the  PC  was 
transmitted  by  the  UART  module  via  serial 
communication.  In  this  particular  design,  the  data 
was  fed  to  the  computer  by  a  virtual  com  port  via 
USB  cable.  The  signals  from  the  ports  were  read  by 
MATLAB®. 

Motor  Actuation  Stage: 

In  this  stage,  the  motor  was  actuated  with  a 
SN754410  quadruple  half-H  driver  [18]  with  the 
corresponding  control  signal.  This  proposed  design 
was  tested  on  the  index  finger  of  a  prosthetic  hand 
prototype.  Fig.  3  shows  the  test  bed  for  the  proposed 
design. 


Fig.  3.  Embedded  Test  bed  for  the  proposed  design 
Mechanical  structure  of  the  robotic  hand  prototype: 

The  prosthetic  hand  prototype  finger  has  three 
degrees  of  freedom  stimulated  by  two  Pololu  35:1 
mini  metal  gear  motors.  Biologically  inspired 
parallel  actuation  is  the  main  characteristic  of  this 
robotic  hand  prototype.  It  is  based  on  the 
behaviour/strength  space  of  the  Flexor  Digitorum 
Profundus  (FDP)  and  the  Flexor  Digitorum 
Superficialis  (FDS)  muscles  [19].  Using  a  belt 
transmission  system,  the  DC  motor  in  the 
metacarpal  phalange  of  the  finger  triggers  the 
Proximal  Inter  Phalangeal  (PIP)  joint.  It  also  drives 
the  DIP  (Distal  Inter  Phalangeal)  joint.  The  Meta 
Carpo  Phalangeal  (MCP)  joint  is  actuated  by  the  DC 
motor  located  at  the  base  of  the  finger  as  shown  in 
Fig.  4. 


Fig.  4.  Finger  Actuation  Scheme 


4  Results  and  Discussion 

Data  was  acquired  from  the  microcontroller  through 
UART  channel2  of  the  PIC  32  micro  controller  by  a 
virtual  com  port  via  USB  at  a  57600  baud  rate.  The 
data  from  the  microcontroller  was  converted  into 
unit  16  data  type  before  it  is  transmitted  through  the 
UART.  It  ran  at  an  external  clock  frequency  of 
8MHz  with  internal  scaling  enabled.  Fig.  5  depicts 
the  experimental  results  of  the  proposed  design.  The 
actual  angle  output  from  the  position  sensor  (i.e.T) 


closely  follows  the  fusion  algorithm  estimated  angle 
Y.  Fig.  6  shows  the  fusion  estimated  angle 
profile  Y  and  actual  angle  from  the  position  sensor 
(F)  plotted  for  a  separate  experiment.  Fig.  7  shows 
the  repeated  experimental  results.  The  proposed 
control  strategy  was  tracking  angle  profile  and 
matching  the  actual  angle  profile  with  the  model 
estimated  angle  ( Y). 


Fig.  5.  Fusion  based  angle  estimate  and  actual  angle 
from  angle  sensor  during  the  grasp  action. 


from  angle  sensor  during  the  grasp  action  (for 
experiment-2). 


from  angle  sensor  during  the  grasp  action  (for 
experiment-3). 


Fig.  8.  Validation  Plot. 


While  conducting  the  experiments,  the  following 
observations  were  made.  The  DC  motors  currently 
employed  have  the  primary  task  of  moving  the 
prosthetic  fingers.  As  the  project  is  on-going  ,  the 
Shape  Memory  Alloy  (SMA)  actuation  scheme  has 


not  yet  been  implemented  because  of  the  slow 
response  of  the  SMA’s,  and  also  because  SMA’s 
have  a  long  relaxation  time.  Therefore  it  is  difficult 
to  track  a  randomly  changing  angle  profile  with  a 
slowly  responding  actuation  system.  However,  as 
the  prosthetic  hand  prototype  is  designed  to  use  the 
parallel  actuation  of  these  DC  motors  and  SMA’s, 
the  DC  motors  alone  cannot  produce  a  fusion 
algorithm  estimated  angle  profile. 

In  this  work,  the  DC  motors  are  solely  responsible 
for  motion  actuation.  Since  the  DC  motors  have 
small  gear  heads,  the  usual  characteristic  of  gear 
driver  actuation  cores  occurs:  gear  backlash.  In 
addition,  the  DC  motors  employed  were  slow  in 
responding  to  the  changes  in  the  force  profile. 
Hence  some  gaps  and  delay  were  observed  in  the 
measured  angle  signal.  However,  the  profile  of  the 
measured  angle  from  the  angle  sensor  has  a  similar 
pattern  as  the  fusion  algorithm  estimated  angle  (  Y). 
Thus  we  can  conclude  that  apart  from  those 
mechanical  transmission  problems,  the  implemented 
control  scheme  produced  promising  results.  These 
problems  will  be  considered  in  a  new  prototype 
design  that  we  are  currently  developing. 

From  the  results,  it  is  also  evident  from  Figs.  5,  6 
and  7  that  the  controller  is  tracking  the  slow  changes 
in  the  angle  profile  very  well,  where  as  a  small 
delay  was  observed  while  tracking  the  angle  profile. 
In  order  to  test  the  precision  of  the  proposed  control 
strategy,  15  different  experiments  were  conducted. 
The  mean  of  the  Pearson's  correlation  coefficient  for 
the  fusion  algorithm  estimated  angle  ( F)  and  the 
actual  angle  from  the  angle  sensor  (F)  in  all  the  15 
experiments  is  0.86.  Because  of  the  above 
mentioned  transmission  problems  and  the  slow 
response  of  the  gears,  slight  variability  is  observed 
in  the  correlation  coefficients  for  the  15 
experiments.  Hence  the  difference  in  tracking  the 
angle  profile  is  observed  in  Figs.  6  and  7.  Fig.  8 
depicts  the  validation  plot  with  a  different  fusion 
algorithm  angle  estimate  F  obtained  by  feeding  a 
different  sEMG. 

5.  Conclusion  and  Future  Work 

In  this  paper,  based  on  sEMG  signals,  we 
proposed  a  two-stage  real-time  embedded 
MRAC  strategy  for  a  prosthetic  hand  prototype. 
The  proposed  design  was  based  on  tracking  a 
reference  angle  profile  and  it  gives  good 
performance  when  tested  on  a  prosthetic  hand 
prototype.  This  design  enables  the  transmission 
of  the  data  from  the  microcontroller  to  the 


computer.  This  design  allows  the  control 
engineer  to  increase  the  accuracy  and 
performance  of  the  design  by  implementing 
various  novel  control  strategies  and  also  enables 
fast  trouble  shooting. 

For  future  work,  we  are  planning  to  use  the 
above  mentioned  embedded  platform  to 
implement  online  model-based  skeletal  muscle 
angle  estimation  along  with  controller  designs 
that  address  the  above  listed  mechanical 
shortcomings.  It  will  be  valuable  to  acquire  the 
sEMG  signal  directly  from  the  arm  of  a  healthy 
subject  and  transmit  to  our  embedded  system 
rather  than  using  pre-recorded  sEMG  signals, 
which  will  be  investigated  as  well  in  the  future. 
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Abstract —  In  this  paper,  we  present  a  method  of  combining 
spectral  models  using  a  Kullback  Information  Criterion  (KIC) 
data  fusion  algorithm.  Surface  Electromyographic  (sEMG) 
signals  and  their  corresponding  skeletal  muscle  force  signals 
are  acquired  from  three  sensors  and  pre-processed  using  a 
Half-Gaussian  filter  and  a  Chebyshev  Type-  II  filter, 
respectively.  Spectral  models  -  Spectral  Analysis  (SPA), 
Empirical  Transfer  Function  Estimate  (ETFE),  Spectral 
Analysis  with  Frequency  Dependent  Resolution  (SPFRD)  -  are 
extracted  from  sEMG  signals  as  input  and  skeletal  muscle  force 
as  output  signal.  These  signals  are  then  employed  in  a  System 
Identification  (SI)  routine  to  establish  the  dynamic  models 
relating  the  input  and  output.  After  the  individual  models  are 
extracted,  the  models  are  fused  by  a  probability  based  KIC 
fusion  algorithm.  The  results  show  that  the  SPFRD  spectral 
models  perform  better  than  SPA  and  ETFE  models  in  modeling 
the  frequency  content  of  the  sEMG/skeletal  muscle  force  data. 

1.  INTRODUCTION 

There  are  approximately  1.7  million  people  living  with  an 
amputation  in  the  United  States  according  to  the  amputation 
statistics  provided  by  the  National  Limb  Loss  Information 
Center.  It  has  also  been  suggested  that  one  out  of  every  200 
people  in  the  U.S.  has  had  an  amputation  [1].  H.  Piper  [2] 
introduced  the  first  investigation  into  Electro  Myographic 
(EMG)  signals  in  1921.  EMG  signals  can  be  used  in  various 
applications  such  as  clinical  diagnosis,  engineering 
applications,  physical  therapy,  etc.  During  the  past  few 
decades,  a  wide  array  of  studies  have  focused  on  the 
functionality  of  various  upper  extremity  prostheses  but 

Chandrasekhar  Potluri  is  with  Measurement  and  Control  Engineering 
Research  Center  (MCERC),  Idaho  State  University,  Pocatello,  Idaho  83201 
USA  (e-mail:  potlchan@isu.edu). 

Madhavi  Anugolu  is  with  MCERC,  Idaho  State  University,  Pocatello,  Idaho 
83201  USA  (e-mail:  anugmadh@isu.edu). 

Steve  Chiu  is  with  Department  of  Electrical  Engineering  and  Computer 
Science,  MCERC,  Idaho  State  University,  Pocatello,  Idaho  83201  USA 
(email:chiustev@isu.edu). 

Alex  Urfer  is  with  Department  of  Physical  and  Occupational  Therapy, 
Idaho  State  University,  Pocatello,  Idaho  83209,  (email:urfealex@isu.edu) 
Marco  P.  Schoen  is  with  Department  of  Mechanical  Engineering,  MCERC, 
Idaho  State  University,  Pocatello,  Idaho  83201  USA  (e- 
mail :  schomarc@isu.edu) . 

D.  Subbaram  Naidu  is  with  Department  of  Electrical  Engineering  and 
Computer  Science,  MCERC,  Idaho  State  University,  Pocatello,  Idaho 
83201  USA  (email:  naiduds@isu.edu). 


investigators  have  yet  to  put  forth  a  cost  effective  prosthesis 
that  truly  simulates  normal  human  hand  function  [3].  The 
electromyographic  (EMG)  signal  is  the  primary  electrical 
activity  of  the  skeletal  muscles.  These  signals  can  be 
detected  either  with  sensors  placed  on  the  surface  of  the  skin 
or  with  needle  sensors  inserted  into  the  muscle  tissue.  In  this 
work,  noninvasive  technique  is  used  to  acquire  the  surface 
electro-myographic  (sEMG)  signals  [4].  During  muscle 
contraction,  many  motor  units  are  activated  at  the  same  time. 
This  contributes  to  interferences  with  the  sEMG  signal  and 
cross  talk,  which  is  a  major  issue  in  accurate  sEMG  signal 
monitoring  [5].  The  number  of  motor  units  in  individual 
muscles  varies  from  person  to  person.  Muscle  fatigue  begins 
at  the  onset  of  muscle  contraction  and  progressively 
continues  throughout  the  time  of  the  muscle  activation. 
Fatigue  will  induce  an  increase  in  motor  unit  recruitment  and 
a  decrease  in  mean  medium  frequency  in  the  sEMG  signal. 
The  sEMG  signals  pass  through  numerous  layers  of  tissues 
before  reaching  the  skin  surface  [5].  The  uncertainty  of  the 
sEMG  signal  presents  a  special  challenge  in  their  analysis. 
All  of  these  factors  increase  the  complexity  of 
discriminating  the  content  of  the  EMG  signal  against  noise 
and  interference.  Identification  of  the  content  of  the  EMG 
signal  should  focus  on  the  amplitude,  frequency  and 
amplitude-frequency  using  distinct  methods.  As  the  EMG 
signal  is  time  dependent  and  amplitude  modulated,  it  is 
spatially  and  temporally  frequency  encoded  [6].  From  the 
literature,  it  is  apparent  that  sensor  data  fusion  improves  the 
output  measurement  quality  [4].  In  [7],  a  multi-channel  grid 
surface  electrode  is  employed.  Using  this,  the  spatial  and 
temporal  aspects  of  time  varying  potential  distribution  of  the 
sensors  on  the  skin  can  be  recognized.  sEMG  data  fusion 
algorithms  were  designed  by  the  authors  using  time  domain 
linear  Output-Error  (OE)  models  and  non-linear  Weiner- 
Hammerstein  models  in  the  past[4,  8,  9]. 

In  this  work,  spectral  models  -  Spectral  Analysis  (SPA), 
Empirical  Transfer  Function  Estimate  (ETFE),  Spectral 
Analysis  with  Frequency  Dependent  Resolution  (SPAFDR) 
-are  obtained  using  sEMG  and  skeletal  muscle  force  data. 
Finally,  the  spectral  models  are  fused  using  the  KIC 
algorithm  for  the  improved  estimation  of  skeletal  muscle 
force.  This  paper  is  structured  as  follows.  The  experimental 
set  up  is  given  in  Section  II  and  Section  III  provides  the 
background  information  for  system  identification  and 
spectral  models.  Section  IV  details  the  results  and  discussion 
and  in  the  last  section,  some  conclusions  are  provided. 


II.  Experimental  Set-up 

The  experiments  are  conducted  on  a  healthy  male  subject 
in  order  to  acquire  the  sEMG  and  corresponding  skeletal 
muscle  force  (y^)  signals.  First,  the  skin  surface  is  slightly 
abraded  and  cleaned  with  alcohol  swabs  and  the  test  subject 
was  prepared  by  following  the  ISEK  standards  [10].  A  wet 
probe  point  muscle  stimulator  manufactured  by  Rich-Mar 
Corporation  (Model  number  HV-1000)  is  used  to  identify 
the  motor  point  of  the  flexor  digitorum  superficialis  muscle. 
An  array  of  three  sensors  are  placed,  one  on  the  motor  point 
and  the  other  two  adjacent  to  the  motor  point.  A  Delsys 
Bagnoli-16  channel  EMG  equipment  is  used  to  capture 
sEMG  signal  and  the  related  skeletal  muscle  force 
(y^) signal  is  acquired  using  Force  Sensitive  Resistor  (FSR). 
Both  of  the  signals  are  acquired  at  a  sampling  rate  of  2000 
samples/sec  for  duration  of  10  seconds.  The  sEMG  signal  is 
filtered  by  using  a  Half-Gaussian  filter  and  the  skeletal 
muscle  force  signal  (y^)  is  filtered  using  a  Chebyshev  Type- 
II  filter  whose  cut-off  frequency  is  set  to  550  Hz  [10].  The 
Half-Gaussian  filter  is  given  by: 

f  EMG"  1 

p{eMG\x)  =  2 - ^ ,  (1) 

where  p(EMC|x)is  the  conditional  probability,  x  is  the 
latent  driving  signal,  and  EMG  is  the  acquired  data. 

III.  PROPOSED  DESIGN 

System  Identification  (SI)  technique  is  utilized  to  achieve 
the  dynamic  relationship  between  sEMG  and  the  skeletal 
muscle  force  (y^).  In  [4,  8],  sensor  fusion  is  done  by 
combining  linear  and  non-linear  time  domain  SI  models. 
Combinations  of  different  filters  (Butterworth,  Chebyshev, 
Exponential  and  Half-Gaussian  filters)  and  different 
information  criteria  based  on  Akaike  (AIC),  Bayesian  (BIC), 
and  Kull-back  (KIC)  were  used.  A  KIC  criterion  with  Half 
Gaussian  filtering  gives  the  best  EMG/Force  model 
correlation  [8].  In  this  work,  spectral  models  are  used  to 
achieve  SI.  The  idea  is  to  capture  and  model  the  frequency 
content  of  the  sEMG  signal.  Three  spectral  models  of  each 
type  i.e.  SPA,  ETFE  and  SPAFDR  are  obtained  for  the 
sEMG  from  the  three  sensors  and  the  corresponding  skeletal 
muscle  force  (y^)  data.  The  detailed  mathematical  structures 
of  the  utilized  spectral  models  are  given  below. 

Spectral  Analysis  (SPA): 

Consider  a  linear  dynamic  system, 
y(t)  =  G(q)u(t)  +  v{t)  (2) 

where  u(t)  is  the  sEMG  signal,  y(t)-force  signal,and  G(q) 
is  the  transfer  function  which  gives  the  dynamic  relationship 
between  sEMG  and  force.  G(q)  is  evaluated  on  the  unit 
circle 

G(q  =  ei-^)  (3) 


where  o)  is  a  frequency  content  of  the  signal.  The  SPA 
models  are  computed  as  follows. 


Computing  the  covariance’s  and  cross-covariance’s  from 
sEMG  signal  (u(t))  and  skeletal  muscle  force  signal  (y/(t)) 


Ry(T)=^5:?Liy(t  +  T)y(t) 

(4) 

A(t)  =  w(t  +  T)u(t) 

(5) 

Ryu  W  =  y(t  +  T)u(t) 

(6) 

Later,  the  Fourier  transforms  of  the  above 
equations  are  computed  by  using. 

three 

=  I.r=-MRy(r)WM(T)e-^^^ 

(7) 

(8) 

(9) 

In  (7),  (8)  and  (9)  Wm(t)  is  the  Hann  window  of  width 
-M  to  M.  Where  M  is  a  scalar  integer  that  sets  the  size  of 
the  lag  window.  The  frequency-response  function 
and  the  output  nosie  spectrum  0^  (co)  are  computed  as. 

(10) 

(11) 

The  frequency  resolution  is  calculated  by. 

^  2n  f  radians  \ 

M  \sampling  interval  J 

(12) 

Empirical  Transfer  function  Estimate  (ETFE) 

The  ETFE  function  of  (2)  gives  the  transfer  function 
estimate  G  (e^^ )  at  the  frequencies 

IN]  T 

where  N  =  128(default) 

(13) 

Ufico)  =  'Lr=-MU(T)WM(T)e-j^^ 

(14) 

(15) 

Dividing  (15)  by  (14)  and  applying  the  Hann  window  as  in 
the  SPA  models,  with  the  length  of  the  range  of  number  of 
data  points  yields  the  frequency-response  function  C]v(e^") 
and  the  output  noise  spectrum  0^(0))  same  as  (10)  and  (11). 
Both  the  SPA  and  ETFE  have  the  same  frequency 

resolution. 


Spectral  Analysis  with  Frequency  Dependent  Resolution 
(SPAFRD): 


I  _  Model  selection  criteria  coefficient. 
5.  Fused  output  model  is  computed  by, 


For  the  linear  dynamic  system  given  in  (2)  SPAFRD 
frequency  response  function  returns  transfer  function 
estimate  G  {e^^ )  as  well  as  the  spectrum  additive  noise.  The 
sEMG  and  the  skeletal  muscle  force  data  are  converted  into 
frequency  domain  U (oi)  and  Y (oi) 

The  frequency  domain  data  are  formed  as 

Y((ji))conj  U(a))*U((ji))conj 

- - J 

with  a  desired  resolution  of  ^(/c)  =  2(w(/c  +  1)  —  w(/c) 

The  frequency-response  function  and  the  output 

noise  spectrum  (Py  (oi)  are  computed  as, 

0^(0))  =  .  (18) 
Fusion  Algorithm: 


k 

Yf  =Y^p(Mfi\Z)yft 

i=l 


IV.  Results  and  Discussion 

In  order  to  extract  the  best  working  spectral  model  for  the 
sEMG  and  skeletal  muscle  force  data  three  spectral  models 
SPA,  ETFE,  SPAFDR  are  constructed  based  on  the  sEMG 
data  from  the  individual  sensor  and  the  corresponding 
skeletal  muscle  force.  The  three  spectral  models  of  same 
type  are  fused  using  the  KIC  algorithm  resulting  in  three 
fusion  algorithm  estimated  force  for  each  spectral  model 
type  iYf(^spA},ynETFE),yf  {SPAFDR})-  The  Pearson’s 
correlation  coefficient  (px,y)  percentage  relating  the  actual 
force  (j/f)  from  the  FSR  and  the  fusion  algorithm  estimated 
force  (Yf)  for  each  spectral  model  is  tabulated  in  Table  1. 

TABLE  I:  COMPARISON  OF  CORRELATIONS  OF  INDIVIDUAL 
MODELS  AND  THE  FUSED  OUTPUT  FOR  SPA,  SPAFDR  AND  ETFE 


The  Kullback  Information  Criterion  (KIC)  is  a  symmetric 
measure  used  in  this  paper  for  the  fusion  of  spectral  data. 
The  mathematical  form  of  the  KIC  is  given  as: 

KICipi)  =j\ogRi+^^^-nxp^^^  +  g(ri)  (19) 


where,  n  is  the  number  of  data  points  pi  is  the  order  of  the 
model,  ijj  is  the  digamma  function,  and  g(n)  =  n  ^  log 

After  calculate  the  KIC  for  each  of  the  three  models,  the 
following  fusion  algorithm  was  used  in  order  to  get  the 
overall  estimated  finger  force  3^, 


1.  The  Spectral  models  M^2  ■■■  ^//c  computed 

using  sEMG  data  (u/^)  as  input  and  force  data  (y^)  as 
output,  for  k  number  of  sEMG  sensors  (Where  k  =  3  in 
this  case). 

2.  Residual  square  norm  is  calculated  by 

R.  =  =  ||y-j>||  a  where  0.  =  }  O^y  , 

r  r  T  T 

\  y  u  y  , 

I  Fp  p  F  p-\ 

T  T 

u  y 

and  f 

T  T  T 

LT„-1  Un-X  yn-2 

3.  Using  (19)  model  criteria  coefficients  are  computed. 

4.  The  model  probability  is  computed  by 


Correlation  {pxy) 

Models 

(MfA 

(Mf2) 

(Mfs) 

Fusion(  Yf) 

SPA 

32.52 

29.68 

36.19 

50.29 

SPAFDR 

57.61 

69.87 

65.23 

85.68 

ETFE 

N/A 

N/A 

N/A 

-53.55 

It  is  evident  from  Table  I  that  SPAFDR  models  are 
yielding  the  better  correlation.  The  ability  to  choose  the 
frequency  resolution  in  the  SPAFDR  models  allows 
modeling  of  the  frequency  content  of  the  sEMG  signals.  The 
inability  of  SPA  and  ETFE  to  model  the  non-linear 
frequencies  and  non-periodic  inputs  caused  them  to  fail  to 
capture  the  frequency  of  a  transient  sEMG  signal.  Mf^  is 
constructed  from  the  sensory  data  located  on  the  motor  unit. 
Therefore  it  is  yielding  better  correlation  than  Mfi,  Mf2  -  It  is 
also  clear  that  the  KIC  based  fusion  algorithm  improves  the 
skeletal  muscle  force  estimation  when  compared  to 
individual  spectral  models. 


Figure.  I :  Actual  Force  (y^)  and  the  Fusion  Algoirhtm  Estimated  Force 

(>}). 

Fig  .  1  and  Fig.  2  shows  the  actual  force  (y^)  and  the 
fusion  algorithm  estimated  force  (Yf)  from  the  three 
SPAFDR  models  plotted  together.  The  fusion  algorithm 
estimated  force  follows  the  trends  in  the  actual  force  and 
match  up  with  the  actual  force. 


10'^  lo'  lo“  lo'  10^  10^  10^ 


Frequency  (rad/s) 


Figure.  3:  Frequency  Response  of  SPAFDR,  Output-Error  (OE)  and 
Wiener-Hammerstein  Models. 

Fig  3  gives  the  frequency  response  in  comparison  with  the 
SPAFDR  based  fusion  force  estimate  using  OE  and  Wiener- 
Hammerstein  models  that  were  previously  developed  by  the 
authors  [4,  8,  9].  It  is  interesting  that  the  SPAFDR  spectral 
models  are  capturing  a  different  band  of  frequencies  when 
compared  to  the  other  two  models.  This  indicates  that 
SPAFDR  models  are  capturing  more  of  the  additional 
information  than  the  time  domain  OE  and  Wiener- 
Hammerstein  models.  This  difference  can  be  due  to  reasons, 
such  as  model  order  selection,  input  design  for  the 
experiment,  etc. 

V.  Conclusion  and  Future  Work 

In  this  work,  three  different  spectral  models  were 
analyzed.  From  the  results,  it  is  clear  that  SPAFDR  gives 
better  correlation  between  the  actual  force  (y^)  and  the 
fusion  algorithm  estimated  force  (Yf),  when  compared  to  the 
other  two  spectral  models  SPA  and  ETFE.  Since  the  sEMG 
is  a  non-periodic  signal,  the  application  of  the  Hann  window 
and  fixed  resolution  are  the  possible  reasons  for  the  failure 
of  the  SPA  and  ETFE  model  structures  for  capturing  the 
characteristics  of  sEMG/skeletal  muscle  force  signals.  In 
addition,  the  results  imply  that  the  SPAFDR  spectral  models 
are  capturing  the  frequencies  that  are  not  captured  by  OE 
and  Wiener-Hammerstein  models. 

In  future  we  plan  to  apply  wavelet  transforms  on  the 
sEMG  signals  to  provide  a  better  windowing  of  the  useful 
frequency  content  of  the  sEMG  signal.  It  will  also  be 
interesting  to  fuse  both  the  spectral  and  the  non-linear 


models  for  the  improvement  of  the  correlation  between 
actual  (yf)  and  fusion  algorithm  estimated  forces  (Yf). 
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Optimal  Control  Strategy  for  Smart  Prosthetic  Hand 


Summery 


Optimization  is  a  very  desirable  feature  in  day-to-day  life.  We  like  to  work  and  use  our 
time  in  an  optimum  manner,  use  resources  optimally  and  so  on.  The  subject  of  optimization  is 
quite  general  in  the  sense  that  it  can  be  viewed  in  different  ways  depending  on  the  approach 
(algebraic  or  geometric),  the  interest  (single  or  multiple),  the  nature  of  the  signals  (deterministic 
or  stochastic),  and  the  stage  (single  or  multiple)  used  in  optimization. 

This  report  presents  a  control  technique  of  finite-time  linear  quadratic  optimal  control  for 
five-fingered  smart  prosthetic  hand.  The  optimal  control  is  used  for  feedback  linearized 
dynamics  to  minimize  tracking  error.  This  work  is  different  than  the  work  done  in  [2]  as  in 
this  work  the  reference  input  can  be  chosen  to  be  constant,  ramp,  sinusoidal 
values,... etc.  The  simulations  of  this  optimal  controller  showed  good  performance. 

Introduction 

Optimal  control  theory  is  a  mature  mathematical  discipline  with  numerous  applications  in 
both  science  and  engineering.  It  is  emerging  as  the  computational  framework  of  choice  for 
studying  the  neural  control  of  movement,  in  much  the  same  way  that  probabilistic  inference  is 
emerging  as  the  computational  framework  of  choice  for  studying  sensory  information 
processing.  Despite  the  growing  popularity  of  optimal  control  models,  however,  the  elaborate 
mathematical  machinery  behind  them  is  rarely  exposed  and  the  big  picture  is  hard  to  grasp 
without  reading  a  few  technical  books  on  the  subject. 

The  main  objective  of  optimal  control  is  to  determine  control  signals  that  will  cause  a 
plant  to  satisfy  some  physical  constraints  and  at  the  same  time  (maximize  or  minimize)  a 
performance  index  or  cost  function.  We  are  interested  in  finding  the  optimal  control  u*(t) 
(*  indicates  optimal  condition)  that  will  drive  the  plant  P  from  initial  state  to  final  state  with 
some  constraints  on  controls  and  states  and  at  the  same  time  extremizing  the  given  performance 
index  J. 

The  formulation  of  optimal  control  problem  requires: 

1.  a  mathematical  model  of  the  process  to  be  controlled  (generally  in  state  variable  form), 

2.  a  specification  of  the  performance  index,  and 

3.  a  statement  of  boundary  conditions  and  the  physical  constraints  on  the  states  and/or  controls. 
We  can  describe  a  physical  plant  by  a  set  of  linear  or  nonlinear  differential  equations. 

Classical  control  design  techniques  have  been  successfully  applied  to  linear,  time-invariant, 
single-input,  single  output  (SISO)  systems.  Typical  performance  standards  are  system  time 
response  to  step  or  ramp  input  characterized  by  rise  time,  settling  time,  peak  overshoot,  and 
steady  state  accuracy;  and  the  frequency  response  of  the  system  characterized  by  gain  and  phase 
margins,  and  bandwidth. 

In  modern  control  theory,  the  optimal  control  problem  is  to  find  a  control  which  causes  the 
dynamical  system  to  reach  a  target  or  follow  a  state  variable  (or  trajectory)  and  at  the  same  time 
extremize  a  performance  index.  Performance  index  in  general  can  be  in  the  form  as 


./to 


Where,  R  is  a  positive  definite  matrix,  and  Q  and  F  are  positive  semi  definite  matrices, 
respectively.  Note  that  the  matrices  Q  and  R  may  be  time  varying.  The  particular  form  of  this 
performance  index  is  called  quadratic  (in  terms  of  the  states  and  controls)  form. 

In  tracking  (trajectory  following)  systems,  we  require  that  the  output  of  a  system  track  or 
follow  a  desired  trajectory  in  some  optimal  sense.  Thus,  we  see  that  this  is  a  generalization  of 
regulator  system  in  the  sense  that  the  desired  trajectory  for  the  regulator  is  simply  the  zero  state. 

The  optimal  control  u_(t)  is  given  by 

u*{t)  =  -R-\t)BV{f)x.*{t)  = -K{t)x*{f) 

Here,  K(t)  is  called  Kalman  gain  and  P(t),  the  symmetric  positive  definite  matrix  is  the  solution 
of  the  matrix  differential  Riccati  equation  (DRE) 

P(f)  =  -P(f)A- A'P(f)  -  Q(0  +  P(f)BR-i(0B'P(f) 

Satisfying  the  final  condition: 

=  =  F{f;) 

The  optimal  state  x*  is  the  solution  of: 

i*(f)  =  [A  -  BR“‘(f)B'P(f)]  x*(f) 

And  the  optimal  cost  J*  is 

J-  =  ix-'(f)P(f)x-(f) 

The  optimal  tracking  system  can  be  summarized  in  the  next  figure. 


Modeling: 


It  is  necessary  to  have  a  mathematical  model  that  describes  the  dynamic  behavior  of 
prosthetic  hand  for  the  purpose  of  designing  the  control  system.  Hence,  in  this  section  the 
dynamic  equations  of  hand  motion  are  derived  via  Lagrangian  approach  using  kinetic  energy  and 
potential  energy,  from  Lagrangian  approach,  dynamic  equations  of  thumb  can  be  obtained  as 
below. 


Mfqlq  +  C{q,q)  +  G(q)  =  r  -  Fvq  -  FsSign(q)  -  J'Fcxt 


Where  M(q)  is  the  inertia  matrix;  C(q,  ’q)  is  the  Coriolis/centripetal  vector  and  G(q)  is  the 
gravity  vector;  Fv  denotes  the  diagonal  positive  definite  matrix  of  viscous  friction  coefficients;  Fs 
is  a  diagonal  positive  definite  matrix  and  sign(  'q)  is  a  vector  whose  components  are  given  by  the 
sign  functions  of  the  single  joint  velocities;  J  is  the  Jocobian  and  Fext  denotes  the  vector  of 
external  forces  in  each  direction.  It  can  also  be  written  as: 

M(q)q  +  N(q,  q)  =  r. 

Where 


N(q,  q)  =  C(q,  q)  +  G(q)  +  Fvq  +  F,sign(q)  +  J'Fext 

Represents  nonlinear  terms  in  q  and  q. 

This  work  is  different  than  the  work  done  in  [2]  as  in  this  work  the  reference  input  can 
be  chosen  to  be  constant,  ramp,  sinusoidal  values,... etc. 

In  obtaining  the  linear  system  from  the  original  nonlinear  system,  there  has  been  no  state-space 
transformation.  Further,  the  difficult  design  of  a  controller  for  the  original  nonlinear  system  has 
been  transformed  into  a  simple  design  of  a  controller  for  the  linear  system.  If  we  select  the 
control  function  u(t)  to  stabilize  the  linear  system  and  make  the  tracking  error  zero,  then  the 
nonlinear  torque-control  will  command  the  prosthetic  hand  to  follow  the  desired  trajectory.  The 
original  robotic  hand  system  becomes: 

M(q(0)  q(f)  +  N(q(0, q(f))  =  [M(q(f ))]  [q<((0  -  .i(01  +  N(q(0, q(f)) 

Where 


e(f)  =  u(f) 

Therefore,  the  required  torque  can  be  calculated  by  the  optimal  control  u*(t). 

r*(0  =  M(q(t)){qd(t)  -  u*(t))  +  N(q(f),  q{t)) 

The  next  figure  shows  the  block  diagram  of  a  hybrid  finite-time  linear  quadratic  optimal 
controller 
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Simulation  Results: 

Optimal  control  coefficients,  A,  B,  F(tf ),  R(t)  and  Q(t)  of  all  fingers  are  chosen  as: 
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The  model  that  is  built  in  Simulink  is  shown: 


And  the  next  figures  shows  some  study  cases  to  show  the  designed  control  method  affectivity: 


Case  1  tracking  error 
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Conclusion; 


This  report  presented  a  control  technique  of  finite-time  linear  quadratic  optimal 
control  for  five-fingered  smart  prosthetic  hand.  The  optimal  control  used  for  feedback  linearized 
dynamics  to  minimize  tracking  error.  This  work  is  different  than  the  work  done  in  [2]  as  in 
this  work  the  reference  input  can  be  chosen  to  be  constant,  ramp,  sinusoidal 
values,... etc.  The  simulations  of  this  optimal  controller  showed  good  performance.  This  work 
can  be  expanded  to  five  fingers  hand  with  22  degree  of  freedom 
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Kinematics,  Dynamics  and  Control  of  Prosthetic  Hand  with  extended 

Degrees  of  Freedom 

Abstract 

It  is  obvious  to  all  that  the  human  hand  represents  a  mechanism  of  the  most  intricate  fashioning  and  one  of  great 
complexity  and  utility.  Its  ability  to  adapt  to  different  surfaces  and  shapes,  touch  and  grasp  objects  has  made  it  a 
versatile  tool.  But  beyond  this,  it  is  ultimately  correlated  with  the  brain  both  in  the  evolution  of  the  specie  and  the 
development  of  the  individual. 

In  this  report,  we  present  a  virtual  hand  that  closely  mimics  the  human  hand.  Based  on  the  anatomy  of  the  hand, 
we  designed  a  hand  with  22  degrees  of  freedom  (DOF),  with  each  of  the  carpometacarpal  joints  (CMC)  having  2 
degrees  of  freedom  each  and  metacarpal  joints  (MP)  and  inter-phalangeal  (IP)  joints  having  one  each.  The  two 
degrees  of  freedom  at  the  CMC  joints  are  non-intersecting  and  are  responsible  for  the  flexion  and  extension  (FE) 
motion  as  well  as  the  abduction  and  adduction  motion..  It  is  important  to  note  that  because  of  the  constraint  in  the 
range  of  the  abduction  adduction  motion  in  the  index,  middle,  ring  and  small  fingers,  the  workspace  is  limited. 

In  our  approach,  the  problem  of  forward  kinematics  using  the  Denavit-Hartenberg  (D-H)  method  was  applied  to 
compute  the  position  of  the  end-effector  (fingertip)  given  the  joint  variable.  This  followed  by  the  inverse  kinematics 
which  is  a  little  more  difficult  problem.  The  inverse  kinematics  calculates  the  joint  variables  given  the  position  of 
the  hand.  Based  on  the  kinematic  structure,  a  mathematical  model  that  describes  the  dynamics  of  the  hand  was 
calculated.  These  dynamic  models  were  calculated  using  the  Lagrangian  and  Newton  Euler  formulations.  Hard 
control  strategies  such  as  feedback  linearization  and  proportional  integral  derivative  (PID)  control  were  applied  to 
control  the  hand  based  on  the  kinematic  and  dynamic  models. 


1.1.  Introduction 

In  robotics  terms,  the  hand  can  be  said  to  be  the  end-effector  of  the  human  form.  Because  of  its  correlation  or 
connection  with  the  brain,  it  is  able  to  perform  tasks  like  grasping,  touching,  lifting  and  so  on.  Attempts  has  been 
made  in  the  past  by  various  researchers  to  build  a  prosthetic  hand  that  closely  mimics  the  human  hand  and  various 
propositions  has  been  made  as  to  the  numbers  of  degrees  of  freedom  the  human  hand  has.  Our  own  virtual  model  is 
a  22  degree  of  freedom  smart  prosthetic  hand  that  will  work  with  Myo -electric  signals  from  the  hand  muscles. 


1.2.  Literature 

The  Human  hand  consists  of  connected  parts  composing  kinematic  chains  so  that  the  hand  is  highly  articulated. 
At  the  same  time,  many  constraints  among  fingers  and  joints  make  the  hand  motion  even  hard  to  model.  Over  the 
years,  there  has  been  an  increasing  interest  in  the  area  of  prostheses  which  lead  to  the  creation  of  various  models. 
Vardy  proposed  a  26  degree  of  freedom  (DOF)  hand  model  based  on  the  Danavit-Hartenberg  methodology  [5].  The 
model  from  [5]  is  in-complete  because  the  wrist  was  not  in-cooperated  and  the  palm  was  modeled  as  a  seven  DOFs 
articulation  whereas  in  our  model,  all  fingers  have  the  same  essential  structure,  so  that  the  D-H  methodology  is 
applied  to  all  fingers.  The  wrist  was  modeled  as  a  2  DOF  articulation  made  up  of  flexion/extension  (FE)  and 
abduction  and  abduction  motion  (AA)  motions.  We  placed  the  global  reference  frame  on  the  wrist  so  that  the 
forward  kinematics  of  the  finger-tip  frame  is  calculated  with  respect  to  the  reference  frame  at  the  base  of  the  wrist. 
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In  similar  model  to  ours  is  [6],  where  the  thumb  was  modeled  as  two  DOFs  and  the  rest  of  the  fingers  3  DOFs.  In 
[6],  chen  assumed  a  serial  link  planer  manipulators  for  all  fingers. 


2.  Kinematics 

Kinetics  being  the  science  of  geometry  is  restricted  to  a  pure  geometrical  description  of  motion  by  means  of 
position,  orientation  and  their  time  derivatives  [1].  The  kinematic  study  of  manipulators  and  their  various  roles  is 
fundamental  to  the  formation  of  the  equations  of  motion  (dynamics)  and  control  of  the  manipulator.  The  manipulator 
may  be  thought  as  a  set  of  bodies  connected  in  a  chain  by  joints  [2].  However,  for  the  purpose  of  deriving  the 
kinematic  description  of  a  robot  hand,  a  link  is  considered  as  a  rigid  body  which  defines  the  relationship  between 
two  neighboring  joint  axes  of  a  manipulator.  To  develop  a  systematic  kinematic  description  and  representation  of  the 
location  of  the  arms  of  a  robot  with  respect  to  a  global  fixed  reference  frame  G,  we  utilize  the  matrix  algebra  or  the 
Clifford  algebra 

2.1  Robot  kinematics  using  matrix  algebra 

We  model  any  mechanical  system,  including  robots  as  a  series  of  rigid  link  connected  by  joints.  The  joints  restrict 
the  relative  movements  of  adjacent  links  and  are  generally  powered  and  equipped  with  sensors  to  control  the 
movements.  To  apply  number  synthesis  to  hand  mechanisms,  we  first  define  mobility  and  connectivity.  The  degrees 
of  freedom  of  a  robot  also  called  mobility  are  defined  as  the  number  of  independent  parameters  needed  to  specify 
completely  (or  within  a  finite  set)  the  position  of  everybody  in  the  system  at  the  instant  of  concern  [3].  In  order  to 
compute  the  mobility,  we  employ  the  following  version  of  Grubler’s  formula  (Hunt  1978). 


M>Z^+Zg/-6L 

(2.1) 

M'>Tgj-6L 

(2.2) 

Where; 

M  -  Mobility  of  system  with  finger  joints  free  to  move. 

M  -  Mobility  of  system  with  finger  joints  locked. 

gj  -  Degrees  of  freedom  of  motion  at  the  jth  contact  point. 

L-  Number  of  independent  loops  in  the  system 

However,  for  a  serial  robot,  the  degrees  of  freedom  are  equal  to  the  number  of  joints  multiplied  by  the  mobility 
allowed  by  each  joint.  Once  the  mobility  is  defined  and  the  active  joints  of  the  hand  identified,  the  two  main 
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problems  of  kinematic  analysis  of  robot  are  forward  kinematics  and  inverse  kinematics.  In  the  forward  kinematics 
also  known  as  direct  kinematics,  we  define  the  position  of  the  end-effector  as  a  matrix  which  is  a  function  of  the 
angles  or  slides  at  each  joint.  If  the  joint  angles  are  known,  the  position  of  the  end-effector  is  completely  specified. 
The  inverse  kinematic  problem  which  is  a  more  difficult  problem  is:  given  the  desired  position  and  orientation  of  the 
hand  relative  to  the  station,  how  do  we  compute  the  set  of  joint  angles  which  will  achieve  this  result  [2]. 

The  solution  of  forward  kinematics  defines  the  workspace  of  the  individual  fingers  of  the  hand  as  well  as  the  hand 
in  general.  The  workspace  can  be  defined  as  a  set  of  all  possible  positions  of  the  end-effector  (finger-tip), 
constructed  using  all  possible  values  of  the  joint  variables  within  the  range.  Note  that  the  position  means  location 
plus  orientation;  the  workspace  of  the  robot  hand  is  a  six-dimensional  subset  of  the  six-dimensional  space  of 
rotations  and  translations. 

Several  workspace  have  been  defined  [4] 

•  Reachable  workspace  (W^  ):  Set  of  all  locations  of  the  origin  of  the  fingertip/  hand  frame  that  the  robot 
can  reach.  It  is  a  three-dimensional  subset  of  the  workspace. 

•  Dexterous  workspace  ( ):  Set  of  all  location  of  the  origin  of  the  end-effector  frame  that  the  robot  can 

reach  with  any  orientation.  It  is  useful  because  the  robot  has  full  dexterity  in  this  subspace,  which  ensures 
that  any  task  can  be  performed  within  it. 

•  Workspace  with  constant  orientation  ( ):  Set  of  all  locations  of  the  origin  of  the  finger-tip  frame  that 
the  robot  can  reach  with  a  specified  orientation  for  the  finger-tip. 

2.2  Forward  Kinematics  Equations 

Consider  a  rigid  body  with  a  fixed  reference  frame  {A}  specified  as  X,  Y  &  Z  and  another  moving  body  {B}.  A 
possible  description  of  frame  {B}  with  respect  to  frame  {A}  is  to  start  with  the  frame  coincident  with  a  known 

frame  {A}.  First  rotate  {B}  about  by  an  angle  Ct ,  then  rotate  about  Yg  by  an  angle  [5  and  then  rotate  about 

Xg  by  an  angle  y  •  this  representation,  each  rotation  is  performed  about  an  axis  of  the  moving  frame  {B},  rather 

than  the  fixed  reference  frame  {A}.  These  sets  of  three  rotations  are  called  Euler  angles  [2].  The  Euler  angle  rotation 
matrix  for  XYZ  axes  are  as  follows: 
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We  can  represent  local  transformations  from  joint  to  joint  using  a  4  x  4  homogeneous  matrices.  The  composition 
of  these  displacements  is  given  as  a  result  of  the  displacement  from  the  base  to  the  end-effector.  In  order  to  create 

the  local  transformations  along  any  chain,  we  identify  the  line  locating  the  joint  axes,  S- ,  and  we  compute  the 

common  normal  line  A  ,i-i-l  between  .  We  consider  that  the  link  joining  two  consecutive  joints  extends  along 
the  common  normal  line,  regardless  of  its  real  shape. 

We  assign  local  coordinate  frames  with  the  z  axis  along  the  joints  axes  and  the  x  axis  along  the  common  normal 
line.  Local  displacements  will  take  us  from  local  coordinate  frame  to  local  coordinate  frame,  from  the  base  to  the 
end-effector. 

2.2.1  Denavit-Hartenberg  Parameters 

In  1995,  Denavit  and  Hartenberg  introduced  the  methodology  of  4  x  4  homogeneous  matrix  transformations  to 
analyze  robotic  systems,  which  became  a  standard  tool  in  robotics  [11,  12,  1].  The  shaped  the  local  transformations 
along  the  chain  as  screw  displacements  about  z  and  x  axes,  dependent  on  only  four  parameters.  Although  a  few 
modifications  has  been  made  over  the  years.  The  D-H  notations  we  used  are  similar  to  Craig  [3]. 

We  locate  the  first  local  frame  with  the  x  axis  along  the  common  normal  A^2  •  The  origin  of  the  frame  is  located  at 

the  intersection  of  these  two  lines.  Assume  that  a  general  displacement  [G]  locates  the  first  local  frame  with  respect 
to  the  fixed  frame,  as  shown  in  fig.  2.1. 
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Figure  2.1:  Local  transformations  along  the  links  of  a  robot 

The  second  local  frame  has  the  same  x  axis  but  now  the  z  axis  is  aligned  with  S2 ,  with  its  origin  at  the 

intersection  point  of  these  two  lines,  while  the  third  local  frame  has  same  z  axis  as  the  second  and  the  line  A23  as  its 
X  axis.  From  the  local  frame  attached.  Two  parameters  are  needed  to  transform  from  local  fame  to  local  frame  along 
links:  Link  twist  and  link  length.  This  is  X-screw  displacements.  Link  twist,  (X-_^  ■ :  This  defines  the  relative  location 
of  two  axes,  whose  common  normal  lines  are  mutually  perpendicular  and  it  is  measured  along  this  line.  Link  length, 
a._^ . :  This  is  the  distance  measured  along  a  line  that  that  is  mutually  perpendicular  (common  normal)  to  two  axes. 

Also,  links  that  are  next  to  each  other  have  a  common  joint  axis  between  them.  The  first  parameter  describes  the 
distance  along  the  common  axis  from  one  link  to  the  next.  This  parameter  is  called  the  link  offset,  d. .  A  second 
parameter  describes  the  amount  of  rotation  about  this  common  axis  between  one  link  and  the  next.  This  parameter  is 
called  joint  angle,  0- . 

The  human  hand  consists  of  connected  parts  composing  kinematical  chains  so  that  the  hand  motion  is  highly 
articulated.  Various  models  of  the  human  hand  have  been  created  with  varying  degrees  of  freedom.  The  aim  of  this 
research  is  to  obtain  a  model  that  closely  mimics  the  human  hand,  as  natural  as  possible.  The  Kinematical  scheme 
was  considered  to  be  consisting  of  22  re  volute  joints  linking  together  the  palm  and  the  phalanges  as  rigid  bodies. 
The  Denavit-Hartenberg  methodology  becomes  necessary  because  we  have  four  open-loop  kinematic  structure  and  a 
high  number  of  degree  of  freedom  (DOF). 


2.2.2  KINEMATIC  SCHEME  OF  THE  HUMAN  HAND 

The  kinematic  scheme  of  the  human  hand  contains  the  palm  and  the  phalanges  as  rigid  bodies  linked  by  22 
revolute  joints.  The  joint  variables  for  all  the  fingers  are  ql,  q2,  q3  and  q4.  The  kinematic  chain  structure  is  the  same 
for  the  little,  ring,  middle  and  index  fingers. 
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2.2.3  KINEMATIC  MODEL  OF  THE  THUMB 


The  kinematic  properties  of  the  thumb  should  mimic  those  of  a  human  thumb.  Matching  the  robotic  thumb  joints 
to  the  anatomic  thumb  joints  creates  the  proper  relative  motion  between  the  bones.  Working  from  the  wrist  up  to  the 
thumb  tip,  the  four  bones  of  the  thumb  are  the  trapezium  carpal,  the  metacarpal,  the  proximal  phalanx,  and  the  distal 
phalanx.  The  three  thumb  joints  are  named  the  carpometacarpal  (CMC),  metacarpophalangeal  (MCP),  and 
interphalangeal  (IP)  joints,  as  shown  in  fig.  1. 


CMC 


Figure  1.  Bones  and  joints  of  the  thumb  [11] 
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Based  on  the  kinematic  model  described  above  the  resulting  location  of  the  axes  within  the  thumb  bones  are  shown 
in  fig.  2. 


Fig.  2  Kinematic  Model  of  the  thumb  with  four  rotational  degrees  of  freedom  thumb.  [11] 


The  resulting  locations  of  the  axes  within  the  thumb  bones  are  shown  in  fig.  2.  The  IP  joint  FE  axis  passes 
through  the  distal  end  of  the  proximal  phalanx  and  is  not  perpendicular  to  the  sagittal  plane  of  the  thumb.  The 
flexion-extension  (FE)  and  the  adduction-abduction  (AA)  rotational  degrees  of  freedom  (DOF)  at  the  CMC  joint  are 
non-orthogonal  and  non-intersecting,  as  shown  in  figure  2.  The  FE  axis  is  fixed  relative  to  the  trapezium  bone  at  the 
base  of  the  thumb.  However,  the  anatomy  of  the  interfacing  bone  surfaces  of  the  trapezium  and  the  thumb 
metacarpal  bones  suggests  a  saddle  joint  model  with  two  axes  that  are  non-intersecting  and  non  -orthogonal  (skew) 
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The  Four  degrees  of  freedom  Thumb 


Fig. 3  Four-DOF  thumb  illustration 


Figure  1.0  shows  the  illustration  of  a  four-link  thumb.  LI,  L2,  L3,  L4  and  L5  are  the  link  lengths  of  the  respective 
links;  SI,  S2,  S3  AND  S4  are  the  joint  axis  of  the  respective  joints;  ql,  q2,  q3,  q4,  and  q5  are  the  twist  angles  of  the 
respective  joints.  The  orientation  of  the  fingertip  (end-effector),  P(x,  y)  can  be  obtained  using  the  Denavit- 
Hartenberg  Method.  The  Denavit-Hartenberg,  D-H  matrices  are  obtained  by  the  by  the  product  of  the 
transformations  from  the  origin  (fixed  frame)  to  the  various  local  frames  and  the  finger-tip  (end-effector  frame) 
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Table  1.0:  DH  Parameter  Table  for  Four-link  shown  In  Figure  1.1 


Link  No. 

OCi  - 1,  i 

d/ 

Oi 

1 

0 

-Till 

0 

qi+  Till 

2 

L2 

0 

0 

q2 

3 

L3 

0 

0 

q3 

4 

L4 

0 

0 

q4 

CCi  - 1,  /  :  Twist  angle  between  S  /  - 1  to  S  / 
a  /  - 1,  / :  Link  length  from  S  /  -  1  to  S  / 
d  i  :  offset 

Oi  :  Joint  angle  between  Ai  -l, i  and  Ai  +  l, i 


From  the  DH  table  for  four-link  thumb  shown  in  Table  2.0,  the  transformation  matrices 
and,  can  be  written  as 


1 

0 

0 

0 

0 

1 

0 

0 

0 

0 

1 

0 

0 

0 

0 

1 

10 


'^cos(q5)  -sin(q5)  0  L'jCOs(^')  ^ 

sm(qj)  cos(q5)  0  L'jSin(^|) 

0  0  10 

^0  0  0  1  ^ 


^10  0  0 
0  cos(q2)  '811^(02)  L2^os(^') 
0  -sin(q2)  cos(q2)  L2sin(^2) 
^0  0  0  1 


^cos(q3)  -sin(q3)  0  L3  005(^3)  ^ 

sin(q3)  cos(q3)  0  L3sin(^3) 

0  0  10 

^0  0  0  1  ^ 


^cosCq^)  -sinCq^)  0  005(^4)^ 

sin(q4)  cos(q4)  0  L4  5111(^4) 

0  0  10 

^0  0  0  1  ^ 


Here  is  the  transformation  matrix  from  thumb  local  base  frame  (zero)  to  Global  frame.  Is  the 
transformation  matrix  from  frame  1  to  base  frame  (zero),  is  the  transformation  matrix  from  frame  2  to  frame  1, 
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is  the  transformation  matrix  from  frame  3  to  frame  2  and  is  the  transformation  matrix  from  frame  4  to 


frame  3.  The  transformation  matrix  from  thumb  local  frame  4  to  global  frame  can  be  written  as 


Grr<t  _ 

^4  “ 


Grj^t  Orpt  \rpt  2rj^t  ?>rpt 


2.2.4  The  Four  degrees  of  freedom  Index  finger 

The  Index,  the  middle,  the  ring  and  the  little  fingers  can  be  considered  to  be  made  up  of  four  links  as  against  the 
human  hand  configuration  which  is  made  up  of  three  links  and  three  bones  (Metacarpal  phalangeal  MP,  Proximal 
interphalangeal  and  Distal  interphalangeal). 


Fig.  4  Configuration  of  the  joints  of  the  index  finger 


The  coordinate  of  the  fingertip,  P\X\Y^) 


and  the  orientation  (j/  of  the  thumb  finger  (t)  can  be  written  as 


X  ^^(^123  )  ^4^(^1234  ) 

Y  —  ^^(^123  )  ^4^(^1234  ) 


(j)*  -  q[  +  ^2  +  ^3  +  ^4 
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The  Homogeneous  transformation  matrix  to  transform  the  thumb  Local  coordinate  frame  base  Xq  —  y^—  Zq 
to  the  global  frame  is  expressed  as  a  product  of  two  basic  homogeneous  transformations 

R(X^,a)andR(Y^,j3). 


2.3  Inverse  Kinematics  of  4-Link  thumb 


As  presented  in  the  previous  section,  the  forward  kinematics  problem  of  a  robot  manipulator  is  to  determine  the 
configuration  (position  and  orientation)  of  the  end-effector  of  the  manipulator  as  a  function  of  the  manipulator  joint 
angles.  The  inverse  kinematics  problem  is  to  determine  the  joint  angle.  The  inverse  kinematics  problem  is  to 
determine  the  joint  angles  given  a  desired  end-effector  configuration.  Different  approaches  to  solving  the  inverse 
kinematics  problem  has  been  studied  [10].  The  method  adopted  requires  that  the  number  of  unknown  is  the  same  as 
that  of  equations  and  finally  it  solves  a  set  of  highly  non-linear  equations.  The  Newton-Raphson  (N-R)  method  is 
Implemented  for  4  DOFs,  5  DOFs  and  6  DOFs,  but  for  some  configuration  the  system  of  equations  will  not 
converge. 

The  thumb  has  4DOFs  and  to  solve  the  inverse  kinematics,  we  use  the  theory  of  robotics  [11],  where 


G 


Orrit  Irpt  2rjit 


(2.3.1) 


and  from  equation, 

Grpt 


Where  the  vector  d  —  [d^d^d^Y  is  a  known  vector  position  of  the  fingertip  and  each  element  of  the  right  hand 
form  the  equation  of  transformation  matrix: 


Orpt  _ 


0.  P. 

II 

o  o 

dy 

dz 

lo 

0  0 

ij 

f 

cos  q[ 

-cos(^)sin(^[ 

+  -)  sin(--)sm(^j +-) 

0 

sin(^;+^) 

cos(- 

-^)cos{q{ 

TT 
-h  — 
2 

-sin(-^)cos(^i'+^) 

0 

0 

sin(-|) 

cos(-— ) 

2 

0 

V  0 

0 

0 

1. 

(2.3.2) 


(2.3.3) 
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f 


\rpt  _ 


COS  ^2 

sin(^2) 

0 

0 


-cos(O)  sin(g2) 
cos(O)  cos{q[) 
sin(O) 

0 


sin(O)  sm{q[ ) 
-  sin(O)  cos(^2 ) 
cos(O) 

0 


L2  COS(^2 
L2  sm{q[ ) 
0 
1 


(2.3.4) 


r 


2rjit 


Jt  _ 


COS  ^3 

sin(^3) 

0 

0 


-cos(O)  sin(^3) 
cos(O)  005(^3) 
sin(O) 

0 


sin(O)  sin(^3 ) 

-  sin(O)  cos(^3 ) 
cos(O) 

0 


L3  COS(^3 

L3  sin(^3 ) 
0 
1 


(2.3.5) 


?>rTit  _ 

^4  “ 


cosq^ 

sin(^4) 

0 

0 


-cos(O)  sin(^4) 
cos(O)  005(^4) 
sin(O) 

0 


sin(O)  sin(^4 ) 
-  sin(O)  cos(^4 ) 
cos(O) 

0 


L^cos{q\) 

L^?,m{q\) 

0 

1 


(2.3.6) 


The  unknown  angles  are  q[ ,  ^2  ’  ^3  ^4  pre-multiply  the  equation  on  both  sides  for  the  inverse  (  ) 

and  the  equation  is  now 


(Ojtyl  Gj,r 


X* 


X  •  ■ 


(2.3.7) 


With  the  convenient  operation,  we  can  see  that  from  the  left  matrix  the  element  [3, 4]^  is  —d^  cos  ql  —  sin  ql 

and  for  the  right  hand  the  element  [3, 4]^  is  0.  We  can  assume  that  [3, 4]^^  =  [3, 4]^  and  we  calculate  the  first 
unknown  with 


tan  ql  =  - 


X 

dy 


(2.3.8) 


The  tangent  has  two  solutions  with  a  variation  of  tt,  but  the  thumb  has  constrained  the  movement,  the  range  of 
motion  is  between  -13/18071  and  T/SOtt  and  we  only  accept  one  solution  within  the  range  of  motion.  Note  that  this 
equation  is  only  for  this  four  DOFs  system  and  its  D-H  table.  We  need  three  more  independent  equations  to  find  the 

three  unknowns.  Following  a  similar  method,  the  equation  can  be  pre -multiplied  for  ^  on  both  sides  and 
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(2.3.9) 


For  this  equation,  [1,  A\  =  [1, 4]^  and  [2,  A\  =  [2, 4]^ ;  from  this,  we  have  two  equations  and  three  unknowns. 


dy  cos  ql  cos  ^2  “  cos  q\  sin  -d^^mq\-Ly  =  cos  q^+L^  cos  q[  cos  q\-L^  sin  q[  sin  q\ 

(2.3.10) 


and 

dy  cosq[  sinq^  sin^^  sin^{  -d^  sinq[-L^  =  sinq^+L^  sinq[  cosq\  +  L^  cosq^  sinq^ 

(2.3.11) 


We  need  more  equations  to  pre-multiply  for  (  ) 


-1 


.  The  next  equation  is 


(0y,r)-l^(ly,r)-l^(2y.r) 


-l^G, 


rr<t  _ 

^4  “  ^4 


(2.3.12) 


With  the  new  equation,  we  can  extract  for  [1, 4]^  =  [1, 4]^  ,  as  follows 


-L|  COS  q'^-L^-d^  ((cos  sin  ^2  +  cos  ^2  sin  ql  +  cos  q[  ((cos  ql  cos  ql  -  sin  ql  sin  ql )) 
—d^  sin  q^  cos  q^  cos  ql  —  sin  ql  sin  ql=L^  cos  q^  o  q  1  q 


We  have  one  system  of  equations  with  three  unknowns.  This  is  a  system  of  non  -linear  equations  and  to  solve  this 
system  of  equations,  we  need  some  iteration  method  or  applied  optimization. 
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2.4.  DIFFERENTIAL  KINEMATICS 

Differential  Kinematics  establishes  the  relationship  between  the  linear  and  angular  velocities  and  accelerations  of 
fingertips  and  the  angular  velocities  and  accelerations  of  joints  by  the  manipulator  geometric  Jacobian. 


2.4.1.  Four-link  thumb 

If  we  only  consider  the  linear  velocities  of  the  fingertip,  then  the  angular  velocities 
and  angular  accelerations  of  joints  can  be  obtained  by  taking  the  first  derivative  and 

second  derivative  on  the  finger-tip  co-ordinate  P\X\Y^)C-  thumb 


• 

X 

'-I\Siq{)-Il2Siq[2)-I^Siq[2,)-Ii,Siq[2,S 

• 

Y 

_  l\C(q{ )  +  ll2C{q[2 )  +  I^Ciq[22 )  +  4^(434 )  _ 

2.4.2.  Jacobians 

The  jacobians,  J  is  a  multidimensional  form  of  the  derivative.  Suppose,  for  example  we  have  four  functions,  each  of 
which  is  a  function  of  four  independent  variables: 

Yl=fl(ql,q2,  q3,  q4), 

Y2=f2(ql,q2,  q3,  q4), 

Y3=f3(ql,q2,  q3,  q4), 

Y4=  f4(ql,  q2,  q3,  q4). 

Now  if  we  wish  to  calculate  the  differentials  of  y.  as  a  function  of  differentials  of  Xj ,  we  simply  use  the  chain  rule 
to  calculate  and  we  get 


5/j  df^  df^ 

OXj  0X2  0X3  0X4 


dy  =^SX,+^  5X2  +  —  +  -^  5X^ 

OX^  0X2  0X3  0X4 
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This  again  might  be  written  more  simply  using  vector  notation  as 


The  6x6  matrix  of  partial  derivatives  is  what  we  call  the  Jacobian,  J. 


The  differential  derivative  of  the  coordinate  of  the  points  of  the  finger-tip  can  be  written  as 

p  =J'M)q 


.t  .t 

The  matrices  p  andJ^^{q^)  as  follows 


• 

q[ 

• 

q\ 

X' 

• 

t 

t 

qi 

t 

qi 

Y' 

q  = 

1 

_ 1 

q  = 

1 

m 

_ 1 

-I\S{q[ )  -  Il,S{q[,)  -  45(^1, 3 )  - 
; C(^; )  +  +  Il,C{q[,,,)  _ 

The  matrix  {q^)  is  called  a  sub-matrix  of  the  geometric  Jacobian  of  the  thumb.  We  will  only 

consider  the  geometric  Jacobian  for  the  planer  location  P\X\Y^)  and  not  the  orientation,  that  is,  a  sub¬ 
matrix  of  the  geometric  Jacobian. 

.t  .  t  .t  .t 

The  angular  velocities  q^  ,^2 ’^3  ^4  the  Joints  1,  2,  and  3  are 
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q 


V  J 


•  ‘ 

p 


••  ••  ••  •• 

Similarly,  the  angular  accelerations  ql ,  ^2  ’  the  joints  1 ,  2  and  3  are  obtained  as 


q‘=j: 


/  n  p  \  ±  '' 


q 

V  y 


dt 


q ) 


Where  P  is  the  linear  acceleration  vector  of  the  fingertip.  P  ,  q  ,  and -  are  denoted  as 

dt 


P  = 


X' 

•• 

yt 


q  = 


qi 


^2 


q. 


^4 


dt 


.t 


.t 


.t 


Z^cos(^j)^j  Zy2  cos(^j2)  ^12  ^3^^^(9123)^123  ^4^^^(91234)9 


1234 


L\  sin(^j )  L2  sin(^j2)  9i2  ^  ^1^(9123)  9i23  ^4  ^^^(91234)  9 


1234 


2.4.3.  Finger-tip  Workspace 

The  solutions  of  the  direct  kinematics  define  the  workspace  of  the  finger.  The  workspace  can  be  defined  as  the  set  of 
all  possible  positions  of  the  finger-tip,  constructed  using  all  possible  values  of  joint  variables  within  their  range. 
Because  of  the  difficulty  in  visualizing  the  workspace,  several  subspaces  have  been  defined 


•  Reachable  workspace:  This  is  a  set  of  all  locations  of  the  origin  of  the  finger-tip  frame  that  the  robot  finger 
can  reach.  It  is  a  three  dimensional  subset  of  the  workspace. 

•  Dexterous  workspace:  Set  of  all  locations  of  the  origin  of  the  finger-tip  frame  that  the  robot  finger  can 
reach  with  any  orientation.  This  useful  because  the  robot  has  full  dexterity  in  this  subspace,  which  ensures 
that  any  task  can  be  performed  within  it 

•  Workspace  with  constant  orientation:  Set  of  all  locations  of  the  origin  of  the  end-effector  frame  that  the 
robot  can  reach  with  a  specified  orientation  for  the  end-effector. 
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2.4.4.  Three-link  thumb 

The  three-link  thumb  with  four  degree  of  freedom  is  shown  in  the  figure.  The  red  region  is  the  reachable  workspace 
of  the  thumb.  The  first,  second  and  third  positions  (joint  angles)  are  constrained  in  the  ranges  of  10,90],  1-80,0]  and 
160,0]  respectively. 


0.1 

0.08 

0.06 


-0.04  - ' - ' - ' - ' - ^  ^ 

-0.02  0  0.02  0.04  0.06  0.08  0.1 

X  (meter) 

Figure  2.0.  Workspace  of  thumb  in  Flexion  and  extension  motion 

Also  for  the  combined  workspace  of  the  thumb  and  index  finger  during  extension  and  flexion  is  show  in 
the  figure.  The  Index  finger  is  constrained  within  the  range  [0,  90],  [0,110]  and  [0,  80].  In  the  figure  a 
square  shaped  object  is  within  the  reachable  workspace  of  the  thumb-index  fingers  motion. 


19 


0.12 


0.1 


0.08 


0.02 


I  0.04 


0 


-0.02 


0.06 


0 


_0  04  ^ ^ ^ ^ ^ ^ ^ ^ ^ 

■-0.04  -0.02  0  0.02  0.04  0.06  0.08  0.1  0.12  0.14  0.16 

X  (meter) 

Figure  2.1.  Configuration  of  a  Square  shaped  object  within  the  workspace  of  a  thumb-index  finger 


3.  Dynamics 

In  other  to  derive  a  control  technique  for  the  prosthetic  hand,  a  mathematical  model  that  describes  the  dynamic 
behavior  of  the  hand  must  be  calculated.  An  ideal  model  of  a  4-link  with  4-R  finger  is  studied  in  this  section.  It  is 
called  ideal  because  it  is  assumed  that  the  links  are  massless  and  there  is  no  friction.  The  equation  of  motion  that 
describes  the  dynamic  behavior  of  systems  can  be  obtained  via  Newton’s  equation  of  motion  or  Legrange’s 
approach.  We  will  use  the  Legrange’s  form  of  Newton’s  equation  of  motion  to  derive  the  dynamic  equations. 

The  Legrangean  form  of  Newton’s  equation  are  given  by 


r=l,  2,...,n 


(3.00) 


Where 


L  =  K-V 


(3.10) 


Equation  (3.10)  is  called  the  Lagrangean  of  the  system,  is  the  non-potential  generalized  force;  K  and  V  are  the 
potential  energy  of  the  n  degree  of  freedom  prosthetic  hand  respectively. 
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3.1.  Four-link  index  finger 

The  Legrangean  equation  of  the  index  finger  can  be  expressed  as 


Where 


1 

11 

(3.20) 

K' =f,\"i(Xl+Y,^,) 

m=l  ^ 

(3.30) 

n=4  n=4 

m=l  m=l 

(3.40) 

Here,  n  is  the  number  of  links  of  the  index  finger;  is  the  mass  of  link  m;  we  take  the  absolute  angle  9^  and  the 
relative  angles  O^^O^andO^  as  the  generalized  coordinates  to  express  the  configuration  of  the  index  finger. 


The  global  position  of  n\ ,  nir^ ,  m^andm^  are 


X4 

^4 


r  n _ r  /icos6\  n 

L^i  J  “  J 

X2  I  I  cos  ^ +/2  COS(^ +^2  ) 

Y2  J  |_  /j  sin  0^  +I2  sin( ^  +^2 ) 

[Xj  I  _  I  /j  COS^j +/2  COS(^j +^2  +^2  )  I 

13  J  |_  ^1  ^1  "^^2  +^2  )'^^3  sin(^j  +^2  'YO'^  )  ^ 

[/j  cos  0-^  YI2  COS(^  ^”^^3  COS(^j  ~^^2  ~^^3  COS(^  ~^^2  ) 

/j  sin  +/2  sin(^j  "^^2  )'^^3  sin(^j  "^^2  "^^3  )"^^4  sin(^j  "^^2  "^^3  "^^4 ) 


(3.50) 


(3.60) 


(3.70) 


(3.80) 


The  global  velocities  of  the  masses  are  the  time  derivative  of  the  global  position  of  the  masses. 


• 

r^ii- 

-/j  6^  sin6>j 

L^l  J" 

• 

/j  6^  cos(9i 

(3.90) 
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-/j  0^  sin  0^  -I2  012  sin  0^2 
•  • 

/j  01  cos  01 +I2  012  COS  0^2 


(3.91) 


-li  01  sin  $1 -I2  012  sin  0i2  -It,  0i23  sin  0^22 

•  •  • 

/j  0^  cos  01 +I2  012  cos  0^2  +^3  ^123  COS  0^22 


(3.92) 


•  •  •  • 

r  X4 

-4  01  sin  0^  -I2  012  sin  6^2  -I2  ^123  sin  6^23  -I4  6^1234  sin  6^234 

L^4  J 

•  •  •  • 

/j  01  cos  01  +I2  012  COS  0^2  +I2  0123  COS  0^23  +h  ^1234  COS  ^^234 

The  kinetic  energy  of  the  finger  is  made  up  of  the  kinetic  energy  of  the  masses  and  is  equal  to 


K  =  K,+K^  +  K^  +  K^ 
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_  ml  {if  &m{01(t)f  ei(tf  +  Ll^  cos{61(t)f  ei(tf) 

2 

+  -j{m2{Lf  sin{ei{t)f  dl{tf  - 12^  sm{dl{t) 

+  e2(t)f  [ei{t)  +  62{t)f  +  if-  cos{ei{t)f  ei(t)^ 

+  L2cos[dl(t)  +  d2{t)f  {dl{t)  +d2(t)f)) 

+  -j{m3  {if  sm{ei{t)f  ei(tf  -  L2^  sm{ei{t) 

+  e2{t)f  {ei{t)  +  e2(t)f  -Ls^sinieiit)  +  e2{t) 

+  e3(t)f  {ei{t)  +  e2(t)  +  e3(t)f  +  if  cos{ei(t)f  ei{tf 
+  L2^cos{ei(t)  +  e2{t)f  {61(t)  +G2{t)f 
+  Lfcos{dl(t)  +  e2{t)  +  d3(t)f  {61  it)  +  d2{t)  +  d3[t)f)) 
+  -j{m4{Lfsm{ei{t)f  ei{t)^ -L2sm{ei{t) 

+  62(?))  (07(/)+62(^))  +  Z/5^ sin( 07(?)  +  62(/) 

+  63(t) )  {01{t)  62(t)  +  63(?) )  +  sin(  61  (/)  +  62(t) 

+  63 (t)  +  64{t)')  {61  (t)  +  62 {t)  +  63 [t)  +  6¥(7)) 

+  Lfcos{61(t)f  61{t)^  +L2^cos{61(t)  +  62{t)f  {dl{t) 

+  02(7))  +7/5^ cos(07(7)  +  62(t)  +  05(7))  {61  {t)  + 

02(7)  +  05(7))^  +z/cos( 07(7)  +  02(7)  +  05(7) 

+  07(7))^  (07(7)  +  02(7)  +  05(7)  + 


The  Potential  Energy  of  the  manipulator  V=vl+v2+v3+v4 
=  niigY^+m^gY^+m^gY^+m^gY^ 

n\g\  sin  0 + m^gil^  sin  0^  +  ^  sin  0^2 )  +  7n3g(/j  sin  0^  +  ^  sin  0^2  +  h  ^123 ) 

+7n4g(/j  sin  0^  + 12  sin  0.^2  +  h  ^123  +  h  ^1234)  (3.96) 

Here  is  the  length  of  link  k;  0^  is  the  angle  at  joint  m  and  a  function  of  time;  g  is  the  acceleration  due  to  gravity. 
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Therefore  the  Lagrangean  is  obtained  from  equations  (3.95)  and  (3.96)  by  substituting  it  in  (3.20) .  Here  is  the 
length  of  link  k;  6^  is  the  angle  at  joint  m  and  a  function  of  time;  g  is  the  acceleration  due  to  gravity. 


L  =  K-V 

_ ml  sin( sijt) eijtf'  +  Li'^ cos( eijt))^ 

2 

+  -^{m2{Ll^  sinCe/Cf)  01  {t)^  —  sin(  07(f) 

+  e2(f))^  {01{t^  +  02(f)  +  7.7^  cos(  07(f)  02(f)^ 

+  Z2cos(  07(f)  +  02(f)  (02(f)  +  02(f)  )^)) 

+  ^(m5  {lP-  sin(  07(f)  07(f)^  —  Lp  sin(  07(f) 

+  02(f)  (07(f)  +  02(f)  —7.3^  sin(  07(f)  +  02(f) 

+  05(f)  (02(f)  +  02(f)  +  05(f)  +  7.7^  cos(  07(f)  02(f)^ 

+  7.2^  cos(  07(f)  +  02(f)  (02(f)  +  02(f) 

+  lP  cos(  07  ( f )  +  02 (  f )  +  05  ( f )  )  (  07  ( f )  +  02 (  f )  +  03  ( f )  )  )  ) 
+  {lP  sin(  07(f)  07(f)^  —  7,2  sin(  07(f) 

+  02(f)  (07(f)  +  02(f)  +7,5^  sin(  07(f)  +  02(f) 

+  05  ( f )  )  (  07  ( f )  +  02 ( f )  +  03  ( f )  )  +  lP  siii(  07  ( f )  +  02 (  f ) 

+  05  ( f )  +  04  ( f )  )  (  07  ( f )  +  02  ( f )  +  03  ( f )  +  04  ( f )  ) 

+  7,7^  cos(  07(f)  02(f)^  +  cos(  07(f)  +  02(f)  (02(f) 

+  ^2(f))  +  7^5^  cos(  02 ( f )  +  02(f)  +  05(f))  (07(f)  + 

02(f)  +  05(f)  +  7:4^  cos(  07(f)  +  02(f)  +  05(f) 

+  04  ( f )  )  (  07  ( f )  +  02  ( f )  +  03  ( f )  +  04  ( f )  )  )  ) 

—  m7  7,7  sin(  07(f)  )  — m2g7,7  sin(  07  (f)  )  — m2 g L2  01  {t) 
+  02(f))  —  m5gZ7  sin(  07(f))  —  m5gZ2sin(  07(f)  +  02(f)) 

—  m5g7,5sin(  07(f)  +  02(f)  +  05(f))  —  m4  g  LI  sh\{  01  {t)) 

—  m4 g L2  siipOl {t)  +  02(f))  — m'7g7.5  sin(  07(f)  +  02(f) 

+  03  ( f )  )  —  m4  g L4  sin(  07  ( f )  +  02 ( f )  +  03  ( f  )  +  04 )  ) 


—  =  -(mj  +  ^2 + wij  +  )^/j  cos  ^^-{m2+n^+  cos(^j + ^2 ) + (^2  +  ^2)'^  +  ^2  ^3 ) 

dO^ 

•  •  •  •••  •••• 

— —  =  (jUy  +  Jfl2  +  +  TJi^  )/|  6^  —  (jn2  +  ^  I2  {0^  +  ^2  )  "^  (^3  ^4  )  4  (^1  "I"  ^2  ^3  )  ^4^  (^1  "I"  ^2  ^3  ^4  ) 

de, 
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3.2.  Dynamics  for  a  3R  Planer  Index  finger 

We  can  derive  a  set  of  recursive  equations  to  relate  each  link  in  the  coordinate  frame  attached  to  the  previous  link 
based  on  the  velocity  and  acceleration  kinematics.  We  may  generalize  the  method  of  analysis  to  be  suitable  for  a 
robot  index  finger  any  number  of  links.  The  Newton-Euler’s  equations  of  motion  application  in  robot  dynamics 
enables  us  to  calculate  the  joint  forces  one  link  at  a  time  starting  from  the  end-effector  (finger-tip)  link. 

The  backward  Newton-Euler  equations  of  motion  for  the  link  (i)  in  the  local  coordinate  frame  Bi  are 


F  .  =  Z'F.  +m.  'a. 

i-\  ei  i  0  i 


+  ‘h  O^i  +  0^  ^  O^i 


‘n,  =  -  ‘r, 

‘tU:  =  'd,  -  ‘r 


Translational  acceleration  of  link  (i)  is  denoted  by  aOi  and  is  measured  at  the  mass  center  Ci.  Angular  acceleration 
which  is  the  same  for  all  points  of  a  rigid  link  (i)  is  denoted  by  aOi  and  is  usually  shown  at  the  mass  center  Ci.  The 
forces,  Ei-1  and  moment  Mi-1  are  the  resultant  force  and  moment  that  link  (i)  applies  to  link  (i+1)  at  joint  i-i-1. 

When  the  driving  force  system  (Ei-1,  and  Mi-1)  is  found  in  frame  Bi,  we  can  transform  them  to  the  frame  Bi-1  and 
apply  the  Newton-Euler  equation  for  link  (i-1). 

/-I  _  i-\rr<  i 

^i-1  ~  ^i-1 

‘M,_, 

The  negative  of  the  converted  force  system  acts  as  the  driven  force  system  (Ei-1,  and  Mi-1)  for  the  link  (i-1). 


3.3.  Three-link  Index  finger  Dynamics 

Fig. 

The  Torques  of  the  actuators  are  parallel  to  the  z-axis  and  are  shown  to  be  QO,  Q1  and  Q3. 
The  Newton  Euler  equations  of  motion  for  the  first  link  are 

Qi  —Q2  /Tqi  xFq—  niQi  X  =  /oi<^oi 


(3.2.1) 
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Equations  of  motion  for  the  second  link  are 
^01  ~  ^2  ^iSi  ~  ^2^02 

2l  —  ^2  +  ^02  ^  ^01  “  ^02  ^  ^02  ~  ^02^02 


Equations  of  motion  for  the  third  link  are 

^02  —  ^3^03  2  3) 

Q2  +  ^Q3  X  Fq2  =  1 03^03 

There  are  six  equations  with  six  unknowns;  EO,  El,  E2,  QO,  Q1  and  Q2 

However  in  robot  dynamics,  actuator  torques  is  usually  applied  in  the  control  not  the  joint  forces.  So  we  do  not 
necessarily  need  to  find  the  joint  forces.  We  may  eliminate  EO,  El  and  E2  and  reduce  the  number  of  equations  by 
half. 

Eliminating  E2  in  equation  (3.2.3) 

Q2  ~  ^03^03  “^03  (^^03  “^3«§/)  (3  2  4) 

Eliminating  El  and  E2  in  equation  (3.22) 


2l  =  02  +  42«02  («03  -  S/)  -  «02  ("%  («02  “  S/)  “  "^3  («03  “  «/))  (3.2.5) 


Eliminating  EO  and  El  in  equation  (3.2.1) 


=  2l  +  4l«01  +  ^  (^03  -  S/)  -  ^01  (^01  -  S/)  -  («02  -  g/)  -  (%  -  g/)) 

(3.2.6) 


Using  MAPLE,  the  position  of  Ci  and  the  links’  angular  velocity  and  acceleration  are  calculated.  The  translational 
acceleration,  aOl  at  the  center  of  mass  of  each  link  is  also  calculated.  Substituting  these  results  in  equations  (3.2.1), 
(3.2.2)  and  (3.2.3),  provides  the  dynamic  equations  for  the  3R  robotic  finger  in  appropriate  form. 
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Q2 


cos(0J  it)  -+-  e2it')  +  a3(?))  m3\^ 


2L7  cos(  07  (  ?  )  )  01  (^ty 
2 


LI  sin(  01  (  ? )  )  01  (  t) 
2 


7:2cos(  07(/^)  +  02  it))  {01  it)  -+-  02  it))' 

2 


7:2  sitiC  07(7)  +  02it))  (01  it)  H-  02(7)) 

2 

02(7) 


7:2  cos(  07(7) 


02(7))  (07(7)  +  02(7)  +  02(7)) 


7.2  sin(  07(7)  +  02(7)  +  02(7))  (07(7)  H-  02it)  -+-  02(7)) 


1^7:2  sin(  07(7) 


02(7)  +  02(7)  )  m3 


7:7  sin(  07(7)  )  01  (t) 

2 

7:2  sirL(  07(7)  +  02(7))  (  07(7) 


7:7  cos(  07(7)  )  07(7) 
2 

2 


02(7))- 


)) 


7:2cos(  07(7)  +  02(7))  (  07(7)  H-  02(7)) 


7.2  sin(  07  (7) 


2 

02^ 


02(7))  (07(7)  +  02(7)  +  02(7)) 


7:2cos(07(7)  +  02(7)  +  02(7))  (07(7)  -+-  02it) 

2 


o>(0 ) 


—  g L3  cos(  07  H-  02  H-  02) 


y  y 


°j- 

72  (  07(7)  +  02(7)  +  02(7)) 
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4.  Hard  Control  of  the  Prosthetic  Hand 

Control  is  the  science  of  desired  motion.  The  prescribed  motion  of  a  robot  is  related  to  the  dynamics  and  kinematics 
by  control.  In  applying  controls,  certain  optimal  indices  should  be  considered  to  enable  the  system  (device)  function 
optimally.  For  example  performance  of  task  by  the  prosthesis  in  the  shortest  possible  time.  This  is  where  the  concept 
of  path  planning  for  the  robotic  finger  comes  into  play. 

An  integral  part  of  robot  control  is  planning  the  path  (path  planning)  the  robot  should  follow  in  carrying  out  specific 
tasks.  Task  compliance  or  constrained  motion  is  critical  in  situations  where  the  robot  comes  in  contact  with 
obstacles.  This  could  be  done  in  either  Cartesian  or  joint  space.  Path  planning  in  the  joint  space  appear  to  be  easier 
compared  to  Cartesian  space. 

There  are  number  control  algorithms  that  can  be  used  to  control  the  robotic  hand,  each  of  which  is  best  applicable  to 
particular  class  of  robots  in  a  particular  task.  Some  of  these  control  methods  are:  Feedback  linearization  or  computed 
torque  control,  linear  control  technique,  adaptive  control,  robust  control,  gain  scheduling  and  also  the  proportional 
controls  (PI,  PD,  and  PID). 

4.1.  Feedback  Linearization 

In  feedback  linearization  or  computed  torque  approach,  a  control  law  is  defined  to  obtain  a  linear  differential 
equation  for  error  command  and  then  use  the  linear  control  design  technique.  An  alternate  dynamics  of  a  robot 
finger  can  be  written  in  the  form. 


Q  =  D{q)  q+  H(q,  q)  +  G{q) 


(4.1.1) 


Where  q  is  the  joint  variable  vector  and  ^ » 0  jg  the  torques  applied  at  joints.  Assume  a  desired  path  in  joint 

space  is  given  by  twice  differentiable  function  ^  ^  ^  From  the  dynamics,  the  desired  time  history  of 

joints’  position,  velocity  and  acceleration  are  known.  Hence,  by  introducing  a  computed  torque  control  law,  we  can 
control  the  robot  fingers  to  follow  desired  path. 

Q  =  D(q)(qj  -  K^e  -  KpC)  +  H{q,  q)  +  G(q)  (4.1.2) 

Where  e  ,  the  tracking  error  is  defined  as 

e  =  q-qj  (4.1.3) 

Kd  and  Kp  are  constant  gain  diagonal  matrices.  The  control  law  is  stable  and  applied  as  long  as  all  the  eigen 
values  of  the  matrix  below  have  negative  real  parts. 

/  ) 

-Ko, 


[A]  = 


0 

y-Kp 


The  idea  behind  the  introduction  of  a  feedback  signal  is  to  make  the  robot  fingers’  actual  path  track  the  desired  path. 
Unlike  in  the  open  loop  approach,  there  is  always  a  difference  between  the  robot  finger’s  actual  path  and  the  desired 
path.  This  is  due  to  non-modeled  parameters  and  also  errors  in  adjustment. 


28 


4.2.  PID  CONTROL 

The  proportional-integral-derivative  (PID)  control  has  simple  structure  and  clear  physical  meanings  for  the  gain.  It’s 
a  widely  accepted  control  strategy  in  most  industrial  robot  design.  In  most  cases,  feedback  loops  are  controlled  using 
PID  algorithm.  The  main  reason  why  feedback  is  very  important  in  systems  is  to  be  able  to  attain  a  set  point 
irrespective  of  disturbance  or  any  variation  in  characteristics  of  any  form.  The  PID  control  is  always  designed  to 
correct  error(s)  between  process  values  and  particular  desired  set  point  in  a  system. 

Consider  the  characteristic  parameters-  Proportional  (P),  integral  (I)  and  derivative  (D)  controls  as  shown  in  the 
diagram  below  is  to  be  applies  to  the  robotic  hand  (system).  The  system,  S  is  to  be  controlled  using  a  controller,  C; 
where  C  depends  on  the  P,  I  and  D  parameters. 

Considering  the  nonlinear  equation  that  are  derived  from  Euler-Lagrange  equation  (),  the  control  input  variable  F 
which  represents  the  torque  applied  to  the  robot,  is  unknown,  (  assumed  that  the  considered  robot  actuators  were 
ideal  sources  of  torques  and  forces).  However  it  requires  a  control  in  the  joints  to  reach  a  final  position.  Therefore 
we  use  the  classical  PID  law  as  shown  below; 

• 

F  =  K^e  +  Iq  e  (4.2.1) 

Where  e  =  —d  ,  is  the  desired  joint  angle,  ,K.  and  are  the  proportional,  integral  and  derivative 
gains  respectively. 


4.2.1.  4  DOF  Index  finger 

For  this  experiment,  what  we  want  to  control  with  PID  is  the  force  applied  to  the  robot  to  take  it  to  a  desired  position 
using  as  parameter  the  error  between  the  actual  and  the  desired  coordinate.  To  develop  the  dynamic  model  we  will 
consider  the  index  finger  configuration  shown  in  figure  3. 

Considering  the  nonlinear  equation  that  are  derived  from  Euler-Lagrange  equation  (),  the  control 
From  equation  4. 1. 1  we  can  describe  the  motion  of  the  system  as  follows; 


D{q)  = 

^21^22^23^24 

^3 

M3JM32M33M34 

A. 

The  matrix  entries  for  D  (q),  C  (q,q)  and  g(q)  can  be  are  obtained  from  the  dynamic  equation  of  a  4DOF  thumb 
obtained  in  section  3. 

Where 


bII=(MI-FM2-FM3-FM4)*LI^2-F(M2-FM3-FM4)*L2^2-F(M3-FM4)*L3^2-FM4*L4^2-F2*(M2-FM3-FM4)*LI*L2*cos(x 

(4))-f2*(M3-fM4)*LI*L3*cos(x(6)-fx(7))-f2*(M3-fM4)*L2*L3*cos(x(7))-f2*M4*LI*L4*cos(x(6)-fx(7)-fx(8))-f2* 

M4*L2*L4*cos(x(7)-fx(8))-f2*M4*L3*L4*cos(x(8)) 
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^22“ 

(M2+M3+M4)*L2^2+(M3+M4)*L3^2+M4*L4^2+2*(M3+M4)*L2*L3*cos(x(7))+2*M4*L2*L4*cos(x(7)+x(8))+ 

2*M4*L3*L4*cos(x(8)) 

M33  =  (M3+M4)*L3^2+M4*L4^2+2*M4*L3*L4*cos(x(8)) 

M44=M4*L4^2 
^12  “  ^21 

=(M2+M3+M4)*L2^2+(M3+M4)*L3^2+M4*L4^2+(M2+M3+M4)*Ll*L2*cos(x(6))+(M3+M4)*Ll*L3*cos(x(6) 

+x(8))+2*(M3+M4)*L2*L3*cos(x(7))+M4*Ll*L4*cos(x(6)+x(7)+x(8))+2*M4*L2*L4*cos(x(7)+x(8))+2*M4*L3 

*L4*cos(x(8)) 

^13  ~  ^31 

=(M3+M4)*L3^2+M4*L4^2+(M3+M4)*Ll*L3*cos(x(6)+x(7))+(M3+M4)*L2*L3*cos(x(7))+M4*Ll*L4*cos(x(6 

)+x(7)+x(8))+M4*L2*L4*cos(x(7)+x(8))+2*M4*L3*L4*cos(x(8)) 

Mi4  =  =M4*L4^2+M4*Ll*L4*cos(x(6)+x(7)+x(8))+M4*L2*L4*cos(x(7)+x(8))+M4*L3*L4*cos(x(8)) 

Af  23  =  A/32  = 

(M3+M4)*L3^2+M4*L4^2+(M3+M4)*L2*L3*cos(x(7))+M4*L2*L4*cos(x(7)+x(8))+2*M4*L3*L4*cos(x(8)) 
M24  =  M42=M4*L4^2+M4*L2*L4*cos(x(7)+x(8))+M4*L3*L4*cos(x(8)) 

^34  =  ^43  =M4*L4^2+M4*L3*L4*cos(x(8)); 


The  Centrifugal  force,  C-  (^,  q)  are  as  follows 


C^iq,q)  = 

((M2+M3+M4)*Ll*L2*sin(x(6))+(M3+M4)*Ll*L3*sin(x(6)+x(7))+M4*Ll*L4*sin(x(6)+x(7)+x(8)))*(2*x(9)*x( 

10)+x(10)^2)+((M3+M4)*Ll*L3*sin(x(6)+x(7)) 

+(M3+M4)*L2*L3*sin(x(7))+M4*Ll*L4*sin(x(6)+x(7)+x(8))+M4*L2*L4*sin(x(6)+x(8)))*(2*(x(9)*x(ll)+x(10) 
*x(ll))+x(ll)^2)+(M4*Ll*L4*sin(x(6)+x(7)+x(8))+M4*L2*L4*sin(x(7)+x(8))+M4*L3*L4*sin(x(8)))*(2*(x(9)*x 
( 1 2)+x(  1 0)  *x(  1 2)+x(  1 1 )  *x(  1 2))+x(  1 2)^2) 


C2  (<7,  q)  =-((M3+M4)*L2*L3*sin(x(7))+M4*L2*L4*sin(x(7)+x(8)))*(2*(x(9)*x(l  l)+x(10)*x(l  l))+x(l  1)^2)- 

(M4*L2*L4*sin(x(7)+x(8))+M4*L3*L4*sin(x(8)))*(2*x(9)*x(12)+x(12)^2)- 

(M4*L2*L4*sin(x(7)+x(8))+M4*L3*L4*sin(x(8)))*2*(x(10)*x(12)+x(ll)+x(12)) 

C3  {q,  q)  =((M3+M4)*L2*L3*sin(x(7))+M4*L2*L4*sin(x(7)+x(8)))*(2*x(9)*x(10)- 

x(10)^2)+(M4*L3*L4*sin(x(8))*(2*x(9)*x(12)+2*x(10)*x(12)+2*x(ll)*x(12)+x(12)^2)+(M3+M4)*L2*L3*sin(x( 

7))+(M3+M4)*Ll*L3*sin(x(6)+x(7))+(M4*Ll*L4*sin(x(6)+x(7)+x(8))+M4*L2*L4*sin(x(7)+x(8)))*x(9)^2); 

C4(q,q) 

=(M4*L2*L4*sin(x(7)+x(8))+M4*L3*L4*sin(x(8)))*(2*x(9)*x(10)+x(10)^2)+(M4*L3*L4*sin(x(8)))*(2*(x(9)*x( 

ll)+x(10)*x(ll))+x(ll)^2)+(M4*Ll*L4*sin(x(6)+x(7)+x(8))+M4*L2*L4*sin(x(7)+x(8))+M4*L3*L4*sin(x(8)))* 

x(9r2; 


The  Vector  of  gravity  torques  are  as  follows 

(4)  =-(Ml+M2+M3+M4)*g*Ll  *sin(x(5))-(M2+M3+M4)*g*L2*sin(x(5)+x(6))- 
(M3+M4)*g*L3*sin(x(5)+x(6)+x(7))-M4*g*L4*sin(x(5)+x(6)+x(7)+x(8)) 
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g2(^)=-(M2+M3+M4)*g*L2*sin(x(5)+x(6))-(M3+M4)*g*L3*sin(x(5)+x(6)+x(7))- 

M4*g*L4*sin(x(5)+x(6)+x(7)+x(8)) 

=-(M3+M4)*g*L3*sin(x(5)+x(6)+x(7))-M4*g*L4*sin(x(5)+x(6)+x(7)+x(8)) 
(q)  =-M4*g*L4*sin(x(5)+x(6)+x(7)+x(8)) 


From  the  system  equation,  4.1.1  we  can  have 


q  =  Diq)  \-Ciq,q)-giq)]  +  F  (4.2.4) 


With 


F  =  D(qy^F  <^M(q)F 


(4.2.5) 


The  error  signals  of  the  system  are 

em  =  e,-e, 


(4.2.6) 


Where  i  =  joint  angle  1  to  4  and  f  is  the  final  positions  of  the  joint  angles. 

Where  is  the  final  position  of  joints  i  =  1,  2,  3  and  4.  For  the  control,  the  final  positions  are  given  by 


^1/ 

nil 

^2/ 

n  12 

^3/ 

n !  A 

1 

_ 1 

n !  6 

The  index  finger  is  considered  to  be  parallel  to  the  x-axis  so  all  initial  positions  are  zero 

Figures  4.1  and  4.2  are  the  simulations  obtained  using  the  PID  controller  for  a  3DOF  thumb.  The  best  performance 
of  the  controller  parameter  where  obtained  with  the  following  values  after  considering  3  cases  of  different  PID 
combinations. 


PID  PARAMETERS 

CASEl 

CASE2 

CASE3 

Kp(l,  1,  3,&4) 

35,  35,  35  &  35 

25,  25,  25  &  25 

50,  50,  50  &  50 

Kj{l,  2,  3,&4) 

10,  13,  17&20 

20,  23,  27  &  30 

15,20,  35  &40 

1,  3,&4) 

25,  25,  25  &  25 

20,  20,  20  &  20 

45,  45,  45  &  45 

Table  4.1.  Three  cases  of  best  performance  of  PID  parameters 
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Theta-3  error 
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Torque  of  theta  3 


Torque  of  theta  4 


theta2  error  (rad)  thetal  error  (rad) 
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Graphs  of  Case  2 
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Torque  of  theta  3 


Torque  of  theta  4 


time  (sec) 


theta2  error  (rad)  thetal  error  (rad) 


39 


Graphs  of  Case  3 
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5.  Conclusion 

In  this  report,  chapter  1  addressed  the  problem  of  kinematics,  inverse  kinematics  and  Differential  kinematics  of  the 
thumb  and  index  finger  of  a  prosthetic  hand.  These  kinematic  structures  could  be  applied  to  the  rest  of  the  fingers  to 
form  a  complete  prosthetic  hand.  In  Chapter  3,  we  derive  the  dynamic  models  for  a  4  DOFs  finger  via  the 
Lagrangian  convention  and  the  Newton  Euler  postulations.  A  Proportional  Integral  Derivative  control  strategy  was 
applied  to  the  parameters  from  the  dynamics  and  simulation  results  gotten.  Our  first  approach  to  control  the  robotic 
finger  arm  is  by  trial  and  error,  the  two  parameters  of  the  controller  will  be  tuned  manually  to  obtain  the  best  results. 
The  best  performance  of  the  controller  parameters  values  were  shown  in  table  4.1  in  three  different  cases. 
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Abstract 

This  paper  presents  a  hybrid  controller  of  soft  control  techniques,  adaptive  neuro- 
fuzzy  inference  system  (ANFIS)  and  fuzzy  logic  (FL),  and  hard  control  technique, 
proportional-derivative  (PD),  for  a  14-Degrees-of-Freedom  (DoF)  five-finger  smart 
prosthetic  hand.  The  ANFIS  is  used  for  inverse  kinematics  of  three-link  fingers 
and  FL  is  used  for  tuning  the  PD  parameters  with  2  input  layers  (error  and  error 
rate)  using  7  triangular  membership  functions  and  49  fuzzy  logic  rules.  Simu¬ 
lation  results  with  the  hybrid  of  FL-tuned  PD  controller  exhibit  superior  perfor¬ 
mance  compared  to  PD,  PID  or  FL  control  alone. 

Keywords:  Prosthetic  Hand,  Hybrid  Control,  Fuzzy  Logic,  PD  Control, 

Adaptive  Neuro-Fuzzy  Inference  System 


1.  Introduction 

In  the  past  several  decades,  prosthetic  hands  have  been  developed  to  replace 
human  hands  that  can  fully  operate  the  various  motions,  such  as  holding,  moving, 
grasping,  lifting,  twisting  and  so  on  [1-6],  but  replacing  an  artificial  hand  in  all  its 
various  functions,  appearance,  visibility,  and  weight  is  still  a  challenging  task  [1] 
due  to  the  extreme  complexity  of  human  hands. 

Hard  computing/control  (HC)  techniques  comprise  proportional-derivative  (PD) 
control  [7],  proportional-integral-derivative  (PID)  control  [8,  9],  optimal  control 
[9-12],  adaptive  control  [13-16]  etc.  with  specific  applications  to  prosthetic 
devices.  However,  our  previous  works  [7-9,  17]  for  a  smart  prosthetic  hand 
showed  that  PID  controller  resulted  in  overshooting  and  oscillation,  which  were 
also  demonstrated  by  Subudhi  and  Morris  [18]  and  Liu  et  al.  [19]. 
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Soft  computing  (SC)  or  computational  intelligence  (Cl)  [20]  is  an  emerging 
field  based  on  synergy  and  seamless  integration  of  neural  networks  (NN),  fuzzy 
logic  (FL)  and  optimization  methods,  such  as  genetic  algorithms  (GA)  and  particle 
swarm  optimization  (PSO)  [7,  21,  22].  Arslan  et  al.  [23]  developed  the  biome¬ 
chanical  model  with  a  tendon  configuration  of  the  3-Degrees-of-Freedom  (DoF) 
index  finger  of  the  human  hand  and  the  fuzzy  sliding  mode  controller  in  which 
a  FL  unit  tuned  the  slope  of  the  sliding  surface  to  generate  the  required  tendon 
forces  during  closing  and  opening  motion.  Kato  et  al.  [24]  expressed  the  reac¬ 
tion  of  brains  to  the  adaptable  prosthetic  system  for  a  13  DOF  electromyographic 
(EMG)  signal  controlled  prosthetic  hand  with  an  EMG  pattern  recognition  learn¬ 
ing  by  artificial  NN.  Kamikawa  and  Maeno  [25]  used  GA  to  optimize  locations  of 
pivots  and  grasping  force  and  designed  one  ultrasonic  motor  to  move  15  compli¬ 
ant  joints  for  an  underactuated  five-finger  prosthetic  hand.  Khushaba  et  al.  [26] 
developed  a  PSO-based  method  for  myoelectrically  controlled  prosthetic  devices. 

In  hybrid  intelligent  control  strategies,  we  look  at  the  integrated  structure  by 
blending  [27,  28]  SC  techniques  and  conventional  HC  techniques.  The  integration 
of  SC  and  HC  methodologies  shown  in  Figure  1 

[Figure  1  about  here.] 

has  the  following  attractive  features  [27,  28]: 

1 .  The  methodology  based  on  SC  can  be  used,  in  particular  with  FL,  at  upper 
levels  of  the  overall  mission  where  human  involvement  and  decision  making 
is  of  primary  importance,  whereas  the  HC  can  be  used  at  lower  levels  for 
accuracy,  precision,  stability  and  robustness. 

2.  In  another  situation  using  hybrid  scheme,  a  NN  of  the  SC  is  used  to  supple¬ 
ment  the  control  provided  by  a  linear,  fixed  gain  controller. 

3.  Further,  the  SC-based  GA  can  be  used  to  parameter  tuning  of  a  PID  con¬ 
troller  to  achieve  good  performance  and  robustness  for  a  wide  range  of  op¬ 
erating  conditions. 

4.  The  SC  and  HC  techniques  are  potentially  complementary  methodologies. 

5.  The  fusion  could  solve  problems  that  cannot  be  solved  satisfactorily  by  us¬ 
ing  either  methodology  alone. 

6.  Novel  synergetic  combinations  of  SC  and  HC  lead  to  high  performance, 
robust,  autonomous  and  cost-effective  missions. 

Hence,  we  present  the  integration  or  fusion  of  SC  and  HC  to  solve  problems  that 
cannot  be  solved  satisfactorily  by  using  either  HC  or  SC  methodology  alone  with 
specific  applications  to  a  smart  prosthetic  hand. 
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In  this  paper,  we  first  consider  briefly  trajectory  planning  and  kinematics  prob¬ 
lems  associated  with  a  five-finger  prosthetic  hand.  Then,  adaptive  neuro-fuzzy  in¬ 
ference  system  (ANFIS)  is  used  to  solve  inverse  kinematics  problem  for  three-link 
fingers  (index,  middle,  ring,  and  little).  Next,  the  dynamic  model  of  the  hand  is 
derived  and  feedback  linearization  technique  is  used  to  obtain  linear  tracking  er¬ 
ror  dynamics.  Then  we  propose  the  FL-based  PD  (hybrid)  controller,  which  uses 
FL  with  7  triangular  membership  functions  in  each  input/output  layer  and  49  logic 
rules  to  tune  PD  gain  parameters.  The  resulting  overall  hybrid  system  incorporat¬ 
ing  both  soft  and  hard  control  techniques  is  simulated  with  realistic  data  for  the 
hand  and  found  the  performance  to  be  superior  to  HC  (PD  and  PID)  or  SC  (FL) 
alone.  Finally,  we  provide  conclusions  and  future  work. 

2.  Modeling 

2.1.  Trajectory  Planning  and  Kinematics 

The  trajectory  planning  using  cubic  polynomial  was  discussed  in  our  previous 
work  [7,  11,  29,  30]  for  a  two-finger  (thumb  and  index  finger)  smart  prosthetic 
hand. 

Kinematics  is  the  study  of  geometry  in  motion  and  is  restricted  to  a  natural  ge¬ 
ometrical  description  of  motion  by  the  manners,  including  positions,  orientations, 
and  their  derivatives  (velocities  and  accelerations)  [31].  Forward  and  inverse  kine¬ 
matics  of  articulated  systems  study  the  analytical  relationship  between  the  angular 
positions  of  joints  and  the  positions  and  orientations  of  the  fingertips.  A  desired 
trajectory  is  usually  specified  in  Cartesian  space  and  the  trajectory  controller  is 
easily  performed  in  the  joint  space.  Therefore,  conversion  of  Cartesian  trajectory 
planning  to  the  joint  space  [31]  is  necessary.  Using  inverse  kinematics,  the  joint 
angular  positions  of  each  finger  need  to  be  obtained  from  the  known  fingertip 
positions.  Then  the  angular  velocities  and  angular  accelerations  of  joints  can  be 
obtained  from  the  linear  and  angular  velocities  and  accelerations  of  fingertips  by 
differential  kinematics.  The  inverse  and  differential  kinematics  of  two-link  thumb 
and  three-link  fingers  were  discussed  in  our  previous  publications  [7,  11,  29,  30] 
for  a  two-finger  (thumb  and  index  finger)  smart  prosthetic  hand. 

[Figure  2  about  here.] 

For  five  fingers  shown  in  Figure  2,  X^,  Y^,  and  are  the  three  axes  of  global 
coordinate.  Local  coordinate  x^-y^-z^  of  thumb  can  be  reached  by  rotating  through 
angles  a  and  /?  to  and  of  the  global  coordinate,  subsequently.  Local 
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coordinate  x^-y'^-z^  of  index  finger  can  be  obtained  by  rotating  through  angle  a  to 
and  then  translating  a  vector  d*  of  the  global  coordinate;  similarly,  the  local 
coordinate  x^-y^z^  of  middle  finger  (j  =  m),  ring  finger  (j  =  r),  and  little  finger 
(j  =  1)  can  be  obtained  by  rotating  through  angle  a  to  X'^  and  then  translating 
the  vector  d-*  (j  =  m,r  and  1)  of  the  global  coordinate. 

2.2.  Adaptive  Neuro-Fuzzy  Inference  System  (ANFIS) 

The  inverse  kinematics  problems  for  three-link  fingers  can  be  solved  by  us¬ 
ing  adaptive  neuro-fuzzy  inference  system  (ANFIS)  method  [32]  where  the  input 
of  fuzzy-neuro  system  is  the  Cartesian  space  and  the  output  is  the  joint  space. 
ANFIS  is  a  fuzzy  inference  system  implemented  in  the  framework  of  adaptive 
networks  which  provides  the  best  optimization  algorithm  to  find  parameters  in  or¬ 
der  to  fit  the  data.  ANFIS  includes  premise  parameters,  that  defines  membership 
functions,  and  consequent  parameters,  that  defines  the  coefficients  of  each  output 
equation.  ANFIS  tunes  the  membership  function  and  identifies  the  coefficients 
by  the  backpropagation  gradient  descent  and  least-squares  methods,  respectively. 
ANFIS  uses  a  hybrid  learning  algorithm  to  identify  parameters  of  Sugeno-type 
fuzzy  inference  systems  for  fuzzy  modeling  procedures  to  learn  information  about 
a  data  set  in  order  to  compute  the  membership  function  and  track  the  given  in¬ 
put/output  data.  Figure  3  (a)  shows  a  two  input  first-order  Sugeno  fuzzy  model 
with  two  rules  and  Figure  3  (b)  depicts  the  equivalent  ANFIS  structure  for  all  the 
computation  below. 


[Figure  3  about  here.] 

Sugeno-type  fuzzy  system  has  the  following  Rule  Base  [32,  33]. 

If  X  is  Ai  and  y  is  Bi,  then  /i  =  pix  +  qiy  +  ri. 

If  X  is  A2  and  y  is  B2,  then  /2  =  P2X  +  q2y  +  ^2. 

Here,  x  and  y  are  inputs  to  constitute  the  premise  parameters  Ai,  A2,  Bi,  and  B2 
(Layer  1  in  Figure  3  (b)).  pi,  qi,  and  r*  {i  =  1,2)  are  the  consequent  parameters. 
We  evaluate  the  rules  by  choosing  product  for  T-Norm  (Layers  2  and  3)  which 
results  in 


Wi  =  yUA,(x)  yUB.(y),  i  =  1,2.  (1) 

Here,  PAi{x)  and  PBiiv)  are  designed  fuzzy  membership  functions.  Now  af¬ 
ter  leaving  the  arguments  (Layer  4),  we  get  the  output  f{x,  y)  by  Rule  Conse¬ 
quences. 
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f{x,y) 


mjx,  y)fi{x,  y)  +  W2{x,  y)f2{x,  y) 
wi{x,y)  +  W2{x,y) 


(2) 


/(Layer  5)  can  be  written  as 


/ 


Wl/l  +  W2/2 
W\  +  W2 
Wlfl  +  W2f2, 


(3) 


where 


Wi 


Wi 

- ^ - ,  ^2 

W\  +  W2 


W2 

W\  +  W2 


(4) 


2.3.  Dynamics  of  the  Hand 

The  dynamic  equations  of  hand  motion  are  derived  via  Lagrangian  approach 
using  kinetic  energy  and  potential  energy  as  [30,  31] 


y  (f^\  _  ^  ^ 

dt\dii{t))  dq(t) 


where  C{t)  is  Lagrangian;  q(f)  and  q(f)  represent  the  angular  velocity  and  posi¬ 
tion  vectors  of  joints,  respectively;  T{t)  is  the  given  torque  vector  at  joints.  The 
Lagrangian  C{t)  can  be  expressed  as 


C(t)  =  T{t)  -  VH), 


(6) 


where  T{t)  and  V  (t)  denote  kinetic  and  potential  energies  at  time  t,  respectively. 
Substituting  (6)  into  (5),  dynamic  equations  of  thumb  and  all  fingers  can  be  ob¬ 
tained  as  below. 


M(q(f))q(f)  +  C(q(f),  q(f))  +  G(q(f))  =  T{t),  (7) 

where  M(q(f))  is  the  inertia  matrix;  C(q(f),  q(f))  is  the  Coriolis/centripetal  vec¬ 
tor  and  G(q(f))  is  the  gravity  vector.  Then,  (7)  can  be  also  written  as 

M(q(f))q(f)  +  N(q(f),  q(f))  =  rf),  (8) 

where  N(q(f),  q(f))  =  C(q(f),  q(f))  -f  G(q(f))  represents  nonlinear  terms.  The 
dynamic  relations  for  the  two-link  thumb  and  all  three-link  fingers  are  detailed  in 
our  previous  work  [30]. 
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3.  Control  Techniques 

3.1.  Feedback  Linearization 

The  nonlinear  dynamics  represented  by  (8)  is  to  be  converted  into  a  linear 
state- variable  system  using  feedback  linearization  technique  [14].  Alternative 
state-space  equations  of  the  dynamics  can  be  obtained  by  defining  the  position/velocity 
state  x(f)  of  the  joints  as 


x(f)  =  [q'(f)  q'Wr.  (9) 

Let  us  repeat  the  dynamical  model  and  rewrite  (8)  as 

4q(()  =  -M-‘(q(i))  [N(q(().  q(t))  -  r(t)] .  (10) 

Thus,  from  (9)  and  (10),  we  can  derive  a  linear  system  in  Brunov  sky  canonical 
form  as 


x(f)  = 


0  I 
0  0 


x(f) 


0 

I 


u(f) 


with  its  control  input  vector  given  by 

u(f)  =  -M-^(q(f))[N(q(f),q(f))-T(f)]. 


(11) 

(12) 


Let  us  suppose  the  prosthetic  hand  is  required  to  track  the  desired  trajectory  qd(f) 
described  under  path  generation  or  tracking.  Then,  the  tracking  error  e(f)  is  de¬ 
fined  as 


e(f)  =  qd(f)  -  q(f).  (13) 

Here,  qd(f)  is  the  desired  angle  vector  of  joints  and  can  be  obtained  by  trajectory 
planning  [7,  11,  29,  30];  q(f)  is  the  actual  angle  vector  of  joints.  Differentiating 
(13)  twice,  to  get 

e(f)  =  qd(f)  -  q(f),  e(f)  =  qd(f)  -  q(f).  (14) 

Substituting  (10)  into  (14)  yields 

e(f)  =  qd(f)  +  M“^(q(f))  [N(q(f),  q(f))  -  T{t)]  (15) 
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from  which  the  control  function  can  be  defined  as 

u(f)  =  qd(f)  +  M“^(q(f))  [N(q(f),  q(f))  -  T{t)] .  (16) 

This  is  often  called  the  feedback  linearization  control  law,  which  can  also  be  in¬ 
verted  to  express  it  as 

T{t)  =  M(q(f))  [qd(f)  -  u(f))  +  N(q(f),  q(f)] .  (17) 

Using  the  relations  (14)  and  (16),  and  defining  state  vector  x(f)  =  [eft)  e'(f)]', 
the  tracking  error  dynamics  can  be  written  as 

^00  ^  I 

Note  that  this  is  in  the  form  of  a  linear  system  such  as 

x(f)  =  Ax(f)  -I-  Bu(f).  (19) 

3.2.  Fuzzy  Logic-Based  PD  Hybrid  Control 

[Figure  4  about  here.] 

Figure  4  shows  the  block  diagram  of  the  hybrid  fuzzy  logic-based  PD  controller 
for  the  proposed  five-finger  prosthetic  hand  with  control  signal  as 

u(f)  =  — Kp(f)e(f)  —  K.-D(t)e(t)  (20) 

with  the  proportional  Kp(f)  and  derivative  K-D{t)  diagonal  gain  matrices  with 
time  varying.  We  then  rewrite  (17)  as 

Tit)  =  M(q(f))[qd(f)  +  Kp(f)e(f)  +  KD(f)e(f))  + 

N(q(f),q(f)].  (21) 

Then  we  use  Mamdani  fuzzy  inference  system  to  tune  the  time-varying  parameters 
Kp(f)  and  KD(f)  of  PD  controller.  The  structural  characteristics  of  proposed 
fuzzy  inference  system,  which  includes  two  inputs  (error  e  and  error  rate  e)  and 
one  output  (Kp).  Each  input  or  output  layer  contains  seven  triangular  membership 
functions  as  shown  in  Figure  5  and  49  logic  rules  as  listed  in  Table  1 . 

[Figure  5  about  here.] 

[Table  1  about  here.] 

Using  49  logic  rules,  the  output  surface  Kp  of  fuzzy  inference  system  is  generated 
as  shown  in  Figure  6.  Similarly,  Kd  can  be  computed  by  the  same  way. 

[Figure  6  about  here.] 
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4.  Simulation  Results  and  Discussion 


[Figure  7  about  here.] 

Figure  7  shows  that  a  five-finger  prosthetic  hand  with  14  DoF  is  grasping  a  rectan¬ 
gular  rod.  When  thumb  and  the  other  four  fingers  are  performing  extension/flexion 
movements,  the  workspace  of  fingertips  is  restricted  to  the  maximum  angles  of 
joints.  Referring  to  inverse  kinematics,  the  first  and  second  joint  angles  of  the 
thumb  fingertip  are  constrained  in  the  ranges  of  [0,90]  and  [-80,0]  (degrees).  The 
first,  second,  and  third  joint  angles  of  the  other  four  fingers  are  constrained  in  the 
ranges  of  [0,90],  [0,110]  and  [0,80]  (degrees),  respectively  [34]. 

Next,  we  present  simulations  with  PD  and  PID  controllers  and  fuzzy  inference 
system  tuned  PD  controller  for  the  14-DOF,  five-finger  smart  prosthetic  hand.  The 
parameters  of  the  two-link  thumb/three-link  fingers  were  related  to  desired  trajec¬ 
tory  [35].  All  parameters  of  the  smart  prosthetic  hand  selected  for  the  simulations 
are  given  in  Table  2  and  the  side  length  and  length  of  the  target  rectangular  rod 
are  0.010  and  0.100  (m),  respectively.  The  relating  parameters  between  the  global 
coordinate  and  the  local  coordinates  are  defined  in  Table  3  and  Figure  2. 

[Table  2  about  here.] 

[Table  3  about  here.] 

Moreover,  each  link  of  all  fingers  is  assumed  to  be  a  circular  cylinder  with  the 
radius  (R)  0.010  (m),  so  the  inertia  of  each  link  k  of  all  fingers  j  (=  t,  i,  m, 
r  and  1)  can  be  calculated  as 

+  jKif  ■  (22) 

All  initial  actual  angles  are  zero  and  the  diagonal  coefficients,  Kp,  Ki  and  Kd, 
for  the  PD  or  PID  controller  alone  are  arbitrarily  chosen  as  100.  From  the  derived 
dynamic  and  control  models,  the  control  signal  u  and  torque  r  can  be  calculated 
after  the  parameters  (Kp  and  Kd)  are  selected. 

[Figure  8  about  here.] 

Figure  8  shows  tracking  errors  (e\  and  on  the  left  column)  and  desired/actual 
angles  (gj  and  ql  on  the  right  column)  of  joints  1  (the  top  row)  and  2  (the  bottom 
row)  for  two-link  thumb  using  PD  (dash  line),  PID  (dot  line),  FL  (short  dash  line) 


8 


and  hybrid  of  FL  and  PD  (solid  line)  controllers.  The  tracking  errors  for  both  PD 
and  FL  controllers  are  convergent  to  zero  within  5  seconds  without  overshooting, 
but  PID  controller  takes  longer  (approximate  10  seconds)  with  overshooting  and 
oscillation.  The  proposed  hybrid  control  of  FL  and  PD  using  parameters  Kp  G 
[50, 1000]  and  Kd  G  [50,500]  provides  5-10  fold  faster  convergence  than  PD, 
PID  and  FLC  alone.  FLC  includes  two  inputs  (error  and  error  rate)  and  one  output 
(control  signal).  To  further  study  whether  the  parameter  range  influences  tracking 
errors,  we  found  that  the  larger  the  parameter  range,  the  faster  the  convergent 
speed  for  the  range  Kp  G  [50, 2000]  without  additional  computational  time  [36]. 
These  results  clearly  demonstrate  that  fusion  of  soft  computing  (SC)  and  hard 
control  (HC)  is  superior  to  either  HC  or  SC  methodology  alone. 

[Figure  9  about  here.] 

The  time-variant  computed  control  signals  {u\  and  u^)  and  torques  (r{  and  r^)  for 
two-link  thumb  are  shown  in  Figure  9,  suggesting  that  the  proposed  hybrid  FL-PD 
controller  requires  more  power  (torque)  than  PD,  PID  and  FL  controllers  in  order 
to  obtain  faster  convergent  tracking  errors. 

[Figure  10  about  here.] 

Figure  10  shows  tracking  errors  and  desired/actual  angles  for  three-link  index  fin¬ 
ger.  As  increasing  DOFs,  PID  control  still  shows  overshooting  and  oscillation 
but  both  PD  and  FL  controllers  reduce  accuracy  and  convergent  speed.  How¬ 
ever,  the  hybrid  control  still  shows  fast  convergence  and  high  accuracy.  Similarly, 
Figures  11,  12  and  13  show  similar  results  of  tracking  errors  for  the  remaining 
three-link  fingers  (middle,  ring  and  little). 

[Figure  1 1  about  here.] 

[Figure  12  about  here.] 

[Figure  13  about  here.] 

Figure  14  shows  the  animation  of  hybrid  control  for  a  14-DOF,  five-finger 
smart  prosthetic  hand  in  3D  (right  upper)  and  2D  (left  upper  and  bottom).  [Note: 
The  animation  file  (Prosthetic  Hand  Animation.avi)  for  Figure  14  is  submitted 
separately  along  with  the  manuscript.  If  you  use  Adobe  Acrobat  version  9  (or 
later),  you  can  directly  play  the  video  on  this  pdf  file.] 

[Figure  14  about  here.] 
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5.  Conclusions  and  Future  Work 

For  a  14-DOF,  five-finger  smart  prosthetic  hand,  a  hybrid  control  technique 
involving  soft  control  with  adaptive  neuro-fuzzy  inference  system  (ANFIS)  and 
fuzzy  logic  (FL)  and  hard  control  with  proportional-derivative  (PD)  was  proposed. 
The  ANFIS  was  used  for  inverse  kinematics  and  FL  was  used  for  tuning  the  PD 
parameters  with  2  input  layers  (error  and  error  change)  using  7  triangular  mem¬ 
bership  functions  and  49  fuzzy  logic  rules.  Simulation  results  with  FL-tuned  PD 
(hybrid)  controller  showed  superior  performance  compared  to  hard  control  or  soft 
computing  alone.  Work  is  underway  to  extend  this  methodology  to  a  real-time 
implementation  on  the  prototype  of  a  prosthetic  hand. 
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Table  1 :  A  Complete  Fuzzy  Logic  Rule  Base 


e\e 

NL 

NM 

NS 

ZR 

PS 

PM 

PL 
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SM 
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ZR 
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VS 
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SM 

ML 

NS 
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ZR 

VS 

s 

SM 

ML 
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PL 

SM 

ML 
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VL 
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N:  negative;  P:  positive;  ZR:  zero;  L:  large; 
M:  medium;  S:  small;  V:  very 


16 


Table  2:  Parameter  Selection  of  the  Smart  Hand 


Parameters 

Values 

Thumb 

Time 

Desired  Initial  Position  (A’q,Fq*)** 

Desired  Final  Position  (Xj,YfT* 

Desired  Initial  Velocity  (A’o,Fo*)* 

Desired  Final  Velocity 

Length  (LlXl) 

Mass 

0,  20  (sec) 

0.035,  0.060  (m) 

0.0495,  0.060  (m) 

0,  0  (m/s) 

0,  0  (m/s) 

0.040,  0.040  (m) 

0.043,  0.031  (kg) 

Index  Finger 

Desired  Initial  Position  (A’o,Fo)** 

Desired  Final  Position  (X^Yp** 

Length  {L\,L2^L\) 

Mass 

0.065,  0.080  (m) 

0.010,  0.060  (m) 

0.040,  0.040,  0.030  (m) 

0.045,  0.025,  0.017  (kg) 

Middle  Finger 

Desired  Initial  Position  {Xp,YfP)** 
Desired  Final  Position  {XJ'Xpy* 
Length  (Ly,L^,LT) 

Mass 

0.065,  0.080  (m) 

0.005,  0.060  (m) 

0.044,  0.044,  0.033  (m) 

0.050,  0.028,  0.017  (kg) 

Ring  Finger 

Desired  Initial  Position  (X^Yq)** 
Desired  Final  Position  (X^Yp** 

Length 

Mass  {m\,m2'>mp 

0.065,  0.080  (m) 

0.010,  0.060  (m) 

0.040,  0.040,  0.030  (m) 

0.041,  0.023,  0.014  (kg) 

Little  Finger 

Desired  Initial  Position  (Xq,YqT* 

Desired  Final  Position  (XpY})** 

Length  {L\,L2^Lp 

Mass  (m[,m2,mp 

0.055,  0.080  (m) 

0.020,  0.060  (m) 

0.038,  0.038,  0.030  (m) 

0.041,  0.023,  0.014  (kg) 

*A11  fingers  use  same  parameters 
**A11  parameters  are  in  local  coordinates 
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Table  3:  Parameter  Selection  of  Conversion  between  Global  and  Local  Coordi¬ 
nates 


Parameters 

Values 

Rotating  a 

90  (deg) 

Rotating  P 

45  (deg) 

Translating  d‘ 

(0.035,  0,  0)  (m) 

Translating  d*” 

(0.040,  0,  -0.020)  (m) 

Translating  d*" 

(0.035,  0,  -0.040)  (m) 

Translating  d* 

(0.025,  0,  -0.060)  (m) 

18 


List  of  Figures 

1  Principle  behind  Fusion  of  Soft  and  Hard  Computing .  21 

2  Relationship  between  Global  Coordinate  and  Local  Coordinates: 

Local  coordinate  x*-y*-z*  of  thumb  can  be  reached  by  rotating 
through  angles  a  and  /?  to  and  of  global  coordinate,  sub¬ 
sequently.  Local  coordinate  x^-y'^-z^  of  index  finger  can  be  ob¬ 
tained  by  rotating  through  angle  a  to  and  then  translating  a 
vector  d*  of  the  global  coordinate .  22 

3  ANFIS  Architecture:  (a)  A  Two  Input  First-Order  Sugeno  Fuzzy 
Model  with  Two  Rules  (b)  Equivalent  ANFIS  Structure  [32].  The 
inverse  kinematics  problems  are  solved  by  using  adaptive  neuro- 
fuzzy  inference  system  (ANFIS)  method  where  the  input  of  fuzzy- 
neuro  system  is  Cartesian  space  and  the  output  is  joint  space.  AN¬ 
FIS  is  a  fuzzy  inference  system  implemented  in  the  framework  of 
adaptive  networks  which  provides  the  best  optimization  algorithm 

to  find  parameters  in  order  to  fit  the  data .  23 

4  Block  Diagram  of  the  Proposed  Hybrid  Fuzzy  Logic-Based  Proportional- 
Derivative  (PD)  Controller  for  a  Five-Finger  Prosthetic  Hand:  Er¬ 
rors  and  error  changes  are  calculated  by  actual  and  desired  angles, 
which  are  based  on  adaptive  neuro-fuzzy  inference  system  (AN¬ 
FIS)  trajectory  planner.  Then  fuzzy  logic  controller  tunes  all  pa¬ 
rameters  of  closed-loop  PD  control  so  that  the  required  torque  of 

the  prosthetic  hand  nonlinear  system  is  computed  by  control  input.  24 

5  All  Membership  Functions:  Each  of  Two  Inputs  (Upper  Panel) 
and  One  Output  (Lower  Panel)  Uses  7  Triangular  Membership 


Functions .  25 

6  The  Output  Surface  of  Fuzzy  Inference  System  with  Two  Inputs 

and  49  Logic  Rules .  26 

7  Five-Finger  Prosthetic  Hand  Grasping  a  Rectangular  Object  ...  27 

8  Tracking  Errors  and  Desired/ Actual  Angles  of  Joints  1  (a,b)  and 
2  (c,d)  for  Two-Link  Thumb  Using  PD  (dash  line),  PID  (dot  line). 


FL  (short  dash  line)  and  hybrid  of  FL  and  PD  (solid  line)  Controllers  28 
9  Control  Signals  and  Actuated  Torques  of  Joints  1  (a,b)  and  2  (c,d) 
for  Two-Link  Thumb  Using  PD  (dash  line),  PID  (dot  line),  FL 
(short  dash  line)  and  hybrid  of  FL  and  PD  (solid  line)  Controllers  .  29 


19 


10  Tracking  Errors  and  Desired/ Actual  Angles  of  Joints  1  (a,b),  2 
(c,d)  and  3  (e,f)  for  Three-Link  Index  Finger  Using  PD  (dash  line), 

PID  (dot  line),  FL  (short  dash  line)  and  hybrid  of  FL  and  PD  (solid 
line)  Controllers .  30 

11  Tracking  Errors  and  Desired/ Actual  Angles  of  Joints  1  (a,b),  2 
(c,d)  and  3  (e,f)  for  Three-Link  Middle  Finger  Using  PD  (dash 
line),  PID  (dot  line),  FL  (short  dash  line)  and  hybrid  of  FL  and 

PD  (solid  line)  Controllers .  31 

12  Tracking  Errors  and  Desired/ Actual  Angles  of  Joints  1  (a,b),  2 
(c,d)  and  3  (e,f)  for  Three-Link  Ring  Finger  Using  PD  (dash  line), 

PID  (dot  line),  FL  (short  dash  line)  and  hybrid  of  FL  and  PD  (solid 
line)  Controllers .  32 

13  Tracking  Errors  and  Desired/ Actual  Angles  of  Joints  1  (a,b),  2 
(c,d)  and  3  (e,f)  for  Three-Link  Little  Finger  Using  PD  (dash  line), 

PID  (dot  line),  FL  (short  dash  line)  and  hybrid  of  FL  and  PD  (solid 
line)  Controllers .  33 

14  Hybrid  Control  Animation  for  a  Five-Fingered  Prosthetic  Hand  .  .  34 


20 


21 


Figure  2:  Relationship  between  Global  Coordinate  and  Local  Coordinates:  Local 
coordinate  x*-y*-z*  of  thumb  can  be  reached  by  rotating  through  angles  a  and  P  to 
and  of  global  coordinate,  subsequently.  Local  coordinate  x^-y^-z^  of  index 
finger  can  be  obtained  by  rotating  through  angle  a  to  and  then  translating  a 
vector  d*  of  the  global  coordinate. 
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Figure  3:  ANFIS  Architecture:  (a)  A  Two  Input  First-Order  Sugeno  Fuzzy  Model 
with  Two  Rules  (b)  Equivalent  ANFIS  Structure  [32].  The  inverse  kinematics 
problems  are  solved  by  using  adaptive  neuro-fuzzy  inference  system  (ANFIS) 
method  where  the  input  of  fuzzy-neuro  system  is  Cartesian  space  and  the  output 
is  joint  space.  ANFIS  is  a  fuzzy  inference  system  implemented  in  the  framework 
of  adaptive  networks  which  provides  the  best  optimization  algorithm  to  find  pa¬ 
rameters  in  order  to  fit  the  data. 
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Figure  4:  Block  Diagram  of  the  Proposed  Hybrid  Fuzzy  Logic-Based 
Proportional-Derivative  (PD)  Controller  for  a  Five-Finger  Prosthetic  Hand:  Er¬ 
rors  and  error  changes  are  calculated  by  actual  and  desired  angles,  which  are  based 
on  adaptive  neuro-fuzzy  inference  system  (ANFIS)  trajectory  planner.  Then  fuzzy 
logic  controller  tunes  all  parameters  of  closed-loop  PD  control  so  that  the  required 
torque  of  the  prosthetic  hand  nonlinear  system  is  computed  by  control  input. 
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Figure  5:  All  Membership  Functions:  Each  of  Two  Inputs  (Upper  Panel)  and  One 
Output  (Lower  Panel)  Uses  7  Triangular  Membership  Functions 
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Figure  6:  The  Output  Surface  of  Fuzzy  Inference  System  with  Two  Inputs  and  49 
Logic  Rules 
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Figure  7:  Five-Finger  Prosthetic  Hand  Grasping  a  Rectangular  Object 
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Figure  8:  Tracking  Errors  and  Desired/ Actual  Angles  of  Joints  1  (a,b)  and  2  (c,d) 
for  Two-Link  Thumb  Using  PD  (dash  line),  PID  (dot  line),  FL  (short  dash  line) 
and  hybrid  of  FL  and  PD  (solid  line)  Controllers 
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Figure  9:  Control  Signals  and  Actuated  Torques  of  Joints  1  (a,b)  and  2  (c,d)  for 
Two-Link  Thumb  Using  PD  (dash  line),  PID  (dot  line),  FL  (short  dash  line)  and 
hybrid  of  FL  and  PD  (solid  line)  Controllers 
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Figure  10:  Tracking  Errors  and  Desired/ Actual  Angles  of  Joints  1  (a,b),  2  (c,d) 
and  3  (e,f)  for  Three-Link  Index  Finger  Using  PD  (dash  line),  PID  (dot  line),  FL 
(short  dash  line)  and  hybrid  of  FL  and  PD  (solid  line)  Controllers 
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Figure  1 1 :  Tracking  Errors  and  Desired/ Actual  Angles  of  Joints  1  (a,b),  2  (c,d) 
and  3  (e,f)  for  Three-Link  Middle  Finger  Using  PD  (dash  line),  PID  (dot  line),  FL 
(short  dash  line)  and  hybrid  of  FL  and  PD  (solid  line)  Controllers 
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Figure  12:  Tracking  Errors  and  Desired/ Actual  Angles  of  Joints  1  (a,b),  2  (c,d) 
and  3  (e,f)  for  Three-Link  Ring  Finger  Using  PD  (dash  line),  PID  (dot  line),  FL 
(short  dash  line)  and  hybrid  of  FL  and  PD  (solid  line)  Controllers 
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Figure  13:  Tracking  Errors  and  Desired/ Actual  Angles  of  Joints  1  (a,b),  2  (c,d) 
and  3  (e,f)  for  Three-Link  Little  Finger  Using  PD  (dash  line),  PID  (dot  line),  FL 
(short  dash  line)  and  hybrid  of  FL  and  PD  (solid  line)  Controllers 
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Figure  14:  Hybrid  Control  Animation  for  a  Five-Fingered  Prosthetic  Hand 
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A  New  Optimal  Control  Strategy  for  a 
Five-Fingered  Smart  Prosthetic  Hand 

Cheng-Hung  Chen*  and  D.  Subbaram  Naidu 


Abstract 

This  paper  addresses  a  new  optimal  control  strategy  for  a  five-fingered  prosthetic  hand,  to  speed  up 
the  performance  and  improve  the  accuracy,  by  modifying  the  performance  index  with  an  exponential 
term.  First,  the  trajectory  planning  of  the  joints  of  each  finger  is  designed  by  using  cubic  polynomial. 
Then  the  dynamic  equations  of  the  prosthetic  hand  and  feedback  linearization  technique  are  employed. 
Next,  the  optimal  control  method  with  modified  performance  index  is  applied  to  the  prosthetic  hand. 
Finally,  simulations  show  that  the  proposed  technique  provides  much  faster  response  with  high  accuracy 
compared  to  adaptive  neuro-fuzzy  inference  system  (ANFIS)  based  inverse  kinematics  for  trajectory 
planning  and  PID  control. 


Index  Terms 

Prosthetic  Hand,  Optimal  Control,  Hard  Control,  PID  Control,  Trajectory  Planning,  ANFIS 


I.  Introduction 

During  the  recent  wars  in  Afghanistan  and  Iraq,  “at  least  919,967  people  have  been  killed  and 
1,739,547  people  have  been  seriously  wounded”  [1].  Further,  in  the  United  States,  the  Amputee 
Coalition  of  America  (ACA)  [2]  reports  that  there  are  approximately  2  million  people  living  with 
limb  loss,  due  to  combat  operations  (such  as  conflicts,  wars  etc.),  and  non-combat  operations 
such  as  accidents,  or  birth  defects.  According  to  a  study  of  the  National  Health  Interview  Survey 
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(NHIS)  published  by  Vital  and  Health  Statistics  [3],  it  is  estimated  that  one  out  of  every  200 
people  in  the  U.S.  has  had  an  amputation.  In  other  words,  about  one  in  every  2,000  new  born 
babies  will  have  limb  dehciency  and  over  3,000  people  lose  a  limb  every  week  in  America. 
By  the  year  2050,  the  projected  number  of  Americans  living  with  limb  amputation  will  become 
3.6  million  [4].  In  the  past  several  decades,  prosthetic  hands  have  been  developed  by  various 
researchers  in  the  held  [5-10],  but  reproducing  the  human  hand  in  all  its  various  functions, 
appearance,  visibility,  and  weight  is  still  a  challenging  task  [5]. 

In  the  research  and  development  of  a  prosthetic  hand  using  non-invasive  techniques,  the 
three  basic  problems  are,  hrst,  electromyographic  (EMG)  signal  acquisition,  and  classihcation 
to  correspond  to  various  human-like  operations  or  features;  second,  conversion  of  EMG  feature 
signals  to  control  signals  to  input  to  actuators  to  operate  the  prosthetic  hand;  third,  design  and 
building  of  a  prosthetic  hand  with  necessary  sensors  to  operate  according  to  the  control  signal 
that  corresponds  to  the  EMG  signal  intended  for  the  particular  identihed  hand  operation.  Figure  1 
shows  the  schematic  diagram  of  our  smart  prosthetic  hand  technology.  The  overall  system,  in 
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Fig.  1.  Schematic  diagram  of  prosthetic  hand  technology. 


brief,  consists  of  EMG  signal  acquisition  from  the  user  arm  for  surface  or  implanted  electrodes 
(in  the  implanted  case  we  focus  on  biocompatibility  based  on  nano-materials  research).  The 
EMG  signal  is  then  processed  for  feature  extraction  and  classification  or  identification  of  EMG 
signal  to  correspond  to  different  motions  of  the  prosthetic  hand.  The  classified  signal  is  then 


used  to  control  the  prosthetic  hand  using  actuators  and  driving  mechanisms.  This  paper  focuses 
on  studying  the  intelligent  control  strategy. 

Soft  computing/control  (SC)  or  computational  intelligence  (Cl)  [11]  is  an  emerging  field  based 
on  synergy  and  seamless  integration  of  neural  network  (NN),  fuzzy  logic  (FL)  and  genetic 
algorithm  (GA)  and  the  SC  can  be  used  at  upper  levels  of  the  overall  mission  where  human 
involvement  and  decision  making  is  of  primary  importance.  Several  SC  techniques  have  been 
applied  to  prosthetic  hands.  Hard  computing/control  (HC)  techniques  comprise  proportional- 
integral-derivative  (PID)  control  [12,  13],  force-derivative  feedback  control  [14],  force-velocity 
control  [15],  proportional-derivative  (PD)  control  [16,  17],  optimal  control  [18-21],  adaptive 
control  [22-25]  etc.  with  specific  applications  to  prosthetic  devices.  Unlike  SC,  HC  can  be  used 
at  lower  levels  for  accuracy,  precision,  stability  and  robustness.  Recently,  the  authors  conducted 
an  overview  of  control  strategies  for  prosthetic  hands  [8,  10].  However,  our  previous  work 
[19]  for  a  five-fingered  smart  prosthetic  hand  showed  that  PID  control  results  in  overshooting 
and  oscillation,  which  were  also  demonstrated  by  Subudhi  and  Morris  [26].  Optimal  control 
can  obtain  a  high  performance  [19],  but  requires  large  computational  time.  To  overcome  the 
overshooting  and  convergent  problems,  a  novel  finite-time  optimal  control  strategy  for  a  14 
degrees  of  freedom  (DOFs)  prosthetic  hand  is  precisely  the  main  goal  of  this  work. 

In  this  paper,  we  first  consider  briefly  kinematics  and  trajectory  planning.  The  trajectory 
planning  using  cubic  polynomial  employs  desired  angular  positions  to  avoid  inverse  kinematics 
problems.  Then  the  dynamic  models  of  the  smart  prosthetic  hand  and  feedback  linearization 
technique  are  briefly  introduced.  Finally,  the  new  finite-time  linear  quadratic  optimal  controllers 
are  investigated  using  exponential  term  in  the  cost  function.  Simulation  results  demonstrate  the 
proposed  technique  giving  fast  response  and  high  accuracy  without  increasing  computational 
time  for  the  five-fingered  smart  prosthetic  hand. 

II.  Modeling 

A  normal  human  hand  has  23  DOFs,  including  4  DOFs  from  four  fingers  (2  at  metacarpal- 
phalangeal  [MCP]  joint,  1  at  proximal  phalangeal  [PIP]  joint  and  1  at  distal  interphalangeal 
[DIP]  joint),  3  DOFs  from  thumb  (2  at  MCP  joint  and  1  at  interphalangeal  [IP]  joint),  2  DOFs 
from  wrist  and  2  DOFs  from  carpometacarpal  (CMC)  joint  [27].  In  this  work,  we  model  a  14 
DOFs,  five-fingered  prosthetic  hand  with  two-link  thumb  and  the  remaining  three-link  fingers. 


q[,  ql  and  (j  =  i,  m,  r  and  1)  represent  the  angular  positions  (or  joint  angles)  of  the  first 
joint  MCP^ ,  second  joint  PIP^  and  third  joint  DIP^  of  index,  middle,  ring  and  little  fingers, 
respectively;  q\  and  ql  are  the  angular  positions  of  the  first  joint  MCP*  and  the  second  joint  IP* 
of  thumb  (t),  respectively.  In  this  section,  we  briefly  describe  kinematics  and  trajectory  planning 
problems  and  dynamics  of  the  hand. 

A.  Kinematics  and  Trajectory  Planning 

Kinematics  is  the  study  of  geometry  in  motion  and  it  is  restricted  to  a  natural  geometrical 
description  of  motion  by  the  manners,  including  positions,  orientations,  and  their  derivatives 
(velocities  and  accelerations).  The  kinematic  descriptions  of  prosthetic  hands  are  used  to  derive 
the  fundamental  equations  for  dynamics  and  control  purposes.  Forward  and  inverse  kinematics  of 
articulated  systems  study  the  analytical  relationship  between  the  angular  positions  of  joints  and 
the  positions  and  orientations  of  fingertips.  The  forward  and  inverse  kinematics  for  the  two-link 
thumb  and  the  remaining  three-link  fingers  were  derived  in  our  previous  work  [24].  Also  our 
previous  works  [19,  23]  showed  that  the  adaptive  neuro-fuzzy  inference  system  (ANFIS)  and  GA 
based  trajectory  planning  take  more  computational  time  to  solve  inverse  kinematics,  especially 
for  high  DOFs  problems.  To  overcome  this  problem,  the  present  work  obtains  the  desired  angular 
position  of  each  joint  using  cubic  polynomial  after  the  initial  and  targeted  angular  positions  are 
determined. 

The  trajectory  planning  using  cubic  polynomial  for  angular  position  control  is  derived  for  all 
fingers.  A  time  history  of  desired  (d)  angular  position  (g^j.),  angular  velocity  (g^^.)  and  angular 
acceleration  (g^^.)  for  the  joint  i  of  each  finger  j  is  given  as 


—  ^ok  +  Aikt  +  A2kt^  +  A^kt^  •) 

(1) 

—  Aik  +  ‘^A2kt  +  SA^kt^  ^ 

(2) 

^dki^) 

=  ‘^A2k  +  QA^ktj 

(3) 

where  Aok-A^k  are  the  undetermined  constants  of  each  joint  k  and  the  superscript  j  indicates 
the  index  of  each  finger  (j  =  t,  i,  m,  r  and  /).  The  relations  (1)  and  (2)  for  each  joint  need  to 
satisfy  the  constraint  conditions,  qd{to),  qd{tf),  qd{to)  and  qd{tf),  at  initial  time  to  and  terminal 
time  tf.  This  can  be  written  as 


T  A  =  z. 


(4) 


Here,  T,  A  and  z  are 
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Therefore,  the  4  unknown  constants,  A0-A3,  can  be  computed  by  A  =  T“^z  provided 
exists.  The  notation  '  means  the  transpose. 

For  the  five-fingered  hand  shown  in  Figure  2,  X^,  Y^,  and  are  the  three  axes  of  global 


Fig.  2.  Relationship  between  global  coordinate  and  local  coordinates. 


coordinate  system.  The  local  coordinate  x*-y*-z*  of  thumb  can  be  reached  by  rotating  through 
angles  a  and  (3  to  and  of  the  global  coordinate,  subsequently.  The  local  coordinate 

x^-y^-z^  of  index  finger  can  be  obtained  by  rotating  through  angle  a  to  X^  and  then  translating 
the  vector  d*  of  the  global  coordinate;  similarly,  the  local  coordinate  x^yY^i  of  middle  finger 
{j  =  m),  ring  finger  (j  =  r),  and  little  finger  (j  =  1)  can  be  obtained  by  rotating  through  angle 
a  to  X^  and  then  translating  the  vector  (j  =  m,r  and  1)  of  the  global  coordinate. 


B.  Dynamics  of  the  Hand 


The  dynamic  equations  of  hand  motion  are  derived  via  Lagrangian  approach  using  kinetic 
energy  and  potential  energy  as  [28] 


d  (dC{t)\  dC{t)_ 

dt  V5q(t) )  aq(t)  ^ 


(8) 


where  C{t)  is  Lagrangian;  q(f)  and  q(f)  represent  the  angular  velocity  and  position  vectors 
of  joints,  respectively;  T{t)  is  the  given  torque  vector  at  joints.  The  Lagrangian  C{t)  can  be 
expressed  as 


C{t)  =  T{t)-V{t),  (9) 

where  T{t)  and  V{t)  denote  kinetic  and  potential  energies  at  time  t,  respectively.  Substituting 
(9)  into  (8),  dynamic  equations  of  thumb  and  all  fingers  can  be  obtained  as  below. 


M(q(f))q(f)  +  C(q(f),  q(f))  +  G(q(f))  =  rf),  (10) 


where  M(q(f))  is  the  inertia  matrix;  C(q(f),  q(f))  is  the  Coriolis/centripetal  vector  and  G(q(f)) 
is  the  gravity  vector.  Then,  (10)  can  be  also  written  as 


M(q(f))q(f) +N(q(f),q(f))  =  T{t),  (11) 

where  N(q(f),q(f))  =  G(q(f),q(f))  +  G(q(f))  represents  nonlinear  terms.  The  dynamic  rela¬ 
tions  for  the  two-link  thumb  and  all  three-link  fingers  are  detailed  in  our  previous  work  [24]. 


III.  Control  Strategies 

A.  Feedback  Linearization 

The  nonlinear  dynamics  (11)  is  to  be  put  into  a  linear  state- variable  system  using  feedback 
linearization  technique.  Alternative  state-space  equations  of  the  dynamics  can  be  obtained  by 
defining  the  angular  position/velocity  state  x(f)  of  the  joints  as 

x(f)  =  [q'(f)  q'(f)r.  (12) 


q'(f)  and  if  if)  are  the  transpose  vectors  of  q(f)  and  q(f),  respectively.  Let  us  repeat  the  dynamical 
model  and  rewrite  (11)  as 


d 

dt 


q(^)  =  - 


M-^(q(f))[N(q(f),q(f))-T(f)]. 


(13) 


Thus,  from  (12)  and  (13),  we  can  derive  a  linear  system  in  Brunov  sky  canonical  form  as 

0  1  0 

x(f)  =  x(f)  +  u(f) 


0  I 

x(f)  + 

0 

0  0 

I 

x(f)  =  x(f)  +  u{t) 

0  0  I 

=  Ax(f)+Bu(f). 
with  its  control  input  vector  given  by 

u(f)  =  -M-Hq(f))[N(q(f),q(f))-T(f)]. 
Then  the  required  torque  of  all  joints  can  be  calculated  by 

T{t)  =  M(q(f))u(f)  +  N(q(f),  q(f)). 


B.  Linear  Quadratic  Optimal  Control  with  Tracking  System 

Our  objective  is  to  control  the  linear  system  (14)  in  such  a  way  that  the  state  variable  x(f)  = 
[q'(f)  q'(f)]^  tracks  the  desired  output  z(f)  =  [q[;(f)  qrf(f)]^  as  close  as  possible  during  the 
interval  [fo,  f/]  with  minimum  control  energy.  For  this,  let  us  define  the  error  vector  as 

e(f)  =  z(f)  -  x(f),  (17) 

and  choose  the  performance  index  J  [18]  as 

J  =  ie'(i^)F(ty)e(ty) 

+-  f  [e'(#)Qe(#)  +  u'(#)Ru(i)]  d#.  (18) 

2  Jto 

We  assume  that  F(f/)  and  Q  are  symmetric,  positive  semidefinite  matrices,  and  R  is  symmetric, 
positive  definite  matrix.  We  use  Pontryagin  Minimum  Principle  [18]  and  then  solve  the  matrix 
differential  Riccati  equation  (DRE) 

p{t)  =  -P(f)A  -  A'P(f)  +  P(f)BR-^B'P(f)  -  Q,  (19) 

with  final  condition  P(f/)  =  F(f/),  and  the  non-homogeneous  vector  differential  equation 

g(f)  =  -  [A  -  BR-iB'P(f)]'g(f)  -  Qz(f),  (20) 

with  final  condition  g(f/)  =  F(f/)z(f/).  Then  the  optimal  state  x*(f)  can  be  solved  from 
±*{t)  =  [A  -  BR-^B'P(f)]  x.*{t)  +  BR-^B'g(f) 


(21) 


with  initial  condition  x(to)  and  optimal  control  u*(t)  is  calculated  by 


u*{t)  =  -R-^B'P(t)x*(t)  +  R-^B'g(t).  (22) 

Finally,  the  optimal  required  torque  T*{t)  is  obtained  by 

T*{t)  =  M(q(t))u*(t)  +  N(q(t),  q(t)).  (23) 

Summarizing,  Figure  3  shows  the  block  diagram  of  a  finite-time  linear  quadratic  optimal  con- 


Fig.  3.  Block  diagram  of  the  linear  quadratic  optimal  controller  tracking  system  for  the  five-fingered  prosthetic  hand. 


troller  tracking  system  for  the  prosthetic  hand.  Use  of  feedback  linearization  technique  converts 
the  nonlinear  dynamics  to  be  linear.  Then  the  closed-loop  finite-time  linear  quadratic  optimal 
controller  through  Pontryagin  Minimum  Principle  is  implemented  to  track  the  desired  trajectory 
planning  using  cubic  polynomial.  P(f)  and  g(f)  are  computed  by  solving  the  matrix  differen¬ 
tial  Riccati  and  the  non-homogeneous  vector  differential  equations  with  boundary  conditions, 
respectively.  Finally,  the  optimal  state  x*(f)  and  optimal  control  u*{t)  are  obtained  in  order  to 
calculate  the  required  torque  T*{t). 


C.  A  New  Optimal  Control  with  Tracking  System 

Our  previous  work  [19]  shows  that  the  original  optimal  control  can  avoid  overshooting  and 
oscillation  problems  and  get  better  results  than  PID  control,  but  this  optimal  control  method 
takes  execution  time  when  applied  to  prosthetic  hand.  To  improve  the  performance  of  the  original 
optimal  controller,  we  propose  to  change  the  performance  index  J  [18]  to  include  exponential 
term  as 

f  [e'(i)Qe(i)  +  u'(i)Ru(f)]  di  (24) 

^  Jto 

where  tr  is  a  positive  parameter.  We  need  to  find  the  optimal  control  which  minimizes  the  new 
performance  index  J  (24)  under  the  dynamical  constraint  (14).  This  problem  can  be  solved  by 
modifying  the  original  system,  so  the  following  transformations  can  be  developed  as 

e{t)  =  e“*e(f);  z{t)  =  e“*z(f); 

x(f)  =  e“*x(f);  u{t)  =  e“*u(f).  (25) 

Then,  using  the  transformations  (24),  it  is  easy  to  see  that  the  new  system  becomes 

i(t)  =  ^{e“*x(f)}  =  «e“*x(f)  +  e“*x(f) 

=  a'k{t)  +  e"*[Ax(f)  +  Bu(f)] 
x(f)  =  (A  +  QT)x(f)  +  Bu(f).  (26) 

Considering  the  minimization  of  the  modified  system  defined  by  (26)  and  (24),  the  new  optimal 
control  u*{t),  which  is  similar  to  (22),  is  given  by 

u*{t)  =  -R-^B'P(f)x*(f)  +  R-^B'g(f)  (27) 

where  the  matrix  P(f)  and  the  vector  g(f)  are,  respectively,  the  solutions  of  DRE 

P(t)  =  -P(f)(A  +  «I)  -  (A'  +  «I)P(f) 

+P(f)BR-^B'P(f)  -  Q,  (28) 

with  final  condition  P(f/)  =  F(f/),  and  the  non-homogeneous  vector  differential  equation 
t{t)  =  -  [a  +  «I  -  BR-iB'P(f)] '  g{t)  -  Qz{t), 


(29) 


with  final  condition  g(t/)  =  F(tf)z(tf).  Using  the  optimal  control  (27)  in  the  new  system  (26), 
we  get  the  optimal  closed-loop  system  as 

k*{t)  =  [a  +  «I  -  BR-^B'P(t)j  x*(t)  +  BR-^B'g(t)  (30) 

with  initial  condition  x(to)- 

Hence,  applying  the  transformations  (26)  in  the  new  system  (27),  the  optimal  control  of  the 
original  system  (14)  and  the  associated  performance  measure  (24)  is  given  by 

u*{t)  =  e-“*u*(f)  =  -e-“*R-^B'  [P(f)x*(f)  -  g(f) 

=  -R-^B'P(f)x*(f) +  e-“*R-^B'g(f).  (31) 

Interestingly,  this  desired  (original)  optimal  control  (31)  has  the  same  matrix  DRE  solutions 
P(f)  =  P(f)  as  the  optimal  control  (27)  of  the  new  system  with  g(f)  =  e“*g(f)  compared  with 
(31)  and  (22).  We  see  that  the  closed-loop  optimal  control  system  (30)  has  eigenvalues  with  real 
parts  less  than  —a.  In  other  words,  the  state  x*(f)  approaches  zero  at  least  as  fast  as 


IV.  Simulation  Results  and  Discussion 


We  present  simulations  with  a  PID  controller  and  a  new  linear  quadratic  finite-time  optimal 
controller  with  tracking  system  for  the  14  DOFs,  five-fingered  smart  prosthetic  hand  in  order  to 
grasp  a  rectangular  object  as  shown  in  Figure  4. 

When  thumb  and  the  other  four  fingers  are  doing  extension/flexion  movements,  the  workspace 
of  fingertips  is  restricted  to  the  maximum  angles  of  joints.  In  this  work,  the  first  and  second 
joint  angles  of  the  thumb  are  constrained  in  the  ranges  of  [0,  90]  and  [-80,  0]  (degrees)  and 
the  first,  second,  and  third  joint  angles  of  the  other  four  fingers  are  constrained  in  the  ranges  of 
[0,  90],  [0,  110]  and  [0,  80]  (degrees),  respectively  [29].  All  parameters  of  the  smart  prosthetic 
hand  selected  for  the  simulations  [30]  are  given  in  Table  I  and  the  side  length  and  length  of 
the  targeted  rectangular  rod  are  0.010  and  0.100  (m),  respectively.  The  conversion  parameters 
between  the  global  coordinate  and  each  local  coordinate  are  defined  in  Table  II.  The  links  of  all 
fingers  are  assumed  as  circular  cylinders  with  the  radius  (R)  0.010  (m)  and  the  inertia  of 
each  link  k  of  all  fingers  j  (=  t,  i,  m,  r  and  1)  can  be  calculated  by 


(32) 


Fig.  4.  A  14  degrees -of-freedom  (DOFs),  five-fingered  prosthetic  hand  with  two-link  thumb  and  remaining  three-link  fingers 
grasping  a  rectangular  object. 


All  initial  actual  angles  are  zero  and  the  diagonal  coefficients,  Kp,  Ki  and  Kd,  for  the  PID 
controller  are  arbitrarily  chosen  as  100.  As  for  the  coefficients  of  optimal  control,  A,  B,  F(f/), 
R  and  Q  of  all  fingers  (j  =  i,  m,  r,  and  1)  are  chosen  as 


A  = 


0  I 
0  0 


F(i/)  =  0,  R=^I. 
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To  study  the  performance  of  the  PID  and  new  optimal  controllers.  Figure  5  and  Figure  6 


(a)  (b) 


Fig.  5.  Desired/actual  angular  positions  of  two-link  thumb.  The  actual  angles  (a)  ql  and  (b)  ql  regulated  by  PID  controller  and 
new  optimal  controller  with  the  different  parameters  a  (a  =  0,  1,  and  3)  are  designed  to  track  the  desired  angles  and  qli2. 


show  desired/actual  angles  and  tracking  errors  of  joints  1  and  2  for  two-link  thumb,  respectively. 
PID  control  shows  overshooting  and  oscillation  problems.  These  problems  are  overcome  by 
original  optimal  control  (a  =  0),  but  it  takes  at  least  8  seconds  for  both  joints.  The  performance 
is  improved  by  the  new  optimal  controller  as  the  parameter  a  increases.  In  other  words,  the 
convergent  time  is  reduced  to  approximate  1  second  as  a  equals  3.  Similar  results  are  also 
demonstrated  by  three-link  index  finger  as  shown  in  Figure  7  and  Figure  8.  Similar  simulations 
are  also  made  for  middle,  ring  and  little  fingers. 

To  investigate  the  effectiveness  of  the  PID  and  new  optimal  controllers.  Figure  9  shows 
that  original  (a  =  0)  and  new  optimal  controllers  (a  =  0.1,  1,  and  10)  are  significantly  more 
effective  (in  term  of  computational  time)  than  PID  controller,  but  there  is  no  significance  between 
the  optimal  controllers  for  all  three-link  fingers,  suggesting  that  the  new  optimal  control  with 
high  a  value  improves  performance  without  excessive  execution  time.  To  further  study  high 
DOFs  inverse  kinematics  problems,  this  work  develops  desired  angles  using  cubic  polynomial  to 
avoid  calculating  inverse  kinematics  at  every  instant  of  time  for  all  three-link  fingers.  Figure  9 
also  shows  this  modified  trajectory  planning  strategy  significantly  reduces  computational  time 


100 


o 

pq 

bX) 

a 


60 


40 


20 


-20 


-40 


1* 

- PID 

II  7 

H  ' 

. Optimal  (a  =  0) 

jl 

Optimal  (a  =  1) 

I*  . 

Il  \ 

Optimal  (a  =  3) 

1*1 

I’l 

’»» 

il 

. 

Vl 

\  \ 

- 

I 

✓ 

\ 

/' 

\ 

/ 

\ 

/ 

\ 

,/ 

4  6 

Time  (sec) 


10 


(a) 


bX) 

'a 


O 

pq 

bX) 


20 

10 

0 

-10 

-20 

-30 

-40 

-50 

-60 


‘X. 

/ 

\ 

/ 

\ 

/ 

*% 

# 

f 

\ 

f 

\  

il 

#i 

II 

»/ 

/ 

i  • 

1*  1 

1 1  / 

1 1 

- PID 

II 

il  / 

. Optimal  (a  =  0) 

•i  3 

'  - '  - '  Optimal  (a  =  1) 

II  3 

Optimal  (a  =  3) 

“/ 

: 

2  4  6 

Time  (sec) 


10 


(b) 


Fig.  6.  Tracking  errors  of  two-link  thumb.  The  tracking  errors  (a)  e\  and  (b)  e|  show  that  PID  controller  with  arbitrary 
parameters  has  overshooting  and  oscillation  problems,  which  are  overcome  by  proposed  new  optimal  controller  with  a  =  0,  1, 
and  3. 


compared  with  ANFIS-based  trajectory  planning  [19,  23]  for  both  PID  and  optimal  controllers. 
The  data  was  simulated  by  a  laptop  with  Intel®  Corel  Duo  CPU  at  1.67  GHz. 

V.  Conclusions  and  Future  Work 

A  new  optimal  control  strategy  for  a  14  DOFs,  five-fingered  smart  prosthetic  hand  was 
successfully  developed  to  improve  performance,  convergence  and  computational  time.  A  modified 
trajectory  planning  strategy  using  cubic  polynomial  to  track  each  angular  position  was  designed 
to  avoid  computing  inverse  kinematics  at  every  instant  of  time.  This  new  optimal  control  strategy 
will  be  tested  and  validated  with  real  data  from  surface  EMG  (sEMG)  signals  for  operation  of 
prosthetic  hand  devices. 
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Qdi^  Qd2  and  ^^3,  respectively. 
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TABLE  I 

Parameter  Selection  oe  the  Smart  Prosthetic  Hand 


Parameters 

Values 

Thumb 

Time  Interval  [to,  t/]* 

[0,  10]  (sec) 

Desired  Initial  Angle  ^^2]** 

[89.48,  -59.48]  (deg) 

Desired  Final  Angle 

[63.99,  -27.04]  (deg) 

Desired  Initial  Angular  Velocity  [^^1,  ^^2]* 

[0,  0]  (deg/s) 

Desired  Final  Angular  Velocity  [Qdi^  Qd2T 

[0,  0]  (deg/s) 

Length  [L\,  Ll] 

[0.040,  0.040]  (m) 

Mass  [mi,  m^] 

[0.043,  0.031]  (kg) 

Index  Finger 

tel,  9^2,  9^3]  at  t  =  to** 

[26.09,  30.15,  21.10]  (deg) 

tel,  qh,  q^s]  at  t  =  tf** 

[9.28,  84.32,  59.03]  (deg) 

tel,  *2,  *3]  at  t  =  to* 

[0,  0,  0]  (deg/s) 

tel,  *2,  *3]  att  =  t/ 

[0,  0,  0]  (deg/s) 

[Ll  Ll  Ll] 

[0.040,  0.040,  0.030]  (m) 

[ml,  m2,  m3] 

[0.045,  0.025,  0.017]  (kg) 

Middle  Finger 

[qfu  qd2,  qTs]  at  t  =  to** 

[26.09,  30.15,  21.10]  (deg) 

IqTi,  9^2,  qTs]  at  t  =  tf** 

[13.34,  84.85,  59.39]  (deg) 

[Lf,  Ll,  Ll] 

[0.044,  0.044,  0.033]  (m) 

[mr,  m^,  mT] 

[0.050,  0.028,  0.017]  (kg) 

Ring  Finger 

tel,  9S2,  9S3]  at  t  =  to** 

[26.09,  30.15,  21.10]  (deg) 

tel,  952,  953]  at  t  =  tf** 

[9.28,  84.32,  59.03]  (deg) 

[Ll  Ll  Ll] 

[0.040,  0.040,  0.030]  (m) 

[ml,  m2,  m3] 

[0.041,  0.023,  0.014]  (kg) 

Little  Finger 

tel,  9d2,  9d3]  at  t  =  to** 

[20.63,  42.11,  29.48]  (deg) 

tel,  9d2,  9d3]  at  t  =  tf** 

[2.01,  82.54,  57.78]  (deg) 

[Ll  Ll  Ll] 

[0.036,  0.036,  0.027]  (m) 

[m[,  ml  ml] 

[0.041,  0.023,  0.014]  (kg) 

*Same  parameters  for  all  fingers 
**Used  in  local  coordinates 


TABLE  II 

Parameter  Selection  oe  Conversion  between  Global  and  Local  Coordinates 


Parameters 

Values 

Rotating  ol 

90  (deg) 

Rotating  /3 

45  (deg) 

Translating 

[0.035,  0,  0]  (m) 

Translating  d"" 

[0.040,  0,  -0.020]  (m) 

Translating  d’’ 

[0.035,  0,  -0.040]  (m) 

Translating  d^ 

[0.025,  0,  -0.060]  (m) 

Attachment  2A-7 
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Abstract:  A  hybrid  of  soft  control  technique  of  adaptive  neuro-fuzzy  inference  system  (ANEIS)  and  genetic  algo¬ 
rithm  (GA)  and  hard  control  technique  of  proportional-integral-derivative  (PID)  for  a  five-fingered,  smart  prosthetic 
hand  is  presented.  The  ANEIS  is  used  for  inverse  kinematics  and  GA  is  used  for  tuning  the  PID  parameters  with 
the  objective  of  minimizing  the  error  squared  between  desired  and  actual  angles  of  the  links  of  the  fingers  of  the 
prosthetic  hand.  Simulation  results  for  all  the  five  fingers  with  GA-tuned  PID  controller  exhibit  superior  perfor¬ 
mance  compared  to  the  PID  control  without  GA. 


Key-Words:  Prosthetic  Hand,  PID  Control,  Genetic  Algorithm,  Adaptive  Neuro-Euzzy  Inference  System,  Hybrid 
Control 


1  Introduction 

Hard  control  (HC)  methodologies  are  used  at  lower 
levels  for  accuracy,  precision,  stability  and  robust¬ 
ness.  HC  comprises  proportional-derivative  (PD)  con¬ 
trol  [1],  proportional-integral-derivative  (PID)  control 
[2,  3],  optimal  control  [3-6],  adaptive  control  [7-9] 
etc.  with  specific  applications  to  prosthetic  devices. 
However,  our  previous  works  [1-3,  10]  for  a  smart 
prosthetic  hand  showed  that  PID  controller  resulted  in 
overshooting  and  oscillation  because  the  system  dy¬ 
namics  are  sensitive  to  the  rigidity  of  the  target  ob¬ 
ject  and  the  used  gain  parameters  of  PD  or  PID  con¬ 
troller  [11]. 

Soft  computing  (SC)  or  computational  intelli¬ 
gence  (Cl)  is  an  emerging  field  based  on  synergy  and 
seamless  integration  of  neural  networks  (NN),  fuzzy 
logic  (PL)  and  optimization  methods,  such  as  genetic 
algorithms  (GA),  particle  swarm  (PS)  [1, 12, 13],  tabu 
search  (TS)  [13]  and  so  on.  The  methodology  based 
on  SC  can  be  used  at  upper  levels  of  the  overall  mis¬ 
sion  whereas  the  HC  can  be  used  at  lower  levels  for 
accuracy,  precision,  stability  and  robustness.  Hence, 
we  propose  the  GA-based  PID  controller  to  solve 
problems  that  cannot  be  solved  satisfactorily  by  us¬ 
ing  either  HC  or  SC  methodology  alone  with  specific 
applications  to  prosthetics. 

In  this  paper,  we  first  consider  briefly  trajec¬ 
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tory  planning  and  kinematics  problems.  Then,  adap¬ 
tive  neuro-fuzzy  inference  system  (ANEIS)  is  used  to 
solve  inverse  kinematics  problem  for  three-link  fin¬ 
gers  (index,  middle,  ring,  and  little).  Next,  the  dy¬ 
namics  of  the  hand  is  derived  and  feedback  lineariza¬ 
tion  technique  is  used  to  obtain  linear  tracking  error 
dynamics.  Then  we  propose  the  GA-based  PID  con¬ 
trol,  which  uses  GA  to  tune  all  PID  parameters  by 
minimizing  the  tracking  errors,  for  the  five-fingered 
prosthetic  hand.  The  resulting  overall  hybrid  system 
incorporating  both  soft  and  hard  control  techniques  is 
simulated  with  practical  data  for  the  hand  and  found 
to  be  superior  to  that  using  PID  alone.  We  finally  pro¬ 
vide  conclusions  and  future  work. 


2  Modeling 

2.1  Trajectory  Planning  and  Kinematics 

The  trajectory  planning  using  cubic  polynomial  was 
discussed  in  our  previous  work  [1,  2,  5,  8,  9,  14]  for 
a  two-fingered  (thumb  and  index  finger)  smart  pros¬ 
thetic  hand.  The  inverse  and  differential  kinematics 
of  two-link  thumb  and  three-link  fingers  were  dis¬ 
cussed  in  our  previous  publications  [1,2,5, 8,9, 14]  for 
a  two-fingered  (thumb  and  index  finger)  smart  pros¬ 
thetic  hand. 
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For  five  fingers  shown  in  Figure  1,  and 


Figure  1 :  The  Relationship  between  Global  Coordi¬ 
nate  and  Local  Coordinates 

are  the  three  axes  of  the  global  coordinate.  The 
local  coordinate  x^-y^-z^  of  thumb  can  be  reached  by 
rotating  through  angles  a  and  f3  to  and  of  the 
global  coordinate,  subsequently.  The  local  coordinate 
x^-y'^-z^  of  index  finger  can  be  obtained  by  rotating 
through  angle  a  io  and  then  translating  the  vector 
of  the  global  coordinate;  similarly,  the  local  coor¬ 
dinate  x^-y^-z^  of  middle  finger  (j  =  m),  ring  finger 
(j  =  r),  and  little  finger  ( j  =  1)  can  be  obtained  by  ro¬ 
tating  through  angle  a  io  X^  and  then  translating  the 
vector  dj  (j  —  m,r  and  1)  of  the  global  coordinate. 


2.2  Adaptive  Neuro-Fuzzy  Inference  System 
(ANFIS) 


The  inverse  kinematics  problems  can  be  solved  by  us¬ 
ing  adaptive  neuro-fuzzy  inference  system  (ANFIS) 
method  [15]  where  the  input  of  fuzzy-neuro  system  is 
the  Cartesian  space  and  the  output  is  the  joint  space. 
ANFIS  tunes  the  membership  function  and  identifies 
the  coefficients  by  the  backpropagation  gradient  de¬ 
scent  and  least-squares  methods,  respectively.  Fig¬ 
ure  2  (a)  shows  a  two  input  first-order  Sugeno  fuzzy 
model  with  two  rules  and  Figure  2  (b)  depicts  the 
equivalent  ANFIS  structure  for  all  the  computation 
below.  Sugeno-type  fuzzy  system  has  the  following 
Rule  Base  [15]. 

If  xis  Ai  andy  is  Bi,  then  fi  =pix  +  qiy  +  ri. 

If  X  is  A2  and  y  is  B2,  then  /2  =  P2X  +  q2y  +  r2. 

Here,  x  and  y  are  inputs  to  constitute  the  premise  pa¬ 
rameters  Ai,  A2,  Bi,  and  B2  (Layer  1  in  Figure  2 
(b)).  Pi,  qi,  and  (i  =  1,2)  are  the  consequent  param¬ 
eters.  We  evaluate  the  rules  by  choosing  product  H 
for  T-Norm  (Layers  2  and  3)  which  results  in 


Wi  =  HAiix)  fiBiiy),  i  =  1,2. 


f=p,x  +  q{y  +  r, 

W^+Wj 

=  wj,+  wjl 

t 

f2=p^  +  q^  +  r^ 


(a)  A  Two  Input  First-Order  Sugeno  Fuzzy  Model  with  Two  Rules 

Layer  1  Layer  2  Layer  3  Layer  4  Layer  5 


Figure  2:  ANFIS  Architecture:  (a)  A  Two  Input 
First-Order  Sugeno  Fuzzy  Model  with  Two  Rules  (b) 
Equivalent  ANFIS  Structure  [15] 


Here,  yAi^x)  and  yBiiy)  are  designed  fuzzy  mem¬ 
bership  functions.  Now  after  leaving  the  arguments 
(Layer  4),  we  get  the  output  f{x^y)  by  Rule  Conse¬ 
quences. 


wi{x,y)fi{x,y)  +  W2{x,y)f2{x,y) 


/(Layer  5)  can  be  written  as 


/  = 


Wlh  +  W2f2 

Wi  +  W2 


=  Wlh  +  W2h, 


(3) 


where 


Wl 


Wl 

- ; - ,  W2 

Wl  +  W2 


W2 

WI  +  W2' 


(4) 


2.3  Dynamics  of  the  Prosthetic  Hand 

The  dynamic  equations  of  hand  motion  are  derived  via 
Lagrangian  approach  using  kinetic  energy  and  poten¬ 
tial  energy  as  [7, 14, 16]  and  can  be  written  as  below. 

M(q)q  +  N(q,q)  =  T,  (5) 

where  M(q)  is  the  inertia  matrix  and  N(q,  q)  = 
C(q,  q)  +  G(q)  represents  nonlinear  terms,  including 
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Coriolis/centripetal  vector  C(q,  q)  and  gravity  vector 
G(q).  The  dynamic  relations  for  the  two-link  thumb 
and  the  remaining  three-link  fingers  are  quite  lengthy 
and  omitted  here  due  to  lack  of  space  [14]. 

3  Control  Techniques 

3.1  Feedback  Linearization 

The  nonlinear  dynamics  represented  by  (5)  is  to  be 
converted  into  a  linear  state-variable  system  using 
feedback  linearization  technique  [7].  Let  us  suppose 
the  prosthetic  hand  is  required  to  track  the  desired 
trajectory  c[d{t)  described  under  path  generation  or 
tracking.  Then,  the  tracking  error  e(f)  is  defined  as 

e{t)  ^  Cld{t)  -  (6) 

Here,  q,d{t)  is  the  desired  angle  vector  of  joints  and 
can  be  obtained  by  trajectory  planning  [1,2, 5, 8, 14]; 
q(f)  is  the  actual  angle  vector  of  joints.  Differentiat¬ 
ing  (6)  twice,  to  get 

e(t)  =  qd(t)  -  q(t),  e(f)  =  qd(f)  -  q(f).  (7) 

Substituting  (5)  into  (7)  yields 
e(t)  =  qd(i)  +M“^(q(t))  [N(q(t),  q(t))  -  T{t)]  (8) 

from  which  the  control  function  can  be  defined  as 
u(t)  =  qd(t)  +M“^(q(t))  [N(q(t),q(t))  -T{t)] .  (9) 


Figure  3:  Block  Diagram  of  the  Hybrid  GA-Based 
PID  Controller  for  14-DOF  Five-Fingered  Prosthetic 
Hand 

Then  we  use  GA  to  tune  all  gain  coefficients  Kp, 
Kd  and  Kd  of  PID  controller.  Figure  4  shows  the 
flowchart  of  GA  and  the  procedure  is  briefly  stated 
below. 


This  is  often  called  the  feedback  linearization  control 
law,  which  can  also  be  inverted  to  express  it  as 

T{t)  =  M(q(f))  [qd(f)  -  u(f))  +  N(q(f),q(f)]  .(10) 


Using  the  relations  (7)  and  (9),  and  defining  state  vec¬ 
tor  x(f)  =  e'(f)]',  the  tracking  error  dynamics 

in  the  form  of  a  linear  system  can  be  written  as 


x(f)  = 


0  I 
0  0 


x(f)  + 


0 

I 


u{t). 


(11) 


3.2  GA-Based  PID  Hybrid  Control 

Figure  3  shows  the  block  diagram  of  a  hybrid  GA- 
based  PID  controller  for  the  presented  five-fingered 
prosthetic  hand  with  control  signal  as 

u(f)  =  — Kpe(f)  —  Ki  y*  e{t)dt  —  KDe(f)  (12) 

with  the  proportional  Kp,  integral  Ki,  and  derivative 
Kd  diagonal  gain  matrices.  We  then  rewrite  (10)  as 

T{t)  =  M{q,{t))[iid{t)+^pe{t)+KiJe{t)dt 
+KDe(f)) +  N(q(f),q(f)].  (13) 


1.  Define  the  GA  parameters:  include  initial  pop¬ 
ulation,  population  at  the  end  of  the  first  gener¬ 
ation,  number  of  chromosomes  kept  for  mating, 
mutation  rate,  and  tolerance  e  so  on. 

2.  Create  a  homogeneous  population:  generate  N 
elements  (chromosomes)  and  N  is  the  initial 
population. 

3.  Evaluate  cost  (fitness)  function  of  each  chromo¬ 
some:  calculate  the  fitness  value  of  the  iih  mem¬ 
ber  in  the  population. 

4.  Select  mate  based  on  the  performance  of  each 
gene:  create  a  new  population  from  the  current 
population  based  on  the  ranking  of  the  current 
fitness  value,  e.g.  determine  which  parents  par¬ 
ticipate  in  producing  offspring  for  the  next  gen¬ 
eration. 

5.  Reproduce  the  generation  by  crossover:  use  the 
single  or  multiple  crossover  points  to  generate 
new  chromosomes  that  retain  the  good  feature 
and  discard  the  bad  feature. 
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Figure  4:  The  Flowchart  of  Genetic  Algorithm  (GA) 

6.  Mutate:  utilize  the  mutation  rate  which  can  ran¬ 
domly  mutate  the  gene  to  avoid  falling  into  the 
local  minima  area. 

7.  Repeat  steps  3  to  6  until  it  reaches  the  maximum 
number  of  iterations  or  stopping  condition  de¬ 
fined  by  e  is  satisfied. 


4  Simulation  Results  and  Discussion 

We  present  simulations  with  a  PID  controller  and  GA- 
tuned  PID  controller  for  the  14  DOFs  five-fingered 
smart  prosthetic  hand  grasping  a  rectangular  object  as 
shown  in  Figure  5.  All  parameters  of  the  smart  pros¬ 
thetic  hand  selected  for  the  simulations  are  the  same 
as  our  previous  works  [3,9].  All  initial  actual  angles 
are  zero  and  the  diagonal  coefficients,  Kp,  Ki  and 
Kd,  for  the  PID  controller  alone  are  arbitrarily  cho¬ 
sen  as  100.  From  the  derived  dynamic  and  control 
models,  after  the  parameters  (Kp,  Ki  and  Kd)  are 
determined,  the  torque  matrix  r  can  be  computed,  and 
then  the  squared-tracking  errors  (t)  of  the  joint  i  of 
the  finger  j  are  obtained.  Therefore,  the  total  error 
E{t),  which  is  a  time-dependent  function,  can  be  de¬ 
scribed  as 

E{t)^  (14) 

Jto 


Figure  5:  A  Five-Finger  Prosthetic  Hand  Grasping  a 
Rectangular  Object 

where  to  and  t f  are  initial  and  terminal  time,  respec¬ 
tively.  The  tuned  diagonal  parameters  (Kp,  Ki  and 
Kd)  and  the  total  error  E{t)  of  PID  controller  by 
GA  are  listed  in  Table  1.  To  study  whether  the  tuned 

Table  1 :  Parameter  Selection  of  GA-Tuned  PID  Con¬ 
troller  and  Computed  Total  Errors 


Input  Output 


Fingers 

Kp 

Ki 

Kd 

m 

Case  I 

[976,956] 

[779,279] 

[170,236] 

0.3107 

Case  II 

[988,999] 

[78,848] 

[  80,109] 

0.1557 

Case  III 

[199,198] 

[127,157] 

[104,102] 

0.8100 

Index 

[794,398,960] 

[960,918,914] 

[15,59,242] 

0.0465 

Middle 

[794,398,960] 

[960,918,914] 

[15,59,242] 

0.1003 

Ring 

[794,398,960] 

[960,918,914] 

[15,59,242] 

0.0465 

Little 

[794,398,960] 

[960,918,914] 

[15,59,242] 

0.0607 

parameter  range  influences  total  tracking  errors,  we 
design  three  different  cases  with  altering  lower  and 
upper  bounds  of  tuned  parameter  ranges  for  two-link 
thumb.  Cases  I,  II,  and  III  for  the  thumb  represent 
that  the  PID  parameters  Kp,  Ki  and  Kd  are  con¬ 
stricted  in  three  different  bounded  ranges  [100,1000], 
[50,1000],  and  [100,200],  respectively.  Figure  6  and 
Figure  7  show  that  tracking  errors  and  desired/actual 
angles  of  joints  1  and  2  of  PID  and  GA-based  PID 
controllers  for  Thumb.  These  simulations  show  that 
the  large  ranges  [100,1000]  (Case  I)  and  [50,1000] 
(Case  II)  provide  better  results  than  the  PID  controller 
parameters  arbitrarily  chosen  as  100.  However,  the 
small  range  [100,200]  (Case  III)  gives  worse  result 
than  the  PID  controller  alone.  These  results  suggest 
that  the  bigger  parameter  range,  the  smaller  the  to¬ 
tal  error.  Cases  I  and  II  explain  that  GA  finds  some 
parameter  values  G  [100,1000]  and  [50,100]  escaping 
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Figure  6:  Tracking  Errors  of  Joint  1  (left)  and  Joint 
2  (right)  of  PID  and  GA-Based  PID  Controllers  for 
Thumb 


Figure  8:  Tracking  Errors  (left)  and  Joint  Angles 
(right)  of  PID  and  GA-Based  PID  Controllers  for  In¬ 
dex  Finger 


Figure  7:  Tracking  Angles  of  Joint  1  (left)  and  Joint 
2  (right)  of  PID  and  GA-Based  PID  Controllers  for 
Thumb 


the  local  minimum  area.  Case  III  covers  the  value  100 
in  lower  bound,  but  both  total  error  and  convergent 
speed  are  even  worse  than  PID  alone,  suggesting  that 
GA  performs  better  for  a  large  range,  but  is  poor  for 
searching  on  the  boundary.  To  further  consider  the 
convergent  speed.  Case  I  gives  smaller  total  error,  but 
does  not  improve  its  convergent  speed  when  compar¬ 
ing  to  PID  control  alone.  Yet,  Case  II  gives  good  total 
error  and  convergent  speed.  Case  III  gives  poor  total 
error  and  convergent  speed.  Taken  together,  these  re¬ 
sults  imply  that  the  global  minimum  could  be  located 
in  the  ranges  [50,100]  and  [200,1000]  and  the  parame¬ 
ter  ranges  play  an  important  role  in  GA  tuning.  Based 
on  these  findings,  we  use  the  range  [50,1000]  for  the 
remaining  three-link  fingers.  Figures  8  to  1 1  show  the 
simulations  of  PID  and  GA-based  PID  controllers  for 
the  remaining  three-link  fingers. 
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Figure  9:  Tracking  Errors  (left)  and  Joint  Angles 
(right)  of  PID  and  GA-Based  PID  Controllers  for 
Middle  Finger 

5  Conclusions  and  Future  Work 

A  hybrid  control  technique  combining  soft  control 
with  adaptive  neuro-fuzzy  inference  system  (ANFIS) 
and  genetic  algorithm  (GA)  and  hard  control  with 
proportional-integral-derivative  (PID)  was  presented 
for  a  five-fingered  smart  prosthetic  hand.  The  AN¬ 
FIS  is  used  for  inverse  kinematics  and  GA  is  used 
for  tuning  the  PID  parameters  with  the  objective  of 
minimizing  the  error  squared  between  desired  and  ac¬ 
tual  angles  of  the  links  of  the  fingers.  Simulation  re¬ 
sults  for  all  the  five  fingers  with  GA-tuned  PID  con¬ 
troller  showed  superior  performance  compared  to  the 
PID  control  alone.  A  real-time  implementation  of 
this  technique  on  a  prototype  of  a  prosthetic  hand  is 
planned  for  future  work. 
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Figure  10:  Tracking  Errors  (left)  and  Joint  Angles 
(right)  of  PID  and  GA-Based  PID  Controllers  for  Ring 
Finger 


Figure  11:  Tracking  Errors  (left)  and  Joint  Angles 
(right)  of  PID  and  GA-Based  PID  Controllers  for  Lit¬ 
tle  Finger 
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Abstract 

A  hybrid  of  soft  control  technique  of  adaptive  neuro-fuzzy 
inference  system  (ANFIS)  and  fuzzy  logic  (FL)  and  hard  control 
technique  of  proportional-derivative  (PD)  for  a  five-fingered, 
smart  prosthetic  hand  is  presented.  The  ANFIS  is  used  for 
inverse  kinematics  and  FL  is  used  for  tuning  the  PD  parameters 
with  two  input  layers  (error  and  error  change)  using  7  triangular 
membership  functions  and  49  fuzzy  logic  rules.  Simulation 
results  with  FL-tuned  PD  controller  exhibit  superior  performance 
compared  to  the  PD  and  PID  control  alone. 


Methods 


Arm 


Biomatcrials  & 
Biocompatibility 


EMG  Signal 
Extraction  & 
Classification 


Sensory  Feedback 


Visual  Feedback 


Object 


Figure  1.  Schematic  Diagram  of  Prosthetic  Hand  Technoiogy:  The  overall  system 
consists  of  electromyographic  (EMG)  signal  acquisition  from  the  user  arm  for  surface  or 
implanted  electrodes  (in  the  implanted  case  we  focus  on  biocompatibility  based  on  nano¬ 
materials  research).  The  EMG  signal  is  then  processed  for  feature  extraction  and 
classification  or  identification  of  EMG  signal  to  correspond  to  different  motions  of  the 
prosthetic  hand.  The  classified  signal  is  then  used  to  control  the  prosthetic  hand  using 
actuators  and  driving  mechanisms. 


Figure  2.  Principle  behind 
Fusion  of  Soft  and  Hard 
Computing:  The  present 
research  focuses  on 
developing  intelligent 
autonomous  strategies  for 
EMG  signal,  extraction, 
analysis  and  control 
prosthetics  by  fusion  of  soft 
computing  (SC)  techniques 
comprising  neural  network 
(NN),  fuzzy  logic  (FL),  and 
genetic  algorithm  (GA)  and 
hard  control  (HC)  techniques, 
such  as  proportional-derivative 
(PD),  optimal  control,  adaptive 
control  and  so  on.  We  present 
the  integration  of  SC  and  HC 
to  solve  problems  that  cannot 
be  solved  satisfactorily  by 
using  either  HC  or  SC 
methodology  alone  with 
specific  applications  to 
prosthetics. 


Figure  3.  Block  Diagram  of  the  Presented  Hybrid  Fuzzy  Logic- 
Based  Proportional-Derivative  (PD)  Controller  for  a  Five-Fingered 
Prosthetic  Hand:  Errors  and  error  changes  are  calculated  by  actual 
and  desired  angles,  which  are  based  on  adaptive  neuro-fuzzy  inference 
system  (ANFIS)  trajectory  planner.  Then  fuzzy  logic  controller  tunes  all 
parameters  of  closed-loop  PD  control  so  that  the  required  torque  of  the 
prosthetic  hand  nonlinear  system  is  computed  by  control  input. 


f 

^y. 

A---- 

1 

j 

n»  Equn  >lcM  ANFIS  Siractucn 

Figure  4.  ANFIS  Architecture:  (a)  A  Two  Input  First-Order  Sugeno 
Fuzzy  Model  with  Two  Rules  (b)  Equivalent  ANFIS  Structure.  The 

inverse  kinematics  problems  are  solved  by  using  adaptive  neuro-fuzzy 
inference  system  (ANFIS)  method  where  the  input  of  fuzzy-neuro 
system  is  the  Cartesian  space  and  the  output  is  the  joint  space.  ANFIS 
is  a  fuzzy  inference  system  implemented  in  the  framework  of  adaptive 
networks  which  provides  the  best  optimization  algorithm  to  find 
parameters  in  order  to  fit  the  data. 


Figure  5.  Relationship  between  Global  and  Local 
Coordinates:  Local  coordinate  x'-/-z'  of  thumb  can  be  reached 
by  rotating  through  angles  a  and  3  to  X®  and  Y°  of  global 
coordinate,  subsequently.  Local  coordinate  x'-y'-z'  of  index  finger 
can  be  obtained  by  rotating  through  angle  a  to  X®  and  then 
translating  a  vector  d'  of  the  global  coordinate. 


<»r) 

Figure  6.  The  Structural  Characteristics  of  Proposed  Fuzzy 
Inference  System:  Two  inputs  (error  and  error  change)  on  the 
left  and  one  output  (tuned  Kp)  on  the  right  with  49  logic  rules 


Figure  7.  Each  of  Two  Inputs  (Upper  Panel)  and  One  Output 
(Lower  Panel)  Uses  7  Triangular  Membership  Functions 


Results 


Table  1 .  Parameter  Selection  of  Conversion 
between  Global  and  Local  Coordinates 


Parameter 

Values 

Rotating  a 

90  (deg) 

Rotating  ii 

45  (deg) 

Translating  d' 

(0.0.35,  0.  0)  (111) 

Translating  d'" 

(0.040.  0.  -0.020)  (m) 

Translating  d' 

(0.0.35.  0.  -0.040)  (ni) 

Translating  d* 

(0.025.  0.  -0.060)  (ni) 

Table  2.  A  Complete  Fuzzy  Logic  Rule  Base 


i\e  NL  NM  NS  ZR  PS  Ri~ 


NL  ZR  ZR  ZR  ZR  V.S 


TJSr“ZR — ZR - ZR - VS— 


VS  S  SM  ML  L  VL  VL 


VL  VL  VT" 


VL  VL  VL  VL 


Table  3.  Parameter  Selection  of  the  Smart 
Hand 


PvuiKteni 

Values 

Uniinb 

Time  doJ/)' 

0.  20  (sec) 

Desired  Initial  D>%itioa  (.Y'.T')** 

0.035.  0.060  tmi 

Disired  Final  Position  (.Vj.iyi" 

0.(M9S.  0.060  (mi 

Desired  Initial  Velocity  (.Yi.»  o'  )* 

0.  0  (nVs) 

Desired  Final  Wlocity  (X}.y/r 

0.  0  (m/s) 

Length  </.',.t^) 

0.(M0.  0.(M0  (ml 

Mass  (mj  .m!^) 

0.043.  0.031  (kg) 

Index  Hngrr 

Desired  Initial  Bnition  (.Y^.Vg')** 

0.065.  0.080  (ml 

Desired  Final  Position  (.Y}.iy')-- 

0.0)0.  0.060  im) 

Length  t/.J.L^.Lj) 

0.040.  0.040. 0.030  (ml 

Mass  (mJ.mL.m^) 

0.045,  0.025. 0.017  (kg) 

SlMdle  Klngrr 

Desired  Initial  PosiUon  t.Y^.ii'") 

•  0.065.  0.080  (ml 

Desired  Final  Position  (.YJf.jy")* 

*  0.005.  0.060  tmi 

Length  ty.JTXr) 

Ma-ss  (mT'.my.m?’) 

0044,  0.044. 0.033  (m) 

0.050. 0.028. 0.017  (kg) 

Ring  Fli^r 

Desired  Initial  R»ition  t.YT.V''’)" 

0.065.  0.080  tm) 

Desired  Final  Position  iXf.Yp" 

0.010.  0.060  (mi 

Length  t/.J.LJ.LJ) 

0.040.  0.040. 0.030  (ml 

Mass  (mf.m!:.m;) 

0.041.  0.023. 0.014  (kg) 

Utile  Finger 

Desired  Initial  IVKilion  (XiyJ)” 
Desired  Final  Position  (Xf.Yp" 

0.055.  0.080  (ml 

0.020.  0.060  (ml 

Unglh(/.'.^.t') 

0.036.0.0.16.0.027  (m) 

Mas$(m',mLm(,) 

0.041.  0.023.0.014  (kg) 

*AII  Hnttn  use  same  panmeicn 

"All  puamelcr!.  arc  in  local  coordinates 


Figure  8.  The  Output  Surface  of  Fuzzy  Inference  System 
with  Two  Inputs  and  49  Logic  Rules 


Figure  10.  Tracking 
Errors  (Left)  and  Desired 
and  Actual  Angles  (Right) 
of  Joints  1  (Upper)  and  2 
(Lower)  for  Two-Link 
Thumb  Using  PD  (Dash 
Line),  PID  (Dot  Line)  and 
Fuzzy  Logic  Based  PD 
(Solid  Line)  Controiiers 


Figure  11.  Tracking  Errors 
(Left)  and  Desired  and 
Actuai  Angies  (Right)  of 
Joints  1  (Top),  2  (Middle) 
and  3  (Bottom)  for  Three- 
Link  Index  Finger  Using 
PD  (Dash  Line),  PID  (Dot 
Line)  and  Fuzzy  Logic 
Based  PD  (Solid  Line) 
Controllers 


Conclusions  and  Future  Work 

1.  For  a  five-fingered,  smart  prosthetic  hand,  a  hybrid  controi 
technique  invoiving  soft  controi  with  adaptive  neuro-fuzzy 
inference  system  (ANFiS)  and  fuzzy  iogic  (FL)  and  hard  controi 
with  proportionai-derivative  (PD)  was  presented. 

2.  The  ANFiS  is  used  for  inverse  kinematics  and  FL  is  used  for 
tuning  the  PD  parameters  with  two  input  iayers  (error  and  error 
change)  using  7  trianguiar  membership  functions  and  49  fuzzy 
iogic  ruies. 

3.  Simuiation  resuits  with  FL-tuned  PD  controiier  showed  superior 
performance  compared  to  the  PD  and  PiD  controi  aione. 

4.  Work  is  underway  to  extend  this  methodoiogy  to  a  reai-time 
prosthetic  hand. 
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Abstract — A  hybrid  of  soft  control  technique  of  adaptive  neuro- 
fuzzy  inference  system  (ANFIS)  and  fuzzy  logic  (FL)  and  hard 
control  technique  of  proportional-derivative  (PD)  for  a  five¬ 
fingered,  smart  prosthetic  hand  is  presented.  The  ANFIS  is 
used  for  inverse  kinematics  and  FL  is  used  for  tuning  the  PD 
parameters  with  two  input  layers  (error  and  error  change)  using 
7  triangular  membership  functions  and  49  fuzzy  logic  rules. 
Simulation  results  with  FL-tuned  PD  controller  exhibit  superior 
performance  compared  to  the  PD  and  PID  control  alone. 

Index  Terms — Prosthetic  Hand,  Fuzzy  Logic,  PD  Control, 
Adaptive  Neuro-Fuzzy  Inference  System,  Hybrid  Control 

I.  Introduction 

During  the  recent  wars  in  Afghanistan  and  Iraq,  “at  least 
251,102  people  have  been  killed  and  532,715  people  have 
been  seriously  wounded”  [1].  Further,  in  the  United  States, 
the  Amputee  Coalition  of  America  (ACA)  [2]  reports  that 
there  are  approximately  1.9  million  people  living  with  limb 
loss,  due  to  combat  operations  (such  as  conflicts,  wars  etc.), 
and  non-combat  operations  such  as  accidents,  or  birth  defects. 
According  to  a  study  of  the  1996  National  Health  Interview 
Survey  (NHIS)  published  by  Vital  and  Health  Statistics  [3], 
it  is  estimated  that  one  out  of  every  200  people  in  the  U.S. 
has  had  an  amputation.  In  other  words,  about  one  in  every 
2,000  new  born  babies  will  have  limb  deflciency  and  over 
3,000  people  lose  a  limb  every  week  in  America.  By  the  year 
2050,  the  projected  number  of  Americans  living  with  limb 
amputation  will  become  3.6  million  [4].  In  the  past  several 
decades,  prosthetic  hands  have  been  developed  by  various 
researchers  in  the  held  [5]-[9],  but  reproducing  the  human 
hand  in  all  its  various  functions,  appearance,  visibility,  and 
weight  is  still  a  challenging  task  [5]. 

Hard  computing/control  (HC)  techniques  are  used  at 
lower  levels  for  accuracy,  precision,  stability  and  robust¬ 
ness.  HC  comprises  proportional-derivative  (PD)  control  [10], 
proportional-integral-derivative  (PID)  control  [11],  [12],  op¬ 
timal  control  [12]-[15],  adaptive  control  [16]-[19]  etc.  with 
speciflc  applications  to  prosthetic  devices.  However,  our  previ¬ 
ous  works  [10]-[12],  [20]  for  a  smart  prosthetic  hand  showed 
that  PID  controller  resulted  in  overshooting  and  oscillation. 


Soft  computing  (SC)  or  computational  intelligence  (Cl)  [21]  is 
an  emerging  held  based  on  synergy  and  seamless  integration 
of  neural  networks  (NN),  fuzzy  logic  (FL)  and  optimization 
methods,  such  as  genetic  algorithms  (GA),  particle  swarm 
(PS)  [10],  [22],  [23],  tabu  search  (TS)  [23]  and  so  on.  The 
methodology  based  on  SC  can  be  used,  in  particular  with  FL,  at 
upper  levels  of  the  overall  mission  where  human  involvement 
and  decision  making  is  of  primary  importance,  whereas  the  HC 
can  be  used  at  lower  levels  for  accuracy,  precision,  stability  and 
robustness.  Hence,  we  present  the  integration  of  SC  and  HC 
to  solve  problems  that  cannot  be  solved  satisfactorily  by  using 
either  HC  or  SC  methodology  alone  with  speciflc  applications 
to  prosthetics. 

In  this  paper,  we  first  consider  briefly  trajectory  plan¬ 
ning  and  kinematics  problems  associated  with  a  flve-flngered 
prosthetic  hand.  Then,  adaptive  neuro-fuzzy  inference  system 
(ANFIS)  is  used  to  solve  inverse  kinematics  problem  for  three- 
link  Angers  (index,  middle,  ring,  and  little).  Next,  the  dynamics 
of  the  hand  is  derived  and  feedback  linearization  technique 
is  used  to  obtain  linear  tracking  error  dynamics.  Then  we 
propose  the  fuzzy  logic-based  PD  (hybrid)  controller,  which 
uses  fuzzy  logic  with  7  triangular  membership  functions  in 
each  input/output  layer  and  49  logic  rules  to  tune  PD  gain 
parameters.  The  resulting  overall  hybrid  system  incorporating 
both  soft  and  hard  control  techniques  is  simulated  with  practi¬ 
cal  data  for  the  hand  and  found  the  performance  to  be  superior 
to  PD  or  PID  alone.  Finally,  we  provide  conclusions  and  future 
work. 

H.  Modeling 
A.  Trajectory  Planning  and  Kinematics 

The  trajectory  planning  using  cubic  polynomial  was  dis¬ 
cussed  in  our  previous  work  [10],  [11],  [14],  [18],  [19],  [24] 
for  a  two-fingered  (thumb  and  index  Anger)  smart  prosthetic 
hand. 

Kinematics  is  the  study  of  geometry  in  motion  and  is 
restricted  to  a  natural  geometrical  description  of  motion  by 
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the  manners,  including  positions,  orientations,  and  their  deriva¬ 
tives  (velocities  and  accelerations)  [25],  [26].  Forward  and 
inverse  kinematics  of  articulated  systems  study  the  analytical 
relationship  between  the  angular  positions  of  joints  and  the 
positions  and  orientations  of  the  fingertips.  A  desired  trajectory 
is  usually  specified  in  Cartesian  space  and  the  trajectory 
controller  is  easily  performed  in  the  joint  space.  Therefore, 
conversion  of  Cartesian  trajectory  planning  to  the  joint  space 
[26]  is  necessary.  Using  inverse  kinematics,  the  joint  angular 
positions  of  each  finger  need  to  be  obtained  from  the  known 
fingertip  positions.  Then  the  angular  velocities  and  angular 
accelerations  of  joints  can  be  obtained  from  the  linear  and 
angular  velocities  and  accelerations  of  fingertips  by  differential 
kinematics.  The  inverse  and  differential  kinematics  of  two-link 
thumb  and  three-link  fingers  were  discussed  in  our  previous 
publications  [10],  [11],  [14],  [18],  [19],  [24]  for  a  two-fingered 
(thumb  and  index  finger)  smart  prosthetic  hand. 

For  five  fingers  shown  in  Figure  1,  ,  and  are 


Fig.  1 .  Relationship  between  Global  Coordinate  and  Local  Coordinates:  Local 
coordinate  x'^-y'^-z^  of  thumb  can  be  reached  by  rotating  through  angles  a 
and  13  io  and  of  global  coordinate,  subsequently.  Local  coordinate 
x'^-y'^-z'^  of  index  finger  can  be  obtained  by  rotating  through  angle  a  to 
and  then  translating  a  vector  of  the  global  coordinate. 


networks  which  provides  the  best  optimization  algorithm  to 
find  parameters  in  order  to  fit  the  data.  ANFIS  includes 
premise  parameters,  that  defines  membership  functions,  and 
consequent  parameters,  that  defines  the  coefficients  of  each 
output  equation.  ANFIS  tunes  the  membership  function  and 
identifies  the  coefficients  by  the  backpropagation  gradient 
descent  and  least- squares  methods,  respectively.  ANFIS  uses 
a  hybrid  learning  algorithm  to  identify  parameters  of  Sugeno- 
type  fuzzy  inference  systems  for  fuzzy  modeling  procedures 
to  learn  information  about  a  data  set  in  order  to  compute  the 
membership  function  and  track  the  given  input/output  data. 
Figure  2  (a)  shows  a  two  input  first-order  Sugeno  fuzzy  model 
with  two  rules  and  Figure  2  (b)  depicts  the  equivalent  ANFIS 
structure  for  all  the  computation  below.  Sugeno-type  fuzzy 


f,=p,x  +  q^  +  r, 

W,  +  W2 

=  wj,+  wjl 

t 

f2=P2X  +  q^  +  r2 


(a)  A  Two  Input  First-Order  Sugeno  Fuzzy  Model  with  Two  Rules 

Layer  1  Layer  2  Layer  3  Layer  4  Layer  5 


(b)  Equivalent  ANFIS  Structures 


the  three  axes  of  global  coordinate.  Local  coordinate  x^-y^-z^ 
of  thumb  can  be  reached  by  rotating  through  angles  a  and  P 
to  and  of  the  global  coordinate,  subsequently.  Local 
coordinate  of  index  finger  can  be  obtained  by  rotating 

through  angle  a  io  and  then  translating  a  vector  of  the 
global  coordinate;  similarly,  the  local  coordinate  x^-y^-z^  of 
middle  finger  (j  =  m),  ring  finger  (j  =  r),  and  little  finger 
(j  =  /)  can  be  obtained  by  rotating  through  angle  a  to  X^ 
and  then  translating  the  vector  (j  =  m,  r  and  1)  of  the 
global  coordinate. 

B.  Adaptive  N euro -Fuzzy  Inference  System  (ANFIS) 

The  inverse  kinematics  problems  can  be  solved  by  us¬ 
ing  adaptive  neuro-fuzzy  inference  system  (ANFIS)  method 
[27]  where  the  input  of  fuzzy-neuro  system  is  the  Cartesian 
space  and  the  output  is  the  joint  space.  ANFIS  is  a  fuzzy 
inference  system  implemented  in  the  framework  of  adaptive 


Fig.  2.  ANFIS  Architecture:  (a)  A  Two  Input  First-Order  Sugeno  Fuzzy 
Model  with  Two  Rules  (b)  Equivalent  ANFIS  Structure  [27].  The  inverse 
kinematics  problems  are  solved  by  using  adaptive  neuro-fuzzy  inference  sys¬ 
tem  (ANFIS)  method  where  the  input  of  fuzzy-neuro  system  is  the  Cartesian 
space  and  the  output  is  the  joint  space.  ANFIS  is  a  fuzzy  inference  system 
implemented  in  the  framework  of  adaptive  networks  which  provides  the  best 
optimization  algorithm  to  find  parameters  in  order  to  fit  the  data. 

system  has  the  following  Rule  Base  [27]-[31]. 

If  V  is  Ai  and  y  is  Bi,  then  fi  =  pix  -H  qiy  -f  ri. 

If  V  is  A2  and  y  is  B2,  then  /2  =  p2X  -f  q2y  +  r2. 

Here,  v  and  y  are  inputs  to  constitute  the  premise  parameters 
Ai,  A2,  Bi,  and  B2  (Layer  1  in  Figure  2  (b)).  pi,  qi,  and  Vi 
(i  =  1,2)  are  the  consequent  parameters.  We  evaluate  the  rules 
by  choosing  product  foi*  T-Norm  (Layers  2  and  3)  which 
results  in 

Wi  =  HAi{x)  i  =  (1) 
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Here,  and  are  designed  fuzzy  membership 

functions.  Now  after  leaving  the  arguments  (Layer  4),  we  get 
the  output  f{x,y)  by  Rule  Consequences. 


f{x,  y)  = 


wi{x,y)fx{x,y) +  W2{x,y)f2{x,y) 


wi{x,y)  +  W2{x,y) 
f  (Layer  5)  can  be  written  as 

Wifi  +  W2f2 


(2) 


/  = 


+  W2 
=  W1/1+W2/2, 


where 


wi  = 


Wi 


W2  = 


W2 


(3) 


(4) 


Wi  -\-W2  Wi  W2 

C.  Dynamics  of  Hand 

The  dynamic  equations  of  hand  motion  are  derived  via 
Lagrangian  approach  using  kinetic  energy  and  potential  energy 
as  [17],  [24]-[26],  [32] 

dt  V^qy  dq 

where  C  is  the  Lagrangian;  q  and  q  represent  the  angular  ve¬ 
locities  and  angle  vectors  of  joints,  respectively;  r  is  the  given 
torque  vector  at  joints.  The  Lagrangian  C  can  be  expressed  as 


(5) 


C  =  T-V, 


(6) 


Thus,  from  (9)  and  (10),  we  can  derive  a  linear  system  in 
Brunovsky  canonical  form  as 


±{t) 


0  I 
0  0 


x(i)  + 


with  its  control  input  vector  given  by 


u{t)  =  -M  ^(q(i))  [N(q(i),  q(i))  -  T{t)] . 


(11) 


(12) 


Let  us  suppose  the  prosthetic  hand  is  required  to  track  the 
desired  trajectory  qd{t)  described  under  path  generation  or 
tracking.  Then,  the  tracking  error  e{t)  is  defined  as 

e(i)  =  ^d{t)  -  q(i).  (13) 

Here,  qd{t)  is  the  desired  angle  vector  of  joints  and  can  be 
obtained  by  trajectory  planning  [10],  [11],  [14],  [18],  [24];  q(t) 
is  the  actual  angle  vector  of  joints.  Differentiating  (13)  twice, 
to  get 

e(i)  =  -  q(t),  e{t)  =  qd(t)  -  q(t).  (14) 

Substituting  (10)  into  (14)  yields 

e(i)  =  hd{t)  +  ]V["i(q(t))  [N(q(t),  q(t))  -  T{t)]  (15) 

from  which  the  control  function  can  be  defined  as 

u(t)  =  iid{t)  +  M"^(q(t))  [N(q(t),  q(t))  -  T{t)] .  (16) 

This  is  often  called  the  feedback  linearization  control  law, 
which  can  also  be  inverted  to  express  it  as 


where  T  and  V  denote  kinetic  and  potential  energies,  respec¬ 
tively.  Substituting  (6)  into  (5),  dynamic  equations  of  thumb 
can  be  obtained  as  below. 

M(q)q  +  C(q,q) +  G(q)  =  T,  (7) 

where  M(q)  is  the  inertia  matrix;  C(q,  q)  is  the  Corio¬ 
lis/centripetal  vector  and  G(q)  is  the  gravity  vector.  (7)  can 
be  also  written  as 


T{t)  =  M(q(t))  [qd(i)  -  u{t))  +  N(q(t),  q(t)]  .  (17) 


Using  the  relations  (14)  and  (16),  and  defining  state  vector 
x(t)  =  e'(t)]',  the  tracking  error  dynamics  can  be 

written  as 


±{t)  = 


0  I 
0  0 


x(i)  + 


(18) 


Note  that  this  is  in  the  form  of  a  linear  system  such  as 


M(q)q  +  N(q,q)=T,  (8) 


x(t)  =  Ax(t)  +  Bu(t).  (19) 


where  N(q,  q)  =  C(q,  q)  +  G(q)  represents  nonlinear  terms. 
The  dynamic  relations  for  the  two-link  thumb  and  the  remain¬ 
ing  three-link  fingers  are  quite  lengthy  and  omitted  here  due 
to  lack  of  space  [24],  [33],  [34]. 

HI.  Control  Techniques 
A.  Feedback  Linearization 

The  nonlinear  dynamics  represented  by  (8)  is  to  be  con¬ 
verted  into  a  linear  state-variable  system  using  feedback  lin¬ 
earization  technique  [17].  Alternative  state- space  equations  of 
the  dynamics  can  be  obtained  by  defining  the  position/velocity 
state  x(t)  of  the  joints  as 

At)  =  h'{t)  q'(i)]'.  (9) 

Let  us  repeat  the  dynamical  model  and  rewrite  (8)  as 

|q(t)  =  -M-l(q(t))  [N(q(t),q(t))  -T(t)]  .  (10) 


B.  Fuzzy  Logic-Based  PD  Hybrid  Control 

Figure  3  shows  the  block  diagram  of  the  hybrid  fuzzy  logic- 
based  PD  controller  for  the  presented  five-fingered  prosthetic 
hand  with  control  signal  as 

u(t)  =  — Kp(t)e(t)  —  KD(t)e(t)  (20) 

with  the  proportional  Kp(t)  and  derivative  KD(t)  diagonal 
gain  matrices  with  time  varying.  We  then  rewrite  (17)  as 

T{t)  =  M{(i{t))[qd{t)  +  Kp{t)e{t)  +  Ku{mt))  + 

N(q(t),q(t)].  (21) 

Then  we  use  mamdani  fuzzy  inference  system  to  tune  the 
time- varying  parameters  Kp  (t)  and  Kd  {t)  of  PD  controller. 
Figure  4  shows  the  structural  characteristics  of  proposed  fuzzy 
inference  system,  which  includes  two  inputs  (error  e  and  error 
change  e)  on  the  left  and  one  output  (Kp)  on  the  right.  Each 
input  or  output  layer  contains  seven  triangular  membership 
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Fig.  3.  Block  Diagram  of  the  Presented  Hybrid  Fuzzy  Logic-Based 
Proportional-Derivative  (PD)  Controller  for  a  Five-Fingered  Prosthetic  Hand: 
Errors  and  error  changes  are  calculated  by  actual  and  desired  angles,  which  are 
based  on  adaptive  neuro-fuzzy  inference  system  (ANFIS)  trajectory  planner. 
Then  fuzzy  logic  controller  tunes  all  parameters  of  closed-loop  PD  control  so 
that  the  required  torque  of  the  prosthetic  hand  nonlinear  system  is  computed 
by  control  input. 


Fig.  5.  All  Membership  Functions:  Each  of  Two  Inputs  (Upper  Panel)  and 
One  Output  (Lower  Panel)  Uses  7  Triangular  Membership  Functions 

TABLE  I 

A  Complete  Fuzzy  Logic  Rule  Base 


e\e 

NL 

NM 

NS 

ZR 

PS 

PM 

PL 

nl 

ZR 

ZR 

ZR 

ZR 

VS 

S 

SM 

nm 

ZR 

ZR 

ZR 

VS 

s 

SM 

ML 

ns 

ZR 

ZR 

VS 

S 

SM 

ML 

L 

ZR 

ZR 

VS 

S 

SM 

ML 

L 

VL 

PS 

VS 

S 

SM 

ML 

L 

VL 

VL 

PM 

S 

SM 

ML 

L 

VL 

VL 

VL 

PL 

SM 

ML 

L 

VL 

VL 

VL 

VL 

N:  negative;  P:  positive;  ZR:  zero;  L:  large;  M:  medium; 
S:  small;  V:  very 


kinematics,  the  first  and  second  joint  angles  of  the  thumb 
fingertip  are  constrained  in  the  ranges  of  [0,90]  and  [-80,0] 
(degrees).  The  first,  second,  and  third  joint  angles  of  the  other 
four  fingers  are  constrained  in  the  ranges  of  [0,90],  [0,110] 
and  [0,80]  (degrees),  respectively  [35]. 

Next,  we  present  simulations  with  PD  and  PID  controllers 
and  fuzzy  inference  system  tuned  PD  controller  for  the  14 
DOFs  five-fingered  smart  prosthetic  hand.  The  parameters 
of  the  two-link  thumb/three-link  fingers  [36]  were  related  to 
desired  trajectory.  All  parameters  of  the  smart  prosthetic  hand 
selected  for  the  simulations  are  given  in  Table  II  and  the 


Fig.  4.  The  Structural  Characteristics  of  Proposed  Fuzzy  Inference  System: 
Two  inputs  (error  e  and  error  change  e)  on  the  left  and  one  output  (tuned 
Kp)  on  the  right  with  49  logic  rules 

functions  as  shown  in  Figure  5  and  49  logic  rules  as  listed  in 
Table  I.  After  using  49  logic  rules,  the  output  surface  Kp 
of  fuzzy  inference  system  is  generated  as  shown  in  Figure  6. 
Similarly,  Kd  can  be  computed  by  the  same  way. 

IV.  Simulation  Results  and  Discussion 

Figure  7  shows  that  a  five-fingered  prosthetic  hand  with 
14  DOFs  is  reaching  a  rectangular  rod  in  order  to  grasp  the 
object.  When  thumb  and  the  other  four  fingers  are  performing 
extension/fiexion  movements,  the  workspace  of  fingertips  is 
restricted  to  the  maximum  angles  of  joints.  Referring  to  inverse 
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Eig.  6.  The  Output  Surface  of  Euzzy  Inference  System  with  Two  Inputs  and 
49  Logic  Rules 
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Fig.  7.  Five-Fingered  Prosthetic  Hand  Grasping  a  Rectangular  Object 


side  length  and  length  of  the  target  rectangular  rod  are  0.010 
and  0.100  (m),  respectively.  The  relating  parameters  between 
the  global  coordinate  and  the  local  coordinates  are  defined  in 
Table  III.  Moreover,  in  this  work,  we  assumed  that  each  link 


TABLE  II 

Parameter  Selection  oe  the  Smart  Hand 


Parameters 

Values 

Thumb 

Time  (fo,f/)* 

Desired  Initial  Position 

Desired  Final  Position  (X^xJ)** 

Desired  Initial  Velocity  {X^XqT 

Desired  Final  Velocity  (XjXp* 

Length  {L\,L2) 

Mass  (m5^,m^) 

0,  20  (sec) 

0.035,  0.060  (m) 

0.0495,  0.060  (m) 

0,  0  (m/s) 

0,  0  (m/s) 

0.040,  0.040  (m) 

0.043,  0.031  (kg) 

Index  Finger 

Desired  Initial  Position  {XqXqT* 

Desired  Final  Position  (XjXfT* 

Length 

Mass  (771^^2,7713) 

0.065,  0.080  (m) 

0.010,  0.060  (m) 

0.040,  0.040,  0.030  (m) 
0.045,  0.025,  0.017  (kg) 

Middle  Finger 

Desired  Initial  Position  (X^,yQ^)** 
Desired  Final  Position  (X'p X^Y* 

Length 

Mass  (7715^,771^,7713^) 

0.065,  0.080  (m) 

0.005,  0.060  (m) 

0.044,  0.044,  0.033  (m) 
0.050,  0.028,  0.017  (kg) 

Ring  Finger 

Desired  Initial  Position  {X'^XqY* 

Desired  Final  Position  (XJXfY* 

Length  {LIX^^X^) 

Mass  (771^,1112,7713) 

0.065,  0.080  (m) 

0.010,  0.060  (m) 

0.040,  0.040,  0.030  (m) 
0.041,  0.023,  0.014  (kg) 

Little  Finger 

Desired  Initial  Position  (XqXqY* 

Desired  Final  Position  (X^yJy* 

Length  (L5,L^,L^) 

Mass  (7715^,7712,1113) 

0.055,  0.080  (m) 

0.020,  0.060  (m) 

0.036,  0.036,  0.027  (m) 
0.041,  0.023,  0.014  (kg) 

*A11  fingers  use  same  parameters 
**A11  parameters  are  in  local  coordinates 

of  all  fingers  is  a  circular  cylinder  with  the  radius  (R)  0.010 
(m),  so  the  inertia  of  each  link  k  of  all  fingers  j  (=  t,  i. 

TABLE  III 

Parameter  Selection  oe  Conversion  between  Global  and  Local 
Coordinates 


Parameters 

Values 

Rotating  a 

90  (deg) 

Rotating  (3 

45  (deg) 

Translating 

(0.035,  0,  0)  (m) 

Translating 

(0.040,  0,  -0.020)  (m) 

Translating  d^ 

(0.035,  0,  -0.040)  (m) 

Translating  d^ 

(0.025,  0,  -0.060)  (m) 

m,  r  and  1)  can  be  calculated  as 

iLk  =  ■  (22) 

All  initial  actual  angles  are  zero  and  the  diagonal  coefficients, 
Kp ,  Ki  and  Kd  ,  for  the  PD  or  PID  controller  alone  are  arbi¬ 
trarily  chosen  as  100.  From  the  derived  dynamic  and  control 
models,  after  the  parameters  (Kp  and  Kd)  are  selected,  the 
control  signal  u  and  torque  r  can  be  calculated. 

Figure  8  shows  tracking  errors  and  on  the  left 


Time  (sec)  Time  (sec) 


Fig.  8.  Tracking  Errors  (Left)  and  Desired/Actual  Angles  (Right)  of  Joints 
1  (Upper)  and  2  (Lower)  for  Two-Link  Thumb  Using  PD  (Dash  Line),  PID 
(Dot  Line)  and  Fuzzy  Logic  Based  PD  (Solid  Line)  Controllers 

column)  and  desired/actual  angles  {q\  and  on  the  right 

column)  of  joints  1  (the  top  row)  and  2  (the  bottom  row) 
for  two-link  thumb  using  PD  (dash  line),  PID  (dot  line)  and 
fuzzy  logic  based  PD  (solid  line)  controllers.  The  tracking 
errors  for  PD  control  are  convergent  within  5  seconds  without 
overshooting,  but  PID  control  acts  longer  (approximate  10  sec¬ 
onds)  with  overshooting  and  oscillation.  The  proposed  hybrid 
fuzzy  logic  PD  control  using  parameters  Kp  G  [50, 1000]  and 
Kd  G  [50,  500]  provides  faster  convergence  than  both  PD 
and  PID  controllers.  To  further  study  whether  the  parameter 
range  influences  tracking  errors,  we  found  that  the  larger 
parameter  range,  the  faster  convergent  speed  after  altering 
Kp  G  [50,  2000]  without  additional  computational  time.  We 
also  used  fuzzy  logic  controller  with  two  inputs  (error  and  error 
rate)  and  one  output  (control  signal),  but  the  control  system 
could  not  obtain  convergent  tracking  errors  (data  not  shown). 
These  data  suggest  that  fusion  of  soft  computing  (SC)  and 
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Fig.  9.  Control  Signals  (Left)  and  Actuated  Torques  (Right)  of  Joints  1 
(Upper)  and  2  (Lower)  for  Two-Link  Thumb  Using  PD  (Dash  Line),  PID  (Dot 
Line)  and  Fuzzy  Logic  Based  PD  (Solid  Line)  Controllers  in  0.01  Second 


hard  control  (HC)  is  superior  to  either  HC  or  SC  methodology 
alone. 

The  time- variant  computed  control  signals  (u\  and  U2) 
torques  (rf  and  rj)  for  two-link  thumb  within  the  first  0.01 
second  are  shown  in  Figure  9,  suggesting  that  the  presented 
hybrid  fuzzy  logic  PD  controller  requires  more  power  (torque) 
than  PD  and  PID  controllers  in  order  to  obtain  faster  conver¬ 
gent  tracking  errors. 

Similarly,  Figures  10,  12,  14  and  16  show  tracking  errors 
and  desired/actual  angles  for  all  remaining  three-link  fingers. 
Figures  11,  13,  15  and  17  show  control  signals  and  torques 
for  the  mapping  three-link  fingers. 


Fig.  1 1 .  Control  Signals  (Left)  and  Actuated  Torques  (Right)  of  Joints  1  (Top), 
2  (Middle)  and  3  (Bottom)  for  Three-Link  Index  Finger  Using  PD  (Dash  Line), 
PID  (Dot  Line)  and  Fuzzy  Logic  Based  PD  (Solid  Line)  Controllers  in  0.01 
Second 
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Fig.  12.  Tracking  Errors  (Left)  and  Desired/Actual  Angles  (Right)  of  Joints 
1  (Top),  2  (Middle)  and  3  (Bottom)  for  Three-Link  Middle  Finger  Using 
PD  (Dash  Line),  PID  (Dot  Line)  and  Fuzzy  Logic  Based  PD  (Solid  Line) 
Controllers 
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Fig.  10.  Tracking  Errors  (Left)  and  Desired/Actual  Angles  (Right)  of  Joints  1 
(Top),  2  (Middle)  and  3  (Bottom)  for  Three-Link  Index  Finger  Using  PD  (Dash 
Line),  PID  (Dot  Line)  and  Fuzzy  Logic  Based  PD  (Solid  Line)  Controllers 


V.  Conclusions  and  Future  Work 

For  a  five-fingered  smart  prosthetic  hand,  a  hybrid  control 
technique  involving  soft  control  with  adaptive  neuro-fuzzy 
inference  system  (ANFIS)  and  fuzzy  logic  (FL)  and  hard 
control  with  proportional-derivative  (PD)  was  presented.  The 
ANFIS  is  used  for  inverse  kinematics  and  FL  is  used  for 
tuning  the  PD  parameters  with  two  input  layers  (error  and 


error  change)  using  7  triangular  membership  functions  and 
49  fuzzy  logic  rules.  Simulation  results  with  FL- tuned  PD 
(hybrid)  controller  showed  superior  performance  compared  to 
the  PD  and  PID  control  alone.  Work  is  underway  to  extend  this 
methodology  to  a  real-time  implementation  on  the  prototype 
of  a  prosthetic  hand. 
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1.  INTRODUCTION 

The  human  hand  is  considered  to  be  an  agent  of  the  human  brain  and  is  the  most 
intriguing  and  versatile  appendages  of  the  human  body.  Over  the  last  several  years, 
attempts  have  been  made  to  build  a  prosthetic  hand  to  replace  the  human  hand  that 
fully  simulates  the  various  natural /human-like  operations  of  moving,  grasping,  lifting, 
twisting  and  so  on.  Replicating  the  human  hand  in  all  its  various  functions  is  still  a 
challenging  task  due  to  its  extreme  complexity.  It  has  27  bones,  controlled  by  about 
38  muscles  to  provide  the  hand  with  22  degrees  of  freedom  (DOF)  and  incorporates 
about  17,000  tactile  units  of  4  different  units  [99,  207].  Parallels  between  dextrous  robot 
and  human  hands  were  explored  by  studying  sensor  motor  integration  in  the  design  and 
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control  of  these  robots  by  bringing  together  experimental  psychologists,  kinesiologists, 
computer  scientists,  and  electrical  and  mechanical  engineers. 

1.1.  Relevance  to  the  Military 

'Tn  the  United  States,  there  are  approximately  1.9  million  people  living  with  limb  loss" 
due  to  combat  operations  (such  as  conflicts,  wars,  etc.)  and  non-combat  operations  such 
as  accidents,  or  birth  defects,  according  to  the  Amputee  Coalition  of  America  (ACA)  [3]. 
Further,  during  the  recent  wars  in  Afghanistan  and  Iraq,  "at  least  251,102  were  killed  and 
532,715  seriously  wounded"  [192]. 

The  following  documents  reveal  the  intense  interest  by  military  in  the  area  of  smart 
prosthetics. 

1.  First,  according  to  [131],  recognizing  that  "arm  amputees  rely  on  old  devices"  and 
that  the  existing  technology  for  arm  and  hand  amputees  hasn't  changed  signifi¬ 
cantly  in  the  past  six  decades,  the  Defense  Department  is  embarking  on  a  research 
program  to  "fund  prosthetics  research"  according  to  [132]  to  revolutionalize  upper- 
body  prosthetics  and  to  develop  artificial  arms  that  will  "feel,  look  and  perform" 
like  a  real  arm  guided  by  the  central  nervous  system. 

2.  According  to  [55,  56],  Bio-Revolution  is  one  of  the  eight  strategic  research  thrusts 
that  DARPA  is  emphasizing  in  response  to  emerging  trends  and  national  security. 
In  particular,  the  Human  Assisted  Neural  Devices  program  under  Bio-Revolution 
will  have  "immediate  benefit  to  injured  veterans,  who  would  be  able  to  control 
prosthetics. . .  ."  A  related  area  of  interest  in  Bio-Revolution  is  Cell  and  Tissue 
Engineering. 

3.  Next,  according  to  the  Defense  Science  Office  (DFO)  of  DARPA  [57],  emerging  tech¬ 

nologies  for  combat  casualties  care  with  dual-usage  for  both  military  and  civilian 
medical  care,  focus  on  programs  in  Revolutionizing  Prosthetics,  Human  Assisted 
Neural  Devices,  Biologically  Inspiredi^r^ulti-functional  Dynamic  Robotics,  and  so 
on.  In  particular,  according  to  [58],  one  of  the  most  devastating  battlefield 

injuries  is  loss  of  a  limb ...  at  DARPA,  the  vision  of  a  future  is  to . . .  regain  full  use 
of  that  limb  again." 

In  research  and  development  of  a  prosthetic  hand  using  non-invasive  techniques,  the 
basic  problems  are 

1.  acquising  and  classifying  electromyographic  (EMG)  signals  to  correspond  to  vari¬ 
ous  human-like  operations  or  features, 

2.  converting  EMG  feature  signals  to  control  signals  to  input  to  actuators  to  operate 
the  prosthetic  hand,  and 

3.  designing  and  building  a  prosthetic  hand  with  necessary  sensors  to  operate  accord¬ 
ing  to  the  control  signal  that  corresponds  to  the  EMG  signal  intended  for  the 
particular  identified  hand  operation. 

This  overview  was  first  prepared  in  2006  [138]  when  the  first  author  and  his  colleagues 
at  Idaho  State  University  submitted  a  proposal  on  Smart  Prosthetic  Hand  Technology — 
Phase  I  of  III  to  the  Telemedicine  Advanced  Technology  Research  Center  (TATRC),  which 
is  the  corporate  or  central  laboratory  for  advanced  technology  research  of  the  U.S.  Army 
Medical  Research  and  Material  Command  (USAMRMC)  of  U.S.  Department  of  Defense. 
Since  the  proposal  was  funded  by  the  TATRC  in  July  2007,  the  overview  has  been  contin¬ 
uously  updated  and  was  then  completed  in  the  present  form.  In  this  chapter,  a  chrono¬ 
logical  overview  of  the  applications  of  control  theory  to  prosthetic  hand  is  presented. 
The  overview  focuses  on  hard  computing  or  control  techniques,  such  as  multi-variable 
feedback,  optimal,  nonlinear,  adaptive  and  robust,  and  soft  computing  or  control  tech¬ 
niques,  such  as  artificial  intelligence,  neural  networks,  fuzzy  logic,  genetic  algorithms, 
and  on  the  fusion  of  hard  and  soft  control  techniques.  This  overview,  focusing  on  recent 
developments,  is  intended  to  supplement  the  already  existing  excellent  survey  articles 
[50, 112,  207],  and  is  not  intended  to  be  an  exhaustive  survey  on  this  topic.  Any  omissions 
of  other  works  is  purely  unintentional. 
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2.  CONTROL  STRATEGIES 
2.1.  Prosthetic  Hands 

Over  the  last  several  years  artificial  hands  have  been  developed  by  various  researchers  in 
the  field  and  some  of  the  prosthetic  devices  developed  are  given  below  (in  chronological 
order)  [207,  208]: 

1.  Russian  arm  -  [108,  128,  177] 

2.  Waseda  hand  -  [103] 

3.  Boston  arm"^  -  [125] 

4.  UNB  hand  (University  of  New  Brunswick)  -  [88,  120,  162] 

5.  Hanafusa  hand  -  [79] 

6.  Crossley  hand  -  [51] 

7.  Okada  hand  -  [146] 

8.  Utah /MIT  hand  (University  of  Utah /Massachusetts  Institute  of  Technology)  -  [95, 
96,  94] 

9.  JPL/Stanford  hand  (Jet  Propulsion  Laboratory/Stanford  University)  -  [167,  195] 

10.  Minnesota  hand  -  [119] 

11.  Manus  hand  -  [114,  157] 

12.  Kobayashi  hand  -  [107] 

13.  Rovetta  hand  -  [165] 

14.  UT/RAL  hand  -  [105] 

15.  Dextrous  gripper  -  [193] 

16.  Belgrade/USC  hand  (University  of  Belgrade /University  of  Southern  California)  - 
[18] 

17.  Southampton  hand  (University  of  Southampton,  Southampton,  UK)  -  [111] 

18.  MARCUS  hand  (Manipulation  And  Reaction  Control  under  User  Supervision)  - 
[113] 

19.  Kobe  hand  (Kobe  University,  Japan)  -  [148] 

20.  Robonaut  hand  (NASA  Johnson  Space  Center)  -  [124] 

21.  NTU  hand  (National  Taiwan  University)  -  [86] 

22.  Hokkaido  hand  -  [145] 

23.  DLR  hand  (Deutschen  Zentrums  fiir  Luft-  und  Raumfahrt-German  Aerospace 
Center)  -  [26,  121] 

24.  TUAT/ Karlsruhe  hand  (Tokyo  University  of  Agriculture  and  Technol¬ 
ogy/University  of  Karlsruhe)  -  [74] 

25.  BUAA  hand  (Beijing  University  of  Aeronautics  and  Astronautics)  -  [209] 

26.  TBM  hand  (Toronto /Bloorview  MacMillan)  -  [59] 

27.  ULRG  System  (University  of  Louisiana  Robotic  Gripper)  -  [109] 

28.  Oxford  hand  -  [114] 

29.  IOWA  hand  (University  of  Iowa)  -  [205] 

30.  MA-I  hand  -  [182] 

31.  RCH  -1  (ROBO  CASA  hand  1^)  -  [159] 

32.  UB  hand  (University  of  Bologna)  -  [123] 

33.  Ottobock  SUVA  hand  -  (www.ottobock.co.uk) 

34.  Northwestern  University  system  -  [72] 

35.  SKKU  Hand  II  (Sungkyunkwan  University,  Korea)  -  [44] 

36.  Applied  Physics  Laboratory  (APL)  at  Johns  Hopkins  University  (JHU)  -  [7,  8,  58] 
Some  of  the  commercial  web  sites  for  prosthetic  devices  are: 

1.  Sensor  Hand™  Speed  from  Otto  Bock  (www.ottobock.co.uk), 

2.  VASI  (Variety  Ability  Systems  Inc.),  a  company  of  the 
Otto  Boch  Group  (http://www.vasi.on.ca/index.html). 


"The  "Boston  Arm,"  project  involved  the  Harvard  Medical  School,  Massachusetts  General  Hospital,  the  Liberty 
Mutual  Research  and  Rehabilitation  Centers,  and  M.I.T. 

^The  Italy-Japan  joint  laboratory  for  Research  on  Humanoid  and  Personal  Robotics. 
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3.  Utah  Arm  from  Motion  Control  (www.utaharm.com), 

4.  The  i-LIMB  Hand  from  Touch  Bionics  (www.touchbionics.com),  and  so  on. 

A  very  useful  comparison  table  between  several  hands  listed  above  and  the  human 
hand,  adapted  from  [207,  208],  is  updated  and  shown  in  Table  1. 

However,  about  35%  of  the  amputees  do  not  use  their  prosthetic  hand  regularly  accord¬ 
ing  to  [14]  due  to  various  reasons  such  as  poor  functionality  of  the  presently  available 
prosthetic  hands  and  psychological  problems.  To  overcome  this  problem,  one  has  to 
design  and  develop  an  artificial  hand  that  "mimics  the  human  hand  as  closely  as  possi¬ 
ble"  both  in  functionality  and  appearance. 

There  are  a  number  of  surveys,  and/or  state-of-the  art  articles  that  appeared  over  the 
years  on  the  subject  of  myoelectric  prosthetic  hand  including  the  work  in  USSR  (Russian) 
[177]  and  other  places  [10,  19,  21,  43,  50,  77,  93,  112,  137,  147,  173,  174,  178,  207]. 

2.2.  Chronological  Overview 

Up  to  1970: 

Electromyographic  (EMG)  signal  is  a  simple  and  easily  obtainable  source  of  informa¬ 
tion  about  the  various  movements  to  be  used  for  artificial /prosthetic  hands.  The  EMG 
extraction  using  surface  electrodes  is  a  very  attractive  method  from  the  point  of  view 
of  the  user  compared  to  implants  requiring  surgery.  Research  activity  in  the  field  of 


Table  1.  Comparison  of  human  hand  with  artificial  hands:  robotic  and  prosthetic  hands.  Force  indicates  power 
grasp.  Speed  indicates  the  time  required  for  a  full  closing  and  opening,  E,  stands  for  external,  I,  stands  for 
internal. 


Size 

(Norm) 

#of 

fingers 

#of 

DOF 

#of 

sensors 

#of 

actuators 

Weight 

(gms) 

Eorce 

(N) 

Speed 

(sec) 

Controls 

Human  hand 

Russian  arm 

Waseda  hand 
hand 

Lr^_jafusa  hand 
Crossley  hand 

1.0 

5 

5 

22 

^17,000 

3 

38(I+E) 

1 

^400 

>300 

^147 

0.25 

E 

Utah/MIT  hand 

^2.0 

4 

16 

16 

32(E) 

— 

31.8 

— 

E 

JPL/ Stanford  hand 

^1.2 

3 

9 

— 

12(E) 

1100 

45 

— 

E 

Minnesota  hand 


[yashi  hand 
:tta  hand 


UT/RAL  hand 

Dextrous  gripper 
Belgrade/USC  hand 

^1.1 

4 

4 

23+4 

4(E) 

E 

Southampton  hand 

^1.0 

5 

6 

— 

6(E) 

400 

38 

^5 

E 

MARCUS  hand 

^^1.1 

3 

2 

3 

2(1) 

— 

— 

— 

I 

Kobe  hand 

Robonaut  hand 

^1.5 

5 

12+2 

43+ 

14(E) 

E 

NTU  hand 

5 

17 

35 

17(E) 

1570 

— 

— 

E 

Hokkaido  hand 

^1 

5 

17 

35 

17(E) 

1570 

— 

— 

E 

DLR  hand  II 

>1 

5 

7 

— 

7(E) 

125 

— 

— 

E 

TUAT/ Karlsruhe  hand 

^1 

5 

17 

— 

17(E) 

^120 

12 

0.1 

E 

BUAA  hand 
\  hand 

vr::_Jrd  hand 

IOWA  hand 

MA-I  hand 

Robo  Casa  hand-1 

^1 

4 

5 

16 

24 

2 

6(E+I) 

350 

^40 

0.25 

E 

Ottobock  SUVA 

1 

3 

1 

2 

1(E) 

600 

— 

— 

I 

UB  hand 

Hokkaido  hand 

>1 

5 

7 

7(E) 

125 

E 

Northwestern 

SKKU  Hand  II 

APL-JHU  System 

1.1 

4 

4 

— 

3 

900 

Automatic  Control  Techniques  for  Smart  Prosthetic  Hand  Technology:  An  Overview 


5 


prosthetic  limbs  was  initiated  by  the  US  National  Academy  of  Sciences  in  response  to 
the  needs  of  a  large  number  of  casualties  in  World  War  II  [135].  Researchers  reporting  in 
Refs.  [16,  203]  first  proposed  the  concept  of  EMG  signals  for  the  control  of  a  prosthetic 
hand  for  amputees.  A  proportional  (open-loop)  control  systems  in  which  the  amplitude 
of  the  hand  motor  voltage  and  hence  its  speed  and  force  measured  from  strain  gauges 
varies  in  direct  proportion  (linearly)  to  the  amplitude  of  the  EMG  signal  generated  by 
the  prosthetic  hand,  was  first  reported  in  Refs.  [24,  25].  In  addition,  the  system  added 
force  and  velocity  feedback  controls  so  the  users  could  feel  more  natural  when  using  this 
device.  An  adaptive  control  scheme  was  developed  by  [187]  for  the  Southampton  Hand. 
1971-79: 

The  work  reported  in  Ref.  [162]  studied  the  effect  of  sensory  feedback  based  on  semi¬ 
conductor  strain  gauges  on  either  edge  of  thumb  of  the  prosthetic  hand  to  adjust  the 
stimulus  magnitude  to  target  value  and  avoid  dropping  or  crushing  objects  for  control 
of  a  prosthesis  and  found  this  acceptable  for  patients.  When  the  strain  gauges  received 
the  stimulus,  the  system  amplified  and  transferred  the  signals  to  comparator,  and  then 
the  comparator  modified  the  range  of  amplitude  of  stimulus  to  the  level  that  the  users 
needed.  However,  the  device  with  feedback  is  two  or  three  times  larger  than  the  normal 
hand.  A  hierarchical  method  consisting  of  analytical  control  theory,  such  as  performance- 
adaptive  self-organizing  control  algorithm  and  artificial  intelligence  using  fuzzy  automa¬ 
ton,  was  presented  in  Ref.  [169]  to  drive  a  prosthetic  hand. 

1980-89: 

In  providing  a  historical  perspective,  the  contribution  in  Ref.  [43]  presented  the  status 
of  the  closed-loop  (feedback)  control  principles  for  the  application  of  prosthetic  devices. 
Three  concepts  relating  to  supplemental  sensory  feedback,  artificial  reflexes,  and  feed¬ 
back  through  control  interfaces  were  discussed,  and  it  was  concluded  that  ''we  have 
not  moved  very  far  in  the  last  65  years  in  the  clinical  application  of  these  concepts." 
A  statistical  analysis  involving  the  study  of  zero-crossings,  second  to  fifth  moments  and 
correlation  functions  and  pattern  classification  of  EMG  signals  was  given  in  Ref.  [168]. 
A  probabilistic  model  of  the  EMG  pattern  was  formulated  in  the  feature  space  of  integral 
absolute  value  (lAV)  to  provide  the  relation  between  a  command,  represented  by  motion 
and  speed  variables  and  the  location  and  shape  of  the  pattern  for  real-time  control  of  a 
prosthetic  arm  as  given  in  Ref.  [118].  Using  kinematic  relationships  for  dynamic  model 
of  fingers,  multi-variable  feedback  control  strategies  using  pole  assignment  in  frequency 
domain  were  employed  by  [195]  to  guarantee  local  stability  for  controlling  one  finger  of 
the  JPL/Stanford  hand.  The  work  in  Ref.  [195]  produced  the  dynamic  models  of  three 
fingers  (thumb,  index,  and  middle)  and  three  joints  first,  and  then  used  Laplace  trans¬ 
form  to  work  in  frequency  domain.  To  get  a  guaranteed  stability  of  control  system,  the 
roots/ poles  had  to  be  located  in  the  left  half  plane.  Hence,  they  could  get  a  desired  steady 
movement  of  fingers  by  controlling  the  positions  of  the  roots.  The  works  reported  by  the 
groups  in  Refs.  [49,  136]  were  the  first  to  investigate  various  aspects  such  as  kinemat¬ 
ics,  prehensility,  dynamics,  and  control  of  multi-fingered  hands  manipulating  objects  of 
arbitrary  shape  in  three  dimensions. 

1990-99: 

Design,  implementation,  and  experimental  verification  of  an  improved  cybernetic 
elbow  prosthesis  was  presented  in  Refs.  [1,  2]  that  mimics  the  natural  limb  to  both 
internal  (voluntary)  inputs  from  the  amputee  and  external  inputs  from  the  environment. 
The  work  in  Ref.  [181]  considered  a  dextrous  hand  employing  a  systematic  approach 
to  achieve  the  object  stiffness  control  by  actuator  position  control,  tendon  tension  con¬ 
trol,  joint  torque  control,  joint  stiffness  control,  and  Cartesian  fingertip  stiffness  control. 
The  work  in  Ref.  [174]  conducted  a  survey  of  33  patients  wearing  the  proportional  myo¬ 
electric  hand  grouped  into  3  categories  based  on  previous  experience  with  a  terminal 
device:  digital  (on-off)  myoelectric  hand,  body-powered  terminal  device,  and  no  termi¬ 
nal  device.  The  survey  results  showed  that  the  group  of  patients  having  experience  with 
the  digital  hand  "were  most  impressed  with  proportionally  controlled  hand,"  because  it 
has  the  advantages:  comfortable,  cosmetic  acceptance,  more  natural,  superior  pinch  force 
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(11-25  lb)  compared  to  voluntary  opening  (7-8  lb),  a  greater  range  of  function  but  less 
energy,  sensory  feedback,  force  feedback,  and  short  below-elbow. 

The  research  work  in  Ref.  [81]  developed  three  tests  for  evaluation  of  input-output 
properties  of  patient  control  of  neuroprosthetic  hand  grasp,  which  can  compensate  or 
enrich  the  function  of  a  damaged  peripheral  nervous  system.  The  first  test  was  for  static 
input-output  properties  of  the  hand  grasp,  the  second  one  was  for  control  of  hand  grasp 
outputs  while  tracking  step  and  ramp  functions,  and  the  final  test  was  to  obtain  the  input- 
output  frequency  response  of  the  hand  grasp  system  dynamics  to  estimate  the  transfer 
function  using  spectral  analysis.  Each  test  used  visual  feedback  when  the  users  controlled 
the  grasp  force  and  grasp  position  tracking  of  the  hand.  It  was  shown  in  Ref.  [89]  that 
the  myoelectric  signal  is  not  random  during  the  initial  phase  of  muscle  contraction  thus 
providing  a  means  of  classifying  patterns  from  different  contraction  types.  The  means  is 
to  establish  the  60  records  of  an  isometric  contraction  of  the  subjects  and  then  produce 
some  anisometric  contraction  types,  like  flexion  and  extension.  This  information  was  use¬ 
ful  in  designing  a  new  multi-function  myoelectric  control  system  using  artificial  neural 
networks  (ANN)  for  classifying  myoelectric  patterns.  Additionally,  the  hidden  layer  size, 
segment  length,  and  EMG  electrode  positions  were  studied.  See  related  works  in  Refs. 
[68,  69,  75,  76]  on  multi-functional  myoelectric  control  systems  using  pattern  recognition 
methods  for  myoelectric  signal  extraction  and  classification.  The  control  philosophy  of  a 
multi-fingered  robotic  hands  for  possible  adaptation  and  use  in  prosthetics  and  rehabili¬ 
tation  was  discussed  in  Refs.  [90-92]  with  respect  to  the  Belgrade/USC  robot  hand  [18], 
called  PRESHAPE  (Programmable  Robotic  Experimental  System  for  Hands  and  Prosthet¬ 
ics  Evaluation),  which  can  estimate  a  system  that  translates  task  commands  to  motor 
commands  using  pressure  sensors,  force  sensors  and  pressure  feedback,  which  is  very 
useful  to  detect  small  contact  forces. 

Using  the  dynamic  model  of  the  nonlinear  neuromuscular  (motor  servo)  control  sys¬ 
tem  of  human  finger  muscles  including  mechanical  properties  (such  as  viscoelasticity) 
of  the  muscle  and  stretch  reflex,  a  surface-based  myoelectrically-controlled  biomimetic 
prosthetic  hand  (called  the  Kobe  hand)  with  three  fingers  (thumb,  index  and  middle 
fingers)  was  developed  at  Kobe  University,  Japan  [148]  with  a  system  consisting  of  an 
EMG  signal  processing  unit,  the  dynamic  model,  a  positional  control  unit,  and  the  pros¬ 
thetic  device.  A  survey  of  four  important  properties — dexterity,  equilibrium,  stability, 
and  dynamic  behavior  relating  to  autonomous  multi-fingered  robotic  hands — was  pre¬ 
sented  [178].  An  interesting  aspect  of  this  literature  survey  is  a  series  of  tables  relating  to 
existing  multi-fingered  robotic  hands,  force  closure,  dexterity  in  kinematically  redundant 
robotic  hands,  equilibrium,  in  robotic  grasp,  and  stability.  As  reported  in  Ref.  [15],  an 
intelligent  prosthesis  control  system,  developed  by  Animated  Prosthetics,  consists  of  two 
parts:  the  animation  control  system  (ACS)  residing  in  prosthesis  and  a  remote  prosthe¬ 
sis  configuration  unit  (PCU)  capable  of  on/off  to  variable  speed/grip.  Dynamic  control 
of  two  arms  to  manipulate  cooperatively  an  object  with  rolling  contacts  was  addressed 
[170]  using  a  nonlinear  feedback  control  methodology  that  decouples  and  linearizes  the 
system. 

A  sensory  control  system  based  on  a  force  sensing  resistor  (PSR)  was  developed  [191] 
at  The  National  Institute  for  Accidents  at  Work  (IN AIL),  Bologna,  Italy,  to  control  the 
strength  of  the  grip  on  objects  for  a  commercial  prosthetic  hand  having  two  main  func¬ 
tions:  the  automatic  search  for  contact  with  the  object  and  the  detection  of  the  object 
possibly  slipping  the  grip  by  involuntary  feedback  (force  sensors  and  slipping  sensors). 
Purther,  automatic  tuning  of  control  parameters  of  the  prostheses  was  investigated  [23] 
using  fuzzy  logic  expert  systems  resulting  in  a  software  package  called  the  microproces¬ 
sor  controlled  arm  auto  tuning.  The  automatic  tuning  software  works  as  follows: 

•  the  client  connects  the  prosthesis  hardware 

•  the  program  needs  both  sensor  signals  as  client  input  the  program  combines  the 
above  qualitative  and  quantitative  information  stored  in  the  fuzzy  logic  database  to 
calculate  the  prosthesis  parameter  values 

•  the  program  enables  the  new  parameter  values  to  be  down-loaded  into  the  prosthesis 
control  system  memory. 
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Dynamic  modeling  of  a  robotic  hand  was  proposed  [172]  using  a  hybrid  approach  with 
a  discrete  event  aspect  of  grasping  and  continuous-time  part  with  a  variable  structure 
impedance  control  algorithm.  A  novel  on-line  learning  method  was  reported  in  Ref.  [145] 
for  prosthetic  hand  control  based  on  EMG  measurements  with  a  system  consisting  of 
three  units: 

•  an  analysis  unit  for  generating  feature  vectors  containing  useful  information  for 
discriminating  motions  from  EMG  signals 

•  an  adaptation  unit  for  adapting  to  the  amputee's  individual  variation  and  for  dis¬ 
criminating  motions  from  the  feature  vector  and  at  the  same  time  generating  the 
necessary  control  commands  to  the  prosthetic  hand 

•  a  trainer  unit  for  directing  the  adaptation  unit  to  learn  in  real  time  based  on  the 
amputee's  teaching  signal  and  the  feature  vector. 

In  Ref.  [191]  researchers  built  a  sensory  control  system  based  on  the  force-sensing  resis¬ 
tor  (ESR)  for  an  upper  limb  prosthesis  and  an  optical  sensor  for  detecting  movement.  The 
prostheses  produced  were  of  the  "all  or  nothing"  (opening  or  closing)  and  proportional 
control  type  (the  relationship  between  force  and  EMG  signal  is  linear).  Eor  traditional 
control,  it  used  voluntary  (visual)  feedback,  but  the  users  had  to  pay  close  attention.  This 
work  developed  an  involuntary  feedback  control  that  uses  two  kinds  of  sensors,  strength 
and  slipping  sensors.  If  the  prosthesis  hand  is  slipping,  the  control  system  can  automat¬ 
ically  order  the  actuator  of  the  prosthesis  to  increase  the  grip  strength.  On  receiving  the 
EMG  signal,  the  hand  begins  a  closing  action  and  goes  on  closing  until  the  ESRs  pro¬ 
duce  a  signal  that  is  greater  than  or  equal  to  a  "contact  threshold"  value.  Then  it  stops 
because  the  object  has  been  grasped  with  the  required  strength  of  grip.  The  automatic 
grip  mechanism  is  very  useful  in  grasping  delicate  objects. 

The  investigation  in  Ref.  [130]  showed  that  the  proposed  neuro-fuzzy  classifier  known 
as  Abe-Lan  network,  is  able  to  identify  correctly  all  the  EMG  signals  related  to  different 
movements  of  the  human  hand.  A  highly  anthropomorphic  human  hand,  called  Robo- 
naut  Hand  consisting  of  five  fingers  and  fourteen  independent  degrees  of  freedom,  was 
built  at  NASA  Johnson  Space  Center  to  interface  with  extra-vehicular  activity  (EVA)  crew 
interfaces  onboard  the  International  Space  Station  (ISS)  [124]. 

2000-2007: 

In  Ref.  [190],  estimating  muscular  contraction  levels  of  flexors  and  extensors  using  neu¬ 
ral  networks,  a  new  impedance  control  technique  [83]  was  developed  to  control  impedance 
parameters  such  as  the  moment  of  inertia,  joint  stiffness,  and  viscosity  of  a  skeletal  mus¬ 
cle  model  of  a  prosthetic  hand.  An  overview  of  dextrous  manipulation  gave  [147]  an 
interesting  time-line  chart  for  the  development  of  robotic  dextrous  manipulation  during 
the  period  1960s  to  2000.  An  excellent  survey  [19]  summarizing  the  evolution  and  state 
of  the  art  in  the  robotic  hands  focusing  mainly  on  functional  requirements  of  manipu¬ 
lative  dexterity,  grasp  robustness,  and  human  operability.  Also,  the  work  in  Ref.  [126] 
exploited  the  nonholonomic  character  of  a  pair  of  bodies  with  regular  rigid  surfaces 
rolling  onto  each  other,  to  study  the  constructive  controllability  algorithm  for  planning 
rolling  motions  for  dextrous  robot  hands.  A  control  system  architecture  was  proposed 
[133, 134]  with  a  feedforward  loop  based  on  EMG  measurements  consisting  of  a  low-pass 
filter  and  neural  network  to  provide  the  actual  torque  signal  and  a  feedback  loop  based 
on  the  desired  angle  consisting  of  a  proportional-derivative  (PD)  controller  to  provide 
the  desired  torque  signal  and  the  error  signal  between  these  torques  drives  the  prosthetic 
hand  to  achieve  the  desired  angle  while  the  neural  network  learns  based  on  feedback 
error. 

Peckham  et  al.  [155]  studied  finger  extension,  external  control,  overhead  reach,  and 
forearm  pronation.  Eor  finger  extension,  they  used  two  electrodes:  one  placed  between 
the  2nd  and  3rd  metacarpals  and  the  other  between  the  3rd  and  4th  metacarpals.  They 
could  provide  full  extension  of  the  index,  long,  and  ring  fingers.  Eor  external  control,  a 
new  form  of  control  was  developed  by  using  retained  voluntary  wrist  extension  to  con¬ 
trol  grasp  opening  and  closing.  Overhead  reach  can  be  provided  by  stimulation  of  the 
triceps  muscle,  so  elbow  position  can  be  controlled  by  voluntary  activation  of  biceps  as 
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an  antagonist.  As  for  forearm  pronation,  the  main  issues  are  an  increased  number  of  stim¬ 
ulus  channels  to  allow  stimulation  of  the  finger  intrinsic  muscles,  triceps,  and  forearm 
pronator,  an  implanted  control  source,  bidirectional  communication  between  sensor  and 
body,  reduced  size,  and  reduction  of  all  external  cables.  The  work  in  Ref.  [207]  presents  a 
review  of  the  traditional  methods  for  control  of  artificial  hands  using  EMG  signals  in  both 
clinical  and  research  areas  and  points  out  future  developments  in  the  control  strategy  of 
the  prosthetics,  in  particular  advocating  neuroprosthesis  with  biocompatible  neural  inter¬ 
face  for  providing  sensory  feedback  to  the  user  leading  to  electroneurographic  (ENG) 
based  control  in  place  of  electromyographic  (EMG)  control. 

Collaboration  between  the  University  of  Southampton  and  University  of  New 
Brunswick  (UNB)  [120]  resulted  in  a  hybrid  control  system  using  a  multilayer  perceptron 
(MLP)  artificial  neural  network  as  a  classifier  of  time-domain  features  set  (zero-crossings, 
mean  absolute  value,  mean  absolute  slope,  and  trace  length)  extracted  from  myoelectric 
signals  (MES)  and  a  digital  signal  processor  (DSP)  controlling  the  grip  pressure  of  the 
prosthetic  hand  without  visual  feedback  (voluntary  feedback).  Design  and  development 
of  an  underactuated  (the  number  of  actuators  less  than  the  degrees-of-freedom)  mecha¬ 
nism  applicable  to  prosthetic  hand  was  presented  in  Ref.  [127]  based  on  dynamic  model 
of  fingers  leading  to  adaptive  grasp  (that  is,  being  able  to  conform  to  the  shape  of  an 
object  held  within  the  hand). 

Although  an  adaptive  control  scheme  was  developed  [187]  for  a  Southampton  Hand, 
further  developments  were  made  in  the  research  first  generation  [22,  112]  producing 
their  IP  (intelligent  prosthesis)  according  to  Ref.  [111].  The  investigation  [116]  provided 
an  evolution  of  microprocessor-based  control  systems  for  prosthetics  classified  as  (based 
on  digital  systems),  second  generation  (with  low  power),  and  third  generation  (based 
on  microprocessors  and  digital  signal  processors).  The  work  in  Ref.  [114]  conducted  a 
comparison  of  Oxford  and  Manus  hand  prostheses  with  respect  to: 

1.  hand  mechanisms 

2.  control  electronics:  EMG  analog  amplifiers,  A/D  converters,  digital  signal 
processors 

3.  sensors:  force,  position  and  slip  sensors  based  on  Hall  effect 

4.  manipulation  or  control  schemes:  Oxford  hand  used  Southampton  Adaptive 
Manipulation  Scheme  consisting  of  a  three-level  hierarchical  scheme  and  Manus 
used  a  two-level  scheme. 

The  scheme  suggested  in  Ref.  [30]  consisted  of  five  modules,  including  an  artificial 
muscoskeletal  system,  position  and  force  sensors,  3D  force  sensors,  low-level  control  loop 
dedicated  to  control  slipping  and  grasping,  and  an  EMG  control  unit.  Further,  the  scheme 
used  two  semiconductor  strain  gauges  as  the  force  sensor  and  the  sensor  in  SS496B  by 
Honeywell  International,  Inc.  as  the  position  sensor,  which  is  the  linear  slider  and  small 
magnets.  Moreover,  the  control  system  receives  three  signals:  activation  (EDG  used  to 
identify  whether  there  is  a  movement),  direction  (SGN  decides  opening  or  closing),  and 
amplitude  of  the  movement  (AMP  controls  the  seed  of  the  movement  in  a  proportional 
means).  As  for  the  control  scheme,  it  uses  a  simple  proportional  open-loop  control. 

A  cylindrical  grasp  of  a  cylindrical  object  and  a  parallel  force /position  control  is  stud¬ 
ied  by  [171]  to  ensure  the  stability.  The  work  in  Ref.  [156]  presented  a  feedback  control 
system  for  hand  prosthesis  with  elbow  control.  Using  a  concept  of  extended  physiological 
proprioception  (EPP)  (i.e.,  using  natural  physiological  sensors),  both  the  work  [156]  and 
the  investigation  in  Ref.  [6]  developed  microprocessor-based  controllers  for  upper  limb 
prostheses.  A  systematic  literature  review  [194]  is  useful  for  prosthetic  hand,  although 
the  survey  was  done  for  lower-limb  prosthesis.  Scherillo  et  al.  [171]  developed  a  proce¬ 
dure  to  obtain  maximum  load  and  contact  force  distribution  for  a  given  grasp  task  and 
a  parallel  force /position  control  to  ensure  stability  of  the  grasp.  The  goal  of  this  control 
scheme  is  to  specify  a  set  of  joint  torque  inputs  so  that  the  desired  grasping  forces  along 
the  constrained  directions,  and  the  desired  position  trajectory  along  the  unconstrained 
directions  are  realized. 
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Several  researchers  showed  [9-11]  that  sensory  feedback  signals  are  obtained  for  multi¬ 
fingered  robot  hands  to  perform  the  function  of  grasping  an  object  and  that  dynamic 
force /torque  closure  can  be  constructed  without  knowing  object  kinematic  parameters 
and  location  of  the  mass  center.  Further,  the  convergence  of  motion  of  the  overall  fingers- 
object  system  was  proved  using  the  concepts  of  "stability  and  asymptotic  stability  on 
a  manifold."  Mechanical  design  and  manipulation  (control)  issues  were  addressed  [157] 
for  a  multi-fingered  dextrous  hand  for  upper  limb  prosthetics  using  the  underactuated 
kinematics  enhancing  the  performance  and  providing  four  grasping  modes  (cylindrical, 
precision,  hook,  and  lateral)  with  just  two  actuators,  one  for  the  thumb  and  one  for  the 
remaining  fingers.  In  particular,  the  hierarchical  control  architecture  consists  of  a  host  (or 
master)  controller  for  EMG  management  and  definition  of  grasp  set  points  (for  position 
and  torque /force)  and  three  local  (or  slave)  controllers  for  low-level  implementation  of 
stiffness  control  of  the  joints.  In  Ref.  [205],  design  and  analysis  was  presented  for  a  multi¬ 
fingered  prosthetic  hand  consisting  of  a  thumb  with  three  joints  and  the  rest  of  the  four 
fingers  having  two  joints  using  Haringx  and  element  stiffness  models,  which  enables 
the  location  of  actuators  far  away  from  the  hand  to  a  belt  around  the  waist  and  further 
enabling  actuation  and  control  with  relatively  high  degrees  of  freedom.  Robotic  hand 
MA-I  was  designed  and  built  [182]  at  the  Institute  of  Industrial  and  Control  Engineering 
(IOC)  at  the  Polytechnic  University  of  Catalonia  (UPC)  with  16  degrees  of  freedom  and 
the  control  system  consisting  of  16  position  control  loops,  independently  controlling  each 
of  the  16  DC  motors.  Visual  hand  motion  capture  is  a  multiple-dimension  and  multiple- 
objective  searching  optimization  problem  and  the  work  reported  in  Ref.  [53]  used  pose 
estimation  and  a  motion-tracking  scheme  with  genetic  algorithms  (CA)  embedded  par¬ 
ticle  filter  (PF)  to  navigate  visual  hand  gesture,  such  as  virtual  environment  and  control 
of  a  robot  arm. 

The  fabrication  of  a  compliant,  under-actuated  prosthetic  hand  (both  palm  and  fin¬ 
gers)  molded  as  a  soft  polymeric  single  part  for  providing  adaptive  grasp  was  reported 
[28,  29].  The  analysis  and  synthesis  are  "so  complex  and  only  experimental  analysis  of 
the  solution  adapted  validate  our  works."  It  was  shown  [154]  that  an  object  with  parallel 
surfaces  in  a  horizontal  plane  could  be  controlled  by  a  pair  of  robotic  fingers  to  achieve 
stable  grasping,  angle  and  position  control  without  the  need  for  the  object  parameters  or 
object  sensors  such  as  tactile,  force,  or  visual  sensors. 

At  Northwestern  University  Prosthetics  Laboratory  (NUPL),  the  researchers  [199,  201] 
developed  multi-function  prosthetic  hand/ arm  controller  system  receiving  signals  from 
as  many  as  sixteen  implantable  myoelectric  sensors  (IMES)  and  a  heuristic  fuzzy  logic 
approach  to  EMG  signal  pattern  recognition  [5,  200].  In  particular,  fuzzy  logic  was 
explored  for  discriminating  between  multiple  surface  EMG  control  signals  and  classify¬ 
ing  them  to  user  intention.  The  multi-functional  hand  mechanism  consisted  of  a  three- 
motor  hand  (one  motor  for  driving  the  thumb,  one  motor  for  the  index  finger,  and  the 
third  motor  for  the  middle,  ring  and  little  finger)  and  a  two-motor  wrist  (one  motor 
for  wrist  extension /flexion  and  the  other  motor  for  wrist  rotation).  Further,  the  research 
[72]  demonstrated  that  in  implementing  the  extended  physiological  proprioception  (EPP) 
control  for  a  powered  prosthesis,  the  backlash  is  determined  by  the  stiffness  of  the  con¬ 
trol  cable  as  well  as  mass  located  at  the  distal  end  of  the  forearm  and  that  reduction  of 
static  friction  and  backlash  in  the  system  could  prevent  the  limit  cycle. 

It  was  demonstrated  [60]  that  by  implanting  electrodes  within  individual  fascicles  of 
peripheral  nerve  stumps,  appropriate,  distally  referred  sensory  feedback  about  joint  posi¬ 
tion  and  grip  force  from  an  artificial  arm  could  be  provided  to  an  amputee  through 
stimulation  of  the  severed  peripheral  nerves,  which  also  provide  appropriate  signals.  It  is 
interesting  to  note  [100]  the  mechanism,  design,  and  control  system  of  a  humanoid-type 
hand  with  human-like  manipulation  capabilities  as  a  part  of  the  development  of  service 
robots  and  the  comparison  (shown  by  [101,  158])  of  natural  and  prosthetic  hands.  In 
Ref.  [211],  the  EMG  motion  pattern  classifier  was  developed  using  a  parametric  autore¬ 
gressive  (AR)  model  and  Levenberg-Marquardt  (LM)-based  neural  networks  to  identify 
three  types  of  motion  of  thumb,  index,  and  middle  fingers  to  control  a  five-fingered 
under  actuated  prosthetic  hand. 
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The  work  in  Ref.  [161]  focused  on  the  ''optimal"  delay  as  the  maximum  amount  of 
time  from  command  to  hand  movement,  for  a  prosthesis  controller  with  a  delay  of  200  to 
400  ms  as  the  range  acceptable  by  users.  A  bypass  prosthesis,  called  the  Prosthetic  Hand 
for  Able-Bodied  Subjects  (PHABS),  was  developed  to  allow  able-bodied  subjects  to  oper¬ 
ate  a  prosthetic  terminal  device.  The  controller  is  a  commercially  available  Myo-pulse 
control,  which  combines  pulse  width  modulation  (PWM)  and  pulse  period  modulation 
(PPM)  because  it  provides  a  linear  relation  between  motor  speed  and  the  pulse  width 
and  timing  of  a  digital  control  signal.  In  addition,  it  also  used  a  mechanical  low-pass 
filter  to  smooth  the  pulse  train  and  movement.  If  the  EMG  reaches  the  threshold,  the 
motor  will  be  turned  "on";  otherwise,  it  will  be  turned  "off."  Furthermore,  the  experi¬ 
mental  controller  was  created  in  Matlab's  Simulink  and  executed  using  Simulink's  Real 
Time  and  XPC  Target  Toolboxes.  Finally,  this  work  summarized  seven  time-delay  sources, 
including: 

1.  the  time  from  the  intent  of  movement  to  the  development  of  FMG 

2.  the  time  constant  of  the  analog  filters  contained  in  the  FMG  pre-amplifiers 

3.  the  analog  to  digital  sampling  period 

4.  the  time  required  to  collect  the  EMG  signal  for  feature  extraction 

5.  the  time  required  to  perform  the  EMG  signal  for  feature  extraction 

6.  the  time  required  to  execute  the  pattern  recognition  on  the  extracted  features 

7.  the  time  required  to  actuate  the  component 

In  Ref.  [50],  a  review  of  the  traditional  methods  of  control  as  well  as  the  current  state  of 
new  control  techniques  was  provided.  A  newly  developed  intelligent  flexible  hand  sys¬ 
tem  with  3  fingers  and  10  joints,  fitted  with  a  small  harmonic  drive  gear  and  a  high  power 
mini  actuator,  providing  12  DOF  applied  to  a  catching  task  was  developed  [117].  The 
authors  [212]  developed  an  EMG-based  (using  electrodes  and  torque  and  angle  sensors) 
prosthetic  hand  control  system  composed  of  a  human  operator,  a  five-fingered  under¬ 
actuated  prosthetic  hand  system,  the  prosthetic  hand  controller  (with  analog-to-digital 
converters,  a  digital  signal  processing  (DSP)  board,  and  stepper  motors)  and  visual  feed¬ 
back.  In  particular,  the  EMG  signals  undergo  feature  extraction  and  feature  classification 
using  neural  networks  with  parametric  autoregressive  (AR)  model  and  wavelet  trans¬ 
forms.  In  an  under-actuated  system,  there  is  a  lower  number  of  actuators  compared  to 
the  number  of  degrees-of-freedom  of  the  system.  Further  in  Ref.  [210],  a  hierarchical  con¬ 
trol  system  was  proposed  with  a  high-level  supervisory  controller  for  implementing  the 
EMG  signal  acquisition  and  pattern  recognition  and  also  providing  a  set  of  commands 
(for  operations  such  as  close,  open,  position,  etc.)  to  a  low-level  controller.  A  sensor-based 
hybrid  control  strategy  (using  normal  feedback  control  based  on  EMG  signals  from  sen¬ 
sors  and  feedback  to  the  user)  was  presented  [160]  where  a  digital  controller  operating 
from  prosthetic  signals  converts  the  user  grasping  intention  (EMG  signal)  into  an  order 
to  control  the  prosthesis. 

Choi  et  al.  [44]  investigated  developed  a  robot  hand  with  tactile  sensors  (slip  sensor 
and  force  sensor),  called  SKKU  Hand  II,  having  two  functional  units:  a  polyvinylidene 
fluoride  (PVDF)-based  slip  sensor  designed  to  detect  slippage  and  a  thin  flexible  force 
sensor  that  can  read  the  contact  force  of  and  geometrical  information  on  the  object  using 
a  pressure  variable  resistor  ink.  A  biomechatronic  approach  to  the  design  and  control  of 
an  anthropomorphic  artificial  hand  was  studied  [216]  for  closing  the  hand  finger  while 
grasping  an  object  using  a  reference  trajectory  and  using  two  different  versions  (joint 
space  and  slider  space)  of  proportional-derivative  (PD)  control  system.  In  particular  the 
artificial  hand  consists  of  three  under-actuated  fingers  (index,  middle,  and  thumb),  which 
are  actuated  by  three  cable-driven  DC  motors  placed  in  the  lower  part  of  the  arm. 

Farrell  and  Weir  [71]  studied  large  controller  delays  created  by  multi-functional  pros¬ 
thesis  controllers.  A  device  called  PHABS  (Prosthetic  Hand  for  Able  Bodied  Subjects)  was 
utilized  to  test  the  performance  of  20  able-bodied  subjects  on  the  Box  and  Block  Test. 
To  estimate  and  compare  the  performance  of  prosthetic  hands,  a  functionality  index  has 
been  proposed  [161].  An  underwater  flexible  robot  manipulation  (called  HEU  Hand  II) 
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that  utilized  PBNNIC  (position-based  neural  network  impedance  control)  for  the  force 
tracking  control  was  studied  in  Ref.  [129]. 

This  work  from  [129]  developed  a  dexterous  underwater  robot  hand,  called  the  HEU 
Hand  II.  The  sensor  system  mainly  includes  12  strain  gauges  at  different  locations.  When 
the  robot  hand  is  under  water,  the  control  system  is  more  complicated  because  the  com¬ 
plete  dynamic  model  is  not  known  exactly.  Hence,  the  control  system  considers  the  uncer¬ 
tainty  of  the  robot  dynamic  model.  The  controller  of  the  hand  force  tracking  is  designed 
by  the  PBNNIC  scheme.  Using  biologically-inspired  principles  for  design  and  control  of 
a  bionic  robot  arm  [106],  several  control  approaches  were  presented  such  as  trajectory 
planning  and  optimization  based  on  robot  dynamics. 

An  alternate  learning  control  strategy  was  proposed  [163]  based  on  the  working 
assumptions  that  both  human  motor  commands  and  sensory  information  are  passed 
on  in  a  discrete,  episodic  manner,  quantized  in  time  with  a  learning  algorithm,  called 
S-Iearning,  based  on  sequences  arguing  against  the  traditional  control  approaches  due  to 
the  highly  nonlinear  robot's  dynamics  and  large  number  of  degrees  of  freedom. 

In  the  work  in  Ref.  [206],  the  first  prototype  of  a  five-fingered  prosthetic  hand  fitted 
with  only  3  motors  and  achieving  20  degrees  of  freedom  was  described  using  a  new 
"strings  and  springs"  mechanism  and  a  continuous  wavelet  transform  (CWT)  for  extrac¬ 
tion  of  EMG  inputs  for  a  feed-forward,  back-propagation  neural  network  to  recognize 
the  type  of  grip. 

The  work  in  Ref.  [215]  focuses  on  the  control  system  of  the  hand  and  on  the  opti¬ 
mization  of  the  hand  design.  It  proposes  the  control  action  as  proportional  to  the  super¬ 
ficial  EMG  signals  extracted  by  surface  electrodes  applied  to  a  couple  of  antagonistic 
user's  residual  muscles.  This  work  first  explains  designs  of  the  hand  prototype,  such 
as  biomechatronic  design  approach,  under-actuated  artificial  hand,  3D  CAD  model  (by 
ProEngineer)  and  dynamic  analysis  (by  ANSYS).  Second,  it  builds  the  model  of  control 
system,  including  the  kinetics  and  dynamics  of  hand,  in  PD  control  in  the  joint  space 
and  slider  space  with  elastic  compensation.  Third,  it  validates  and  optimizes  the  hand 
design  in  four  multiple  objective  problems  (or  goals).  The  first  two  goals  are  related  to  the 
closed-loop  control  performance  and  the  remaining  two  goals  are  part  of  joint  trajectories. 
It  develops  the  simulation  in  MATLAB/Simulink.  Pinally,  it  compares  the  experimental 
results  with  the  simulation. 

The  dynamic  system  of  a  nonlinear  flexible  robot  arm  with  a  tip  mass  was  introduced 
in  Ref.  [198].  Here,  the  proposed  intelligent  optimal  controller,  in  which  the  fuzzy  neural 
network  controller  and  robust  controller  were  designed  to  learn  a  nonlinear  function  and 
compensate  the  approximation  errors  respectively,  could  control  the  coupling  of  bending 
vibration  and  torsional  vibration  for  the  periodic  motion.  To  overcome  the  traditional 
fuzzy  logic  difficulties,  such  as  large  rule  bases  and  long  training  times,  researchers 
[17]  proposed  a  self-learning  dynamic  fuzzy  network  (DEN)  with  dynamic  equality  con¬ 
straints  to  speed  up  the  trajectory  calculations  for  intelligent  nonlinear  optimal  control. 
Eor  a  five-finger  under-actuated  prosthetic  hand  with  tendon  transmission,  Cipriani  et  al. 
[46]  presented  a  robust  controller  that  implemented  two  subsequent  and  different  phases, 
including  the  pre-shaping  of  the  hand  and  the  involved  fingers  rapidly  closing  around 
the  object. 

2.3.  Main  Control  Technique  Overview  Since  2007 
2.3.  f.  Hard  Computing  Techniques 

1.  PD  Controller:  Rong  et  al.  [164]  presented  one  kind  of  PD  controller  with  feed¬ 
forward  control  based  on  adaptive  theory  for  2  DOE  direct  driven  robot  with 
uncertain  parameters. 

2.  Adaptive  Controller:  Cai  et  al.  [27]  developed  an  observer  back-stepping  adaptive 
control  scheme  for  a  two-link  manipulator  under  unmeasured  velocity  and  uncer¬ 
tain  environment.  The  adaptive  velocity  observer  was  designed  independently 
from  the  state-feedback  controller  in  order  to  compensate  the  estimation  errors.  Seo 
and  Akella  [175]  derived  the  novel  adaptive  control  solution  involving  a  new  filter 
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design  for  the  regressor  matrix  for  n  DOF  robot  manipulator  systems.  By  develop¬ 
ing  the  Fourier  series  expansion  from  input  reference  signals  of  every  joint,  Liuzzo 
and  Tomei  [122]  designed  a  global  output  error  feedback  adaptive  learning  control 
for  2  DOF  planar  robot  with  uncertain  dynamics.  To  achieve  the  tracking  control 
objective,  Chen  et  al.  [41]  proposed  an  adaptive  sliding-mode  dynamic  controller 
for  wheeled  mobile  robots  with  system  uncertainties  and  disturbances  to  make  the 
real  velocity  of  the  wheeled  mobile  robot  reach  the  desired  velocity  command. 

3.  Robust  Controller:  Because  of  the  visco-elastic  properties  of  manipulator  links, 
Torabi  and  Jahed  [189]  utilized  the  loop-shaping  method,  which  can  decrease  the 
order  of  the  robust  control  model  of  a  single-link  manipulator  examined  in  time 
and  frequency  domains.  To  enhance  control  of  powered  prosthetic  hands,  Engeberg 
and  Meek  [64-67]  proposed  robust  sliding  mode,  back-stepping,  and  hybrid  slid¬ 
ing  mode-back-stepping  (HSMBS)  parallel  force-velocity  controllers  that  enabled 
the  humans  to  more  easily  control  a  fine  object  by  ten  able-bodied  test  subjects. 
Ziaei  et  al.  [214]  developed  the  modeling,  system  identification  adopting  gener¬ 
alized  orthonormal  basis  functions  (GOBFs),  and  robust  position  and  force  con¬ 
trollers  for  single  flexible  link  (SFL)  manipulators  required  to  operate  the  contact 
motion.  Jiang  and  Ge  [97]  transformed  the  nonlinear  kinematic  models  of  3  DOF 
wheels  mobile  robot  with  uncertain  disturbance  into  linear  control  systems  through 
an  approximate  linearization  algorithm  and  then  designed  a  partial  feedback 
robust  controller  through  linear  matrix  inequality  (LMI). 

4.  Optimal  Controller:  Vitiello  et  al.  [196]  synthesized  the  position  controller  and  the 
Kalman  filter  to  perform  the  planar  movements,  such  as  reaching  and  catching, 
of  the  NEURARM  hydraulic  piston  actuation  with  nonlinear  springs  connected  on 
the  cable.  Vrabie  et  al.  [197]  designed  an  online  method  via  a  biological  inspired 
Actor /Critic  structure  to  solve  the  adaptive  optimal  continuous-time  control  prob¬ 
lem  by  the  solution  of  the  algebraic  Riccati  equation  without  using  knowledge  of 
the  system  internal  dynamics.  To  minimize  the  positioning  time  (traveling  between 
two  specific  points)  of  an  under-actuated  2  DOF  robot  manipulator  restricted  to 
the  input  constraint  and  the  structural  parameter  constraint,  Cruz-Villar  et  al.  [52] 
developed  a  concurrent  structure-control  redesign  method  that  combined  the  struc¬ 
tural  parameters  and  a  bang-bang  control  law.  Duchaine  et  al.  [62]  derived  the  posi¬ 
tion  tracking  and  velocity  control,  the  dynamic  model  of  the  robot,  the  prediction 
and  control  horizons,  and  the  constraints  by  a  general  predictive  control  law  and 
also  derived  an  analytical  solution  for  the  optimal  control  by  a  computationally- 
efficient-model-based  predictive  control  scheme  for  a  6  DOF  cable-driven  parallel 
manipulator. 

4.  Hierarchical  Controller:  Fainekos  et  al.  [70]  proposed  a  hierarchical  control  law 
addressing  the  temporal  logic  motion  planning  problem  for  mobile  robots  mod¬ 
eled  by  second  order  dynamics  to  track  a  simpler  kinematic  model  with  a  globally 
bounded  error,  and  then  solved  the  new  robust  temporal  logic  path  planning  prob¬ 
lem  for  the  kinematic  model  using  automata  theory  and  simple  local  vector  fields. 

2.3.2.  Soft  Computing  Techniques 

1.  Fuzzy  Logic:  According  to  the  human  anatomy,  Arslan  et  al.  [13]  developed  the 
biomechanical  model  with  a  tendon  configuration  of  the  3  DOF  index  finger  of  the 
human  hand.  The  fuzzy  sliding  mode  controller  in  which  a  fuzzy  logic  unit  tuned 
the  slope  of  the  sliding  surface  was  introduced  to  generate  the  required  tendon 
forces  during  closing  and  opening  motions. 

2.  Artificial  Neural  Networks:  Onozato  and  Maeda  [149]  utilized  two  neural  net¬ 
works  learning  inverse  kinematic  and  inverse  dynamic  to  control  the  positions  of  2 
DOF  SCARA  robot.  Aggarwal  et  al.  [4]  obtained  the  neural  recordings  from  rhesus 
monkeys  with  three  different  movements,  the  flexion/ extension  of  each  finger,  the 
rotation  of  wrist,  and  dexterous  grasps.  They  also  designed  the  separate  decod¬ 
ing  filters  for  each  movement  by  using  multilayer  feed-forward  artificial  neural 
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network  (ANN)  (implemented  in  real-time  MATLAB/Simulink).  An  online  decen¬ 
tralized  neural  network  control  design  without  deriving  the  dynamic  model  for  a 
class  of  large-scale  uncertain  robot  manipulator  systems  was  proposed  by  Tan  et  al. 
[184].  Kato  et  al.  [104]  expressed  the  reaction  of  brains  to  the  adaptable  prosthetic 
system  for  a  13  DOF  EMG  signal  controlled  prosthetic  hand  with  an  EMG  pattern 
recognition  learning  by  artificial  neural  networks.  In  addition,  functional  magnetic 
resonance  imaging  (f-MRI)  was  used  to  analyze  the  reciprocal  adaptation  between 
the  human  brain  and  the  prosthetic  hand  by  the  plasticity  of  the  motor  and  sensory 
cortex  area  in  brains  based  on  the  variations  in  the  phantom  upper  limb. 

3.  Genetic  Algorithm:  Marcos  et  al.  [54]  proposed  the  closed-loop  pseudo-inverse 
method  with  genetic  algorithms  (CLGA)  to  minimize  the  largest  joint  displacement 
between  two  adjacent  configurations,  the  total  level  of  joint  velocities,  the  joint 
accelerations,  the  total  joint  torque,  and  the  total  joint  power  consumption  for  the 
trajectory  planning  of  3  DOF  redundant  robots.  Kamikawa  and  Maeno  [98]  used  a 
genetic  algorithm  to  optimize  locations  of  pivots  and  grasping  force  and  designed 
one  ultrasonic  motor  to  move  15  compliant  joints  for  an  under-actuated  five-finger 
prosthetic  hand. 

2.3.3.  Hybrid  of  Soft  and  Hard  Computing  Techniques 

1.  FID  Controller  and  Robust  Controller:  Dieulot  and  Colas  [61]  presented  a  case 
study  of  the  design  of  robust  parametric  methods  for  flexible  axes  and  an  heuristic 
initial  tuning  of  the  FID  controller  from  additional  pole  placement  constraints  on 
the  rigid  mode. 

2.  Adaptive  Controller  and  Robust  Controller:  To  implement  the  trajectory  tracking 
mission  under  the  influence  of  unknown  friction  and  uncertainty,  Chen  et  al.  [40] 
utilized  a  composite  tracking  scheme,  including  the  adaptive  friction  estimation  to 
determine  Coulomb  friction,  viscous  friction,  and  the  Stribeck  effect  and  a  robust 
controller  to  enhance  the  overall  stability  and  robustness  for  a  2  DOF  planar  robot 
manipulator. 

3.  Robust  Controller  and  Optimal  Controller:  Huang  et  al.  [87]  designed  the  robust 
control  systems  with  some  uncertainties,  including  the  unknown  payload  and 
unknown  modeling  of  objects,  and  the  unknown  dynamic  parameters,  such  as  the 
performance  index  that  was  optimized  by  the  optimal  control  method  for  the  space 
robot  to  capture  unknown  objects. 

4.  Robust  Controller  and  Fuzzy  Logic:  Tootoonchi  et  al.  [188]  combined  a  robust 
quantitative  feedback  theory  (QFT)  designed  to  follow  the  desired  trajectory  track¬ 
ing  with  the  fuzzy  logic  controller  (FLC)  designed  to  reduce  the  complexities  of 
the  system  dynamics  for  2  DOF  arm  manipulator.  The  control  gain  of  the  sliding 
mode  controller  tuned  according  to  error  states  of  the  system  by  a  fuzzy  controller 
and  a  moving  sliding  surface  whose  slope  is  dynamically  changed  by  a  fuzzy  logic 
algorithm  for  a  3  DOF  spatial  robot  were  presented  by  Yagiz  and  Hacioglu  [204]. 

5.  Robust  Controller  and  Artificial  Neural  Networks:  Siqueira  and  Terra  [180]  devel¬ 
oped  a  neural  network-based  controller  that  approximated  the  uncertain  factors 
of  an  actual  under-actuated  cooperative  manipulator.  They  robustly  controlled  the 
position  and  squeeze  force  errors  between  the  manipulator  end-effectors  and  the 
object,  although  one  joint  was  not  actuated. 

6.  Sliding  Mode  Controller  and  Genetic  Algorithm:  Chen  and  Chang  [42]  utilized 
the  multiple-crossover  genetic  algorithm  to  estimate  the  unknown  system  param¬ 
eters  and  the  sliding  mode  control  method  to  overcome  the  uncertainty  for  a  two- 
link  robot  control. 

7.  Sliding  Mode  Controller  and  Particle  Swarm  Optimization:  Salehi  et  al.  [166] 
used  an  online  particle  swarm  optimization  to  tune  the  parameters  of  sliding  mode 
control  at  the  contact  moments  of  end  effector  and  unknown  environments  for  the 
2  DOF  planar  manipulator. 

8.  Fuzzy  Logic  and  Artificial  Neural  Networks:  Subudhi  and  Morris  [183]  proposed 
a  hybrid  fuzzy  neural  control  (HFNC)  scheme  containing  a  fuzzy  logic  controller 
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and  a  neural  network  controller  to  balance  the  coupling  effects  for  the  multi-link 
flexible  manipulator  with  both  rigid  and  flexible  motions. 

9.  Artificial  Neural  Networks  and  Particle  Swarm  Optimization:  Wen  et  al.  [202] 
addressed  the  hybrid  particle  swarm  optimization  neural  network  (HPSONN)  to 
compute  the  pseudo-inverse  Jacobian  of  2  DOF  planar  manipulator  inverse  kine¬ 
matic  control. 


2.4.  Revolutionary  Prosthesis 

Recently  (see  the  press  releases  [7,  58])  the  Applied  Physics  Laboratory  (APL)  of  Johns 
Hopkins  University  (JHU)  in  Baltomore,  MD,  USA  received  funding  for  the  Revolution¬ 
ary  Prosthesis  2009  program  from  DARPA  (Defense  Advanced  Research  Projects  Agency), 
the  U.S.  Department  of  Defense,  to  ''develop  a  next-generation  mechanical  arm  that 
mimics  the  properties  and  sensory  perception  of  the  real  thing."  The  APL  leads  an  inter¬ 
national  team  of  about  30  organizations  from  Austria,  Canada,  Germany,  Italy,  Sweden, 
and  USA.  The  APL  team  delivered  its  first  DARPA  Limb  Proto  1  (see  Ref.  [8],  which  "is  a 
complete  limb  system  that  also  includes  a  virtual  environment  used  for  patient  training, 
clinical  configuration,  and  to  record  limb  movements  and  control  signals  during  clinical 
investigations"). 

3.  HYBRID  INTELLIGENT  CONTROL  STRATEGIES 

Here  we  present  the  recent  research  activities  on  hybrid  control  strategies  for  a  smart 
prosthetic  hand  conducted  at  Idaho  State  University  (ISU).  The  schematic  diagram  of 
the  work  is  shown  in  Figure  1  (see  Refs.  [120,  160,  212]).  The  overall  system,  in  brief, 
consists  of  electromyographic  (EMG)  signal  acquisition  from  the  user  arm  for  surface 
or  implanted  electrodes  (in  the  implanted  case  we  focus  on  biocompatibility  based  on 
nano-materials  research).  The  EMG  signal  is  then  processed  for  feature  extraction  and 
classification  or  identification  of  EMG  signal  to  correspond  to  different  motions  of  the 
prosthetic  hand.  The  classified  signal  is  then  used  to  control  the  prosthetic  hand  using 
actuators  and  driving  mechanisms.  It  is  to  be  noted  in  this  proposal  that  the  EMG  signal 
extraction  and  identification  and  the  control  algorithm  are  investigated  using  the  fusion 
of  soft  computing  (SC)  and  hard  computing  (HC)  techniques. 

3.1.  Fusion  of  Soft  and  Hard  Computing  Techniques 

Soft  computing  (SC)  or  computational  intelligence  (Cl)  is  an  emerging  field  based  on 
synergy  and  seamless  integration  of  neural  networks  (NN),  fuzzy  logic  (FL),  and  genetic 
algorithms  (GA)  [102].  The  previous  works  on  prosthetic  hands  used  artificial  neural 
networks  [45,  88,  120],  fuzzy  logic  [5,  31,  200],  genetic  algorithms  [73],  etc.  mostly  for 
EMG  signal  classification  for  various  movements  or  functions  of  the  prosthetic  hand. 

In  hybrid  intelligent  control  strategies,  we  look  at  the  integrated  structure  by  blend¬ 
ing  [153,  186]  soft  computing  (SC)  techniques  and  conventional  hard  computing  (HC) 


Figure  1.  Schematic  diagram  of  prosthetic  hand  technology. 


Automatic  Control  Techniques  for  Smart  Prosthetic  Hand  Technology:  An  Overview 


15 


techniques  comprising  optimal  control  [140],  robust  control  [213],  nonlinear  control  [110] 
and/or  adaptive  control  [185]  with  specific  applications  to  prosthetics. 

The  integration  of  SC  and  HC  methodologies  shown  in  Figure  2  has  the  following 
attractive  features  [153,  186]: 

1.  The  methodology  based  on  SC  can  be  used,  in  particular  with  fuzzy  logic,  at  upper 
levels  of  the  overall  mission  where  human  involvement  and  decision  making  is  of 
primary  importance.  Whereas,  the  HC  can  be  used  at  lower  levels  for  accuracy, 
precision,  stability  and  robustness. 

2.  In  another  situation  using  a  hybrid  scheme,  a  neural  network  of  the  SC  is  used 
to  supplement  the  control  provided  by  a  linear,  fixed  gain  controller  for  a  missile 
autopilot. 

3.  Further,  the  SC-based  GA  can  be  used  for  parameter  tuning  of  a  PID  controller  to 
achieve  good  performance  and  robustness  for  a  wide  range  of  operating  conditions. 

4.  The  SC  and  HC  are  potentially  complementary  methodologies. 

5.  The  fusion  could  solve  problems  that  cannot  be  solved  satisfactorily  by  using  either 
methodology  alone. 

6.  Novel  synergetic  combinations  of  SC  and  HC  lead  to  high  performance,  robust, 
autonomous,  and  cost-effective  missions. 

The  research  at  Idaho  State  University  (ISU)  focuses  on  developing  intelligent 
autonomous  strategies  for  EMC  signal  extraction,  analysis,  and  control  of  prosthetics  by 
fusion  of  soft  computing  techniques  comprising  NN,  FL,  and  GA  [141,  153]  and  hard 
computing  (HC)  techniques.  The  proposal  takes  advantage  of  our  in-house  research  expe¬ 
rience  with  problems  in  prosthetics  [20,  63]  in  particular,  and  with  problems  in  biomedical 
engineering  [142,  143]  in  general. 

An  overview  of  nine  papers  was  presented  using  the  techniques  in  industrial  and  engi¬ 
neering  applications  [152].  For  the  fusion  techniques.  Sick  and  Ovaska  [179]  described  a 
multidimensional  categorization  scheme  in  five  aspects:  the  degree  of  interconnection  of 
soft  and  hard  computing  components  (fusion  grade),  the  topology  of  fusion  skills  (fusion 
structure),  the  time  when  fusion  happens  (fusion  time),  the  layer  of  a  system  architecture 
(fusion  level),  and  the  motivation  for  the  application  (fusion  incentive).  Further,  Ovaska 
et  al.  [151]  classified  the  fusion  techniques  into  twelve  main  categories  and  six  supple¬ 
mentary  categories. 


Figure  2.  Principle  behind  fusion  of  soft  and  hard  computing. 
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4.  OVERVIEW  OF  RESEARCH  AT  ISU 

A  chronological  overview  of  the  research  at  Idaho  State  University  is  provided  below. 

A  short  review  by  Lai  et  al.  [115]  notes  the  importance  of  the  biological  interfaces 
between  robotic  implants  and  other  prosthetic  devices  and  notes  an  interdisciplinary 
team  of  biomedical  and  tissue  engineers,  and  biomaterial  and  biomedical  scientists  is 
needed  to  work  together  holistically  and  synergistically. 

In  addressing  the  particle  swarm  optimization  technique,  a  set  of  operators  for  a  Parti¬ 
cle  Swarm  Optimization  (PSO)-based  algorithm  is  investigated  for  the  purpose  of  finding 
optimal  values  for  some  of  the  classical  benchmark  problems.  Particle  swarm  algorithms 
are  implemented  as  mathematical  operators  inspired  by  the  social  behaviors  of  bird  flocks 
and  fish  schools.  In  addition,  particle  swarm  algorithms  utilize  a  small  number  of  rela¬ 
tively  less  complicated  rules  in  response  to  complex  behaviors,  such  that  they  are  compu¬ 
tationally  inexpensive  in  terms  of  memory  requirements  and  processing  time.  In  particle 
swarm  algorithms,  particles  in  a  confeffous  variable  space  are  linked  with  neighbors, 
therefore  the  updated  velocity jnoans^^^;::Uparticles  influence  the  simulation  results.  The 
work  presents  a  statistical  investigation  on  the  velocity  update  rule  for  continuous  vari¬ 
able  PS  algorithm.  In  particular,  the  probability  density  function  influencing  the  particle 
velocity  update  is  investigated  along  with  the  components  used  to  construct  the  updated 
velocity  vector  of  each  particle  within  a  flock.  The  simulation  results  of  several  numerical 
benchmark  examples  indicate  that  a  small  amount  of  negative  velocity  is  necessary  to 
obtain  good  optimal  values  near  global  optimality  [32]. 

A  chronological  overview  of  the  applications  of  control  theory  to  prosthetic  hand  is 
presented  by  Naidu  et  al.  [139]  focusing  on  hard  computing  or  control  techniques,  such 
as  multi-variable  feedback,  optimal,  nonlinear,  adaptive  and  robust,  and  soft  computing 
or  control  techniques,  such  as  artificial  intelligence,  neural  networks,  fuzzy  logic,  genetic 
algorithms,  particle  swarm,  and  on  the  fusion  of  hard  and  soft  control  techniques.  The 
work  [34]  presents  the  PSO  algorithm  for  identifying  the  rupture  force  for  leukocyte 
adhesion  molecules  and  the  problem  of  finding  the  correct  control  parameters  of  a  robotic 
hand.  Other  work  at  ISU  is  the  fusion  of  soft  computing  or  control  technique  of  genetic 
algorithm  (GA)  and  hard  computing  technique  of  proportional  integral  derivative  (PID) 
control  with  application  to  prosthetic  hand.  In  particular,  an  adaptive  neuro-fuzzy  infer¬ 
ence  system  (ANFIS)  is  used  for  inverse  kinematics  of  the  three-link  index  finger,  and 
feedback  linearization  is  used  for  the  dynamics  of  the  hand.  The  GA  is  used  to  find  the 
optimal  parameters  of  the  PID  controller  [35].  An  adaptive  PSO  (APSO)  approach  based 
on  altering  the  maximum  velocity  at  each  iteration  for  two  thirty-dimensional  benchmark 
problems  is  used  [33]. 

A  hybrid  of  a  soft  computing  technique  of  adaptive  neuro-fuzzy  inference  system 
(ANFIS)  and  a  hard  computing  technique  of  adaptive  control  for  a  two-dimensional 
movement  of  a  prosthetic  hand  with  a  thumb  and  index  finger  was  investigated  [38]. 
The  results  of  this  hybrid  controller,  when  compared  with  the  PID  controller  showed 
enhanced  performance.  A  novel  condensed  hybrid  optimization  (CHO)  algorithm  using 
enhanced  continuous  tabu  search  (ECTS)  and  the  PSO  was  examined  [39].  The  proposed 
CHO  algorithm  combines  the  respective  strengths  of  ECTS  and  the  PSO.  In  particular, 
the  ECTS  is  utilized  to  define  smaller  search  spaces  that  are  used  in  a  second  stage  by 
the  basic  PSO  to  find  the  respective  local  optimum.  The  ECTS  covers  the  global  search 
space  by  using  a  TS  concept  called  diversification  and  then  selects  the  most  promising 
areas  in  the  search  space.  Once  the  promising  regions  in  the  search  space  are  defined, 
the  proposed  CHO  algorithm  employs  another  TS  concept  called  intensification  in  order 
to  search  the  promising  area  thoroughly.  The  proposed  CHO  algorithm  is  tested  with 
the  multi-dimensional  Hyperbolic  and  Rosenbrock  problems.  Compared  to  the  other  four 
algorithms,  the  results  indicate  that  the  accuracy  and  effectiveness  of  the  proposed  CHO 
algorithm  were  enhanced.  Another  hybrid  of  a  soft  computing  technique  using  the  ANFIS 
and  a  hard  computing  or  control  technique  using  finite-time  linear  quadratic  optimal 
control  for  a  two-fingered  (thumb  and  index)  prosthetic  hand  was  investigated  [37].  In 
particular,  the  ANFIS  is  used  for  inverse  kinematics,  and  the  optimal  control  is  used 
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to  minimize  tracking  errors  utilizing  feedback  linearized  dynamics.  The  simulations  of 
this  hybrid  controller,  when  compared  with  the  proportional-integral-derivative  (FID) 
controller,  showed  enhanced  performance.  This  work  was  extended  to  a  five-fingered, 
three-dimensional  prosthetic  hand  [36]. 


5.  RECENT  DEVELOPMENTS  IN  NEUROPROSTHETICS 

It  is  worth  noting  some  of  the  recent  developments  in  neuroprosthesis  [85,  84,  144,  176]. 

An  interesting  study  was  made  by  Hart  et  al.  [80]  on  implanted  neuroprostheses 
employing  functional  electric  simulation  (FES)  to  provide  grasp  and  release  to  individ¬ 
uals  with  tetraplegia  and  comparing  three  control  methods  for  shoulder  position,  wrist 
position,  and  myoelectric  wrist  extensors.  To  improve  the  control  of  grasp  strength,  fore¬ 
arm  pronation,  and  elbow  extension  to  people  with  spinal  cord  injury  at  C5  and  C6, 
the  investigation  by  Peckham  et  al.  [155]  developed  an  advanced  neuroprosthesis  that 
includes  implanted  components,  including  a  10-channel  stimulator,  leads,  electrodes,  and 
a  joint  angle  transducer,  and  external  components,  such  as  a  control  unit  and  transmitter- 
receiver  coil. 

A  particularly  interesting  case  was  reported  [48,  78,  150]  regarding  Jesse  Sullivan,  who 
lost  both  arms  in  an  electrical  accident.  He  could  move  his  bionic  arm  with  his  brain — 
basically  rewiring  the  severed  live  nerves  that  control  arm  and  hand  movements  by 
redirecting  the  nerves  to  pectoral  muscles  in  his  chest.  Electrodes  attached  to  the  chest 
muscles  produce  an  electrical  signal  that  controls  the  robotic  arm  depending  upon  the 
nature  of  muscle  movement,  which  in  itself  is  characterized  by  "thinking"  in  the  brain 
what  is  to  be  done  with  arms.  However,  the  demonstrated  bionic  arm  is  only  a  "prototype 
and  for  research  only." 

More  interesting  news  appeared  [47,  82]  regarding  implantation  of  an  electronic  chip 
into  the  brain  of  a  quadripledge  man  to  use  a  computer  to  operate  a  robotic  arm. 

6.  FUTURE  DIRECTIONS 

During  the  last  three  decades,  investigations  have  been  carried  out  on  the  use  of  EMG 
signals  to  develop  a  prosthetic  hand  to  perform  as  many  functions  as  possible.  How¬ 
ever,  the  use  of  EMG  signals  is  limited  in  the  number  of  possible  human-like  functions 
with  as  few  electrodes  as  possible  and  also  for  the  prosthetic  hand  to  ultimately  have 
a  natural  "cosmetic"  appearance.  Further,  the  EMG  signal  cannot  provide  any  kind  of 
feedback  to  the  user  [207].  One  of  several  possible  solutions  to  overcome  the  limitations 
of  surface-based  EMG  approach  is  neuroprosthesis.  Here,  we  use  an  interface  between 
the  peripheral  nervous  system  (PNS)  and  the  "natural"  neural  interface  to  extract,  record, 
and  simulate  the  PNS  in  a  selective  way.  Further,  advances  in  biocompatible  neural  inter¬ 
faces  can  provide  some  sensory  feedback  to  the  user  by  stimulating  the  afferent  nerves 
and  allowing  motor  control  of  the  prosthesis  leading  to  a  "natural"  EMG-based  control. 
Based  on  this,  two  possible  ways  of  controlling  prosthetic  hands  are  the  simple  and  non- 
intrusive  EMG-based  control  and  the  more  complicated,  implantable  EMG-based  control. 

In  a  recent  conference  of  the  National  Academies  Keck  Futures  Initiative,  "Smart  Pros¬ 
thetics:  Exploring  Assistive  Devices  for  Body  and  Mind,"  [12],  it  was  pointed  out,  "We 
can  make  smarter  prostheses  when  we  are  smarter  in  integrating  state-of-the-art  neuro¬ 
science  with  state-of-the-art  engineering,  medicine,  and  social  science." 
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Abstract:  An  adaptive  control  strategy  for  the  14  degrees  of  freedom  (DDEs),  five-fingered  smart  prosthetic  hand 
with  unknown  mass  and  inertia  of  all  the  fingers  is  developed  in  this  work.  In  modeling,  the  various  links  used 
for  the  five  fingers  of  the  prosthetic  hand  are  shown.  A  cubic  polynomial  for  the  trajectory  planning  is  used.  In 
particular,  using  a  desired  orientation  for  three-link  fingers,  the  forward  and  inverse  kinematics  of  the  prosthetic 
hand  system  regarding  the  analytical  solutions  between  the  angular  positions  of  joints  and  the  positions  and  ori¬ 
entations  of  the  end-effectors  (fingertips)  have  been  obtained.  The  simulations  of  the  resulting  adaptive  controller 
with  five-fingered  prosthetic  hand  show  enhanced  performance. 

Key-Words:  adaptive  control,  prosthetic  hand,  hard  control,  five  finger  hand,  feedback  linearization,  trajectory 
planning 


1  Introduction 

Due  to  the  extreme  complexity  of  human  hand  that 
has  27  bones,  controlled  by  about  38  muscles  to  pro¬ 
vide  the  hand  with  22  degrees  of  freedom  (DDEs), 
and  incorporates  about  17,000  tactile  units  of  4  dif¬ 
ferent  units,  reproducing  the  human  hand  in  all  its 
various  functions  and  appearance  is  still  a  challeng¬ 
ing  task  [1].  Prosthetic  hands  have  been  built  to  re¬ 
place  human  hands  that  can  fully  operate  the  various 
motions,  such  as  holding,  moving,  grasping,  lifting, 
twisting  and  so  on  [1-6].  However,  about  35%  of  the 
users  do  not  regularly  use  their  prosthetic  hands  be¬ 
cause  of  several  reasons,  including  poor  functionality 
of  the  presently  available  prosthetic  hands  and  psy¬ 
chological  problems.  Thus,  designing  and  developing 
an  artificial  hand  which  can  “mimic  the  human  hand 
as  closely  as  possible”  both  in  functionality  and  ap¬ 
pearance  can  overcome  these  problems. 

Hard  computing/control  (HC)  techniques  are 
used  at  lower  levels  for  accuracy,  precision,  sta¬ 
bility  and  robustness.  HC  comprises  proportional- 
derivative  (PD)  control  [7],  proportional-integral- 
derivative  (PID)  control  [8-11],  optimal  control  [9, 
12-14],  adaptive  control  [15-17],  robust  control  [18], 
etc.  with  specific  applications  to  prosthetic  devices. 
However,  our  previous  work  [16]  for  a  two-fingered 
(thumb  and  index  finger)  prosthetic  hand  showed  that 


adaptive  controller  can  overcome  overshooting  and 
oscillation.  However,  a  five-fingered  prosthetic  hand 
with  adaptive  control  technique  has  not  been  devel¬ 
oped  yet. 

In  this  work,  we  first  describe  briefly  the  trajec¬ 
tory  planning  problem,  human  hand  anatomy  and  the 
inverse  kinematics  for  two-link  thumb  and  the  remain¬ 
ing  three-link  fingers  (index,  middle,  ring  and  little). 
Next,  the  dynamics  of  the  prosthetic  hand  is  derived 
and  feedback  linearization  technique  is  used  to  ob¬ 
tain  linear  tracking  error  dynamics.  Then  the  adap¬ 
tive  controller  is  designed  to  minimize  the  tracking  er¬ 
ror.  The  simulation  results  show  that  the  five-fingered 
prosthetic  hand  with  the  proposed  adaptive  controller 
can  grasp  an  object  without  overshooting  and  oscilla¬ 
tion.  The  last  section  provides  conclusions  and  future 
work. 


2  Modeling 

2.1  Human  Hand  Anatomy 

Eigure  1  (a)  shows  a  normal  human  hand  composed  of 
thumb  (f),  index  (i),  middle  (m),  ring  (r),  little  (/)  fin¬ 
gers  and  palm.  The  wrist  is  located  between  the  fore¬ 
arm  and  the  hand  and  consists  of  eight  carpal  bones 
organized  in  two  rows  of  proximal  (movable)  and  dis- 
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(a)  Physical  Appearance  of  Right  Hand 
(Anterior  View) 


S:  Scaphoid  bone 
Carpals  Lunate  bone 

(proximal  row)  T:  Triquetrum  bone 
P:  Pisiform  bone 


T:  Trapezium  bone 
T:  Trapezoid  bone  Carpals 
C:  Capitate  bone  (distal  row) 
H\  Hamate  bone 


Carpals 


Metacarpals 


Proximal  phalanges 


Middle  phalanges 


Distal  phalanges 


(b)  Bones  of  Left  Hand  (Posterior  View) 


Figure  1 :  Human  Wrist  and  Hand:  (a)  Physical  Ap¬ 
pearance  of  Right  Hand  (Anterior  View):  A  human 
hand  has  thumb,  index,  middle,  ring  and  little  fingers, 
palm  and  wrist,  (b)  Bones  of  Left  Hand  (Posterior 
View):  A  human  hand  has  27  bones,  including  5  distal 
phalanges,  4  middle  phalanges,  5  proximal  phalanges, 
5  metacarpals  and  8  carpals. 


tal  (immovable)  carpal  bones  as  shown  in  Figure  1  (b) 
[19].  The  proximal  row  (top)  of  carpal  bones  from  lat¬ 
eral  to  medial  is  the  Scaphoid,  Lunate,  Triquetrum  and 
Pisiform;  the  distal  row  (bottom)  of  carpal  bones  from 
medial  to  lateral  has  the  Hamate,  Capitate,  Trape¬ 
zoid  and  Trapezium.  The  hand  is  composed  of  five 
Metacarpals  and  five  Digits.  The  metacarpals  produce 
a  curve,  so  the  palm  is  concave  in  the  resting  position. 
The  five  digits  contain  one  thumb  (t)  and  four  fingers, 
e.g.  index  (i),  middle  (m),  ring  (r),  and  little  (/)  fin¬ 
gers,  respectively.  The  thumb  has  two  bones.  Proxi¬ 
mal  phalanx  and  Distal  phalanx.  Each  finger  consists 
of  three  bones.  Proximal  phalanx.  Middle  phalanx  and 
Distal  phalanx.  In  this  work,  we  assumed  that  the 
palm  is  fixed,  the  thumb  has  two  links  (proximal  pha¬ 


lanx  and  distal  phalanx),  and  each  finger  has  three 
links  (proximal  phalanx,  middle  phalanx  and  distal 
phalanx). 

Synovial  joints  are  formed  at  the  surface  of  rela¬ 
tive  motion  between  two  bones.  The  joints  of  thumb 
and  four  fingers  contain  two  saddle-shaped  articulat¬ 
ing  surfaces  between  two  bones  and  can  be  classi¬ 
fied  as  saddle  joints.  Index,  middle,  ring,  and  lit¬ 
tle  fingers  include  three  revolute  joints  in  order  to  do 
the  angular  movements  (Figure  1  (b)).  Metacarpal- 
phalangeal  (MCP)  joint  is  located  between  metacarpal 
and  proximal  phalange  bones;  proximal  and  dis¬ 
tal  interphalangeal  (PIP  and  DIP)  joints  separate 
the  phalangeal  bones.  Thumb  contains  metacarpal- 
phalangeal  (MCP)  and  interphalangeal  (IP)  joints 
[19].  For  a  human  hand,  each  finger  has  4  DOFs  (2 
at  MCP  joint,  1  at  PIP  joint  and  1  at  DIP  joint),  thumb 
has  3  DOFs  (2  at  MCP  joint  and  1  at  IP  joint),  wrist 
has  2  DOFs  and  carpometacarpal  (CMC)  joint  has  2 
DOFs.  In  this  work,  we  model  14  DOFs,  five-fingered 
prosthetic  hand  with  two-link  thumb  and  remaining 
three-link  fingers.  and  ^3  (j  —  i,  m,  r  and  1) 

represent  the  angular  positions  (or  joint  angles)  of  the 
first  joint  MCP^,  the  second  joint  PIP^  and  the  third 
joint  DIP^  of  index,  middle,  ring  and  little  fingers,  re¬ 
spectively;  ql  and  q^  are  the  angular  positions  of  the 
first  joint  MCP^  and  the  second  joint  of  thumb  (t), 
respectively. 


2.2  Trajectory  Planning 

The  trajectory  planning  using  cubic  polynomial  for 
fingertip  position  control  was  discussed  in  our  previ¬ 
ous  work  [5,7,8, 13, 16]  for  a  two-fingered  (thumb  and 
index  finger)  smart  prosthetic  hand.  For  three-link  fin¬ 
gers,  we  present  the  same  technique  for  fingertip  ori¬ 
entation  control.  A  time  history  of  desired  (d)  finger¬ 
tip  orientation  (0)  and  its  differentiation  (0  and  0)  is 
given  as 


m 

=  UJq  +  UJit  +  6(^2^^  ^3^^ 5 

(1) 

m 

=  IjJi  2iljJ2t  ^ 

(2) 

m 

=  2(jJ2  + 

(3) 

where  (jUo-cjs  are  undetermined  constants  and  the  su¬ 
perscript  j  indicates  the  index  of  each  finger  {j  —  i, 
m,  r  and  /).  The  relations  (1)  and  (2)  need  to  sat¬ 
isfy  the  constraint  conditions  at  initial  time  f  0  and  final 
time  tf.  This  can  be  written  as 

T  n  =  (4) 
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Here,  the  matrices  T,  ft,  and  $  are 


■  1 

to 

4  ■ 

T  = 

0 

1 

1 

tf 

2fo 

V 

34 

_  0 

1 

2tf 

3t}\ 

Q,  =  [ 

LOq 

OJl 

U02 

CVS  ]' 

$  = 

Xo 

1 - 1 

(5) 

(6) 
(7) 


Therefore,  the  4  unknown  constants,  c<;o-^3,  can  be 
computed  by  The  notation  '  means  the 

transpose. 


2.3  Kinematics 

Kinematics  is  the  study  of  geometry  in  motion  and 
is  restricted  to  a  natural  geometrical  description  of 
motion  by  the  manners,  including  positions,  orienta¬ 
tions,  and  their  derivatives  (velocities  and  accelera¬ 
tions)  [20,  21].  Forward  and  inverse  kinematics  of 
articulated  systems  study  the  analytical  relationship 
between  the  angular  positions  of  joints  and  the  posi¬ 
tions  and  orientations  of  the  end-effectors  (fingertips). 
A  desired  trajectory  is  usually  specified  in  Cartesian 
space  and  the  trajectory  controller  is  easily  performed 
in  the  joint  space.  Hence,  conversion  of  Cartesian  tra¬ 
jectory  planning  to  the  joint  space  [21]  is  necessary. 
Using  inverse  kinematics,  the  joint  angular  positions 
of  each  finger  need  to  be  obtained  from  the  known 
fingertip  positions.  Then  the  angular  velocities  and 
angular  accelerations  of  joints  can  be  obtained  from 
the  linear  and  angular  velocities  and  accelerations  of 
fingertips  by  differential  kinematics.  The  kinematic 
descriptions  of  prosthetic  hands  are  used  to  derive 
the  fundamental  equations  for  dynamics  and  control 
purposes.  The  following  subsections  introduce  for¬ 
ward  and  inverse  kinematics  for  the  two-link  thumb 
and  the  remaining  three-link  fingers  and  then  three- 
dimensional  five-fingered  prosthetic  hand  will  be  de¬ 
scribed  [5,7,8, 13, 16]. 


2.3.1  Forward  Kinematics 

Figure  2  shows  the  illustration  of  two-link  thumb.  L\ 
and  L2  the  lengths  of  the  links  1  and  2  of  the 
thumb  (f),  respectively;  q{  and  are  the  angular  posi¬ 
tions  (or  called  angles)  of  joints  1  and  2  of  the  thumb. 
Using  Denavit-Hartenberg  (DH)  method  [20-23],  the 
fingertip  coordinate  P^(X^y^)  of  the  thumb  can  be 
obtained  by  DH  transformation  matrices.  The  finger¬ 
tip  coordinate  P^(X^y^)  of  the  thumb  (t)  and  the  ori¬ 


Figure  2:  Two-Link  Thumb  Illustration:  The  fingertip 
coordinate  can  be  derived  by  forward  kine¬ 

matics.  L\  and  L2  are  the  lengths  of  the  links  1  and  2, 
respectively;  q\  and  q^  are  the  angles  of  joints  1  and 
2;  tI  and  are  the  torques  of  the  joints  1  and  2. 


entation  of  the  fingertip  frame  can  be  described  as 

X*  =  L\  cos{q\)  +  Ll  cos{q\  +  ql), 

Y*  =  L\  sin(gi)  +  sin(gi  +  ql), 

0*  =  oi  +  ql-  (^) 

Figure  3  shows  the  illustration  of  three-link  index  fin- 


Figure  3:  Three-Link  Index  Finger  Illustration:  The 
fingertip  coordinate  (X\Y^)  can  be  obtained  by  for¬ 
ward  kinematics.  L\,  L^,  and  L\  are  the  lengths  of 
the  links  1,  2,  and  3,  respectively;  q\,  q^,  and  q\  are 
the  angles  of  the  joints  1,  2,  and  3;  t|,  and  T3  are 
the  torques  of  the  joints  1,  2,  and  3. 

ger.  L\,  L2,  and  L\  are  the  lengths  of  the  links  1,  2 
and  3  of  the  index  finger  (i),  respectively;  q\,  q^,  and 
q\  are  the  angles  of  the  joints  1,  2,  and  3  of  the  index 
finger.  Similarly,  using  DH  method,  the  fingertip  co¬ 
ordinate  P^(X\y^)  and  the  orientation  of  the  index 
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finger  (i)  can  be  written  as 


Accordingly,  the  angles  and  can  be  gained  as 


X*  =  LI  cos(ql)  +  L*2  cos(ql  +  q^) 

+L3  cos(gi  +  (Z2  +  'Za)) 
y*  =  L\  sin(gi)  +  sin(gi  +  q^) 

+L3  sin(gi  +  q2  + 

f  =  qi  +  qi  +  ql  (9) 


2.3.2  Inverse  Kinematics 

The  joint  angular  positions  of  each  finger  can  be  de¬ 
duced  as  following.  The  sum  of  squared  (8)  is  written 
as 

Xt2  ^  ^*2  ^  2  ^  2  ^  cos{ql).  (10) 

Rearranging  (10),  we  can  get  the  equation  below. 


-  Lismjqi)  \ 

Ui  +  4cos(Q*)T 


Then,  by  the  summation  of  (14),  the  angle  q\  of  the 
joint  1  can  be  determined  as 


Hence,  the  expression  of  the  joint  angles  and  ql  of 
the  thumb  is  given  in  (12)  and  (15),  respectively. 

The  local  coordinate  of  the  joint  2  of 

the  index  finger  can  be  obtained  as 


cos{ql)  = 


-  Lf  - 


2L\L\ 


(11) 


Choosing  the  elbow  up  configuration,  the  angle  q^  of 
the  joint  2  can  be  obtained  from 


t  -1  ( +  r*"  -  L\^ 

ql^  -  cos  - 


2L\L% 


(12) 


Notice  that  in  this  paper,  all  positive  angles  are  de¬ 
fined  counterclockwise.  When  choosing  the  elbow  up 
configuration,  the  angle  q^  is  clockwise,  so  the  sign  of 
^2  is  negative.  Figure  4  is  the  geometric  illustration  of 


-  L\  L\  sin(0^).  (16) 


Choosing  the  elbow  down  configuration,  the  angles  q^ 
and  q\  can  be  obtained  as 


^2  = 


.-1 


X^ 


-1  /  Y^ 
Ql  =  tan  (  — 


tan 


-1 


_  ri^  _  Ti‘^^ 
■  1 2  -L^i  1^2 


2L\L2  j 

L\  sin(g^) 

L\  +  cos  (4) , 


(17) 


Then  we  can  get  the  angle  q\  of  the  joint  3  as 


(18) 


The  orientation  can  be  designed  by  trajectory  plan¬ 
ning  in  Section  2.2. 

For  the  five-fingered  hand  shown  in  Figure  5,  X^, 
,  and  are  the  three  axes  of  the  global  coordi¬ 
nate.  The  local  coordinate  x^-y^-z^  of  thumb  can  be 
reached  by  rotating  through  angles  a  and  (3io  and 
of  the  global  coordinate,  subsequently.  The  local 
coordinate  of  index  finger  can  be  obtained  by 

rotating  through  angle  cr  to  X^  and  then  translating 
the  vector  of  the  global  coordinate;  similarly,  the 
local  coordinate  xYyY^^  of  middle  finger  (j  =  m), 
ring  finger  (j  =  r),  and  little  finger  (j  =  1)  can  be 
obtained  by  rotating  through  angle  cr  to  X^  and  then 
translating  the  vector  (j  =  m,r  and  1)  of  the  global 
coordinate. 


Figure  4:  Geometric  Illustration  of  Two-Link  Thumb 

two-link  thumb  (elbow  up).  Based  on  the  geometry, 
we  can  get  two  triangular  relations  below 


2.4  Dynamics  of  Hand 

The  dynamic  equations  of  hand  motion  are  derived  via 
Lagrangian  approach  using  kinetic  energy  and  poten¬ 
tial  energy  as  [5,15,20,21,23] 


tan  [X)  =  — ,  tan  (/3^)  = 


^2  sin(92)  (... 

L\  +  L\  cos  {qW^ 


A.  ^  - 

(it  ^ 


(19) 
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Figure  5:  Relationship  between  Global  Coordinate 
and  Local  Coordinates:  Local  coordinate  x^-y^-z^  of 
thumb  can  be  reached  by  rotating  through  angles  a 
and  /?  to  and  of  global  coordinate,  subse¬ 
quently.  Local  coordinate  x'^-y'^-z'^  of  index  finger  can 
be  obtained  by  rotating  through  angle  a  to  and 
then  translating  a  vector  of  the  global  coordinate. 


where  C  is  the  Lagrangian;  q  and  q  represent  the  an¬ 
gular  velocities  and  angle  vectors  of  joints,  respec¬ 
tively;  T  is  the  given  torque  vector  at  joints.  The  La¬ 
grangian  C  can  be  expressed  as 

C^T-V,  (20) 

where  T  and  V  denote  kinetic  and  potential  ener¬ 
gies,  respectively.  Substituting  (20)  into  (19),  dy¬ 
namic  equations  of  thumb  can  be  obtained  as  below. 

M(q)q+C(q,q)  +  G(q)  =T,  (21) 

where  M(q)  is  the  inertia  matrix;  C(q,  q)  is  the  Cori¬ 
olis/centripetal  vector  and  G(q)  is  the  gravity  vector. 
(21)  can  be  also  written  as 

M(q)q  +  N(q,  q)  =  T,  (22) 

where  N(q,  q)  =  C(q,  q)  -h  G(q)  represents  non¬ 
linear  terms.  The  dynamic  relations  for  the  two-link 
thumb  and  the  three-link  index  finger  are  described  in 
Appendix  A  [5, 24, 25]. 


3  Control  Techniques 


the  joints  as 


x(i)  =  [q'(i)  q'(i)]'-  (23) 

q'(f)  and  q'(f)  are  the  transpose  vectors  of  q(f)  and 
q(f),  respectively.  Let  us  repeat  the  dynamical  model 
and  rewrite  (22)  as 


^q(t)  =  -M  ^(q(t))  [N(q(t),q(t))  -  T{t)] .  (24) 


Thus,  from  (23)  and  (24),  we  can  derive  a  linear  sys¬ 
tem  in  Brunovsky  canonical  form  as 


±{t)  = 


0  I 
0  0 


x(t)  + 


(25) 


with  its  control  input  vector  given  by 
u{t)  =  -M“^(q(t))  [N(q(t),q(t))  -  T(t)] .  (26) 


Let  us  suppose  the  prosthetic  hand  is  required  to  track 
the  desired  trajectory  c[d{t)  described  under  path  gen¬ 
eration  or  tracking.  Then,  the  tracking  error  e{t)  is 
defined  as 


e{t)  ^  q.d{t)  -  q.{t).  (27) 

Here,  q,d{t)  is  the  desired  angle  vector  of  joints  and 
can  be  obtained  by  trajectory  planning  [5,7, 8, 13, 16]; 
q(f)  is  the  actual  angle  vector  of  joints.  Differentiat¬ 
ing  (27)  twice,  to  get 

e(t)  =  qd(t)  -  q(t),  e(f)  =  qd(f)  -  q(f).  (28) 

Substituting  (24)  into  (28)  yields 

e(t)  =  qd(t)  +  M“^(q(t))  [N(q(t),q(t))  -  T{t)]  (29) 

from  which  the  control  function  can  be  defined  as 

u(t)  =  qd(t)  +M“^(q(t))  [N(q(t),q(t))  -T{t)] .  (30) 

This  is  often  called  tho  feedback  linearization  control 
law,  which  can  also  be  inverted  to  express  it  as 

T{t)  =  M(q(f))  [qd(f)  -  u(f))  +  N(q(f),q(f)]  .(31) 

Using  the  relations  (28)  and  (30),  and  defining  state 
vector  x(f)  =  Ihe  tracking  error  dy¬ 

namics  can  be  written  as 


3.1  Feedback  Linearization 

The  nonlinear  dynamics  represented  by  (22)  is  to 
be  converted  into  a  linear  state-variable  system  us¬ 
ing  feedback  linearization  technique  [15].  Alterna¬ 
tive  state-space  equations  of  the  dynamics  can  be  ob¬ 
tained  by  defining  the  position/velocity  state  x(f)  of 


x(f)  = 


0  I 
0  0 


x(f)  + 


0 

I 


u{t). 


(32) 


Note  that  this  is  in  the  form  of  a  linear  system  such  as 
x(f)  =  Ax(f)  -h  Bu(f).  (33) 
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3.2  Adaptive  Control  Technique 

The  tracking  error  e{t)  and  the  filtered  tracking  error 
r(t)  are  defined  as 

e{t)  =  qd{t)  -  q(t),  (34) 

r{t)  =  e{t)  +  Ae{t).  (35) 

Here,  c[d{t)  is  the  desired  angle  vector  of  joints; 
q(f)  is  the  actual  angle  vector  of  joints;  A  = 
diag{\i^  A2, . . \n)  is  the  positive-definite  diagonal 
gain  matrix.  The  filtered  error  (35)  ensures  stability 
of  the  overall  system  so  that  the  tracking  error  (34) 
is  bounded.  Figure  6  shows  the  block  diagram  of  the 
adaptive  controller.  Here,  the  filtered  signal  r(f)  is 
derived  from  the  tracking  error  e(f)  and  the  trajec¬ 
tory  planner  and  is  fed  to  the  adaptive  controller  of 
the  prosthetic  hand.  Differentiating  and  substituting 


Figure  6:  Block  Diagram  of  the  Adaptive  Controller 
for  a  Five-Fingered  Prosthetic  Hand:  Tracking  errors 
e(f)  are  calculated  by  actual  angles  q(f)  and  desired 
angles  q(i(f),  which  are  based  on  trajectory  planner. 
Then  filtered  tracking  errors  r{t)  are  computed  by  er¬ 
ror  changes  and  the  parameters  A  multiplying  errors. 
The  required  torque  T{t)  of  the  prosthetic  hand  non¬ 
linear  system  is  computed  by  the  nonlinear  term  f  (t) 
and  the  gain  Kd  multiplying  the  filtered  tracking  er¬ 
rors. 

(35)  into  (21)  gives  the  dynamic  equation  in  terms  of 
the  filtered  error  r(f)  as 

M(q(t))f(t)  =  -C^(q(t),q(t))r(t)  +f(t)  -  T(t),  (36) 

where  C(q(f),q(f))  =  C^(q(t),q(t))q(t)  and  the 
nonlinear  term  f  (t)  can  be  defined  as 

f(f)  =  M(q(f))(qc^(f)  -h  Ae(f))  -h  G(q(f))  -h 

+  Ae{t))  +  Tdis, 

=  Ytt.  (37) 


Here,  Tdis  is  the  unknown  disturbance.  Y  is  a  regres¬ 
sion  matrix  of  known  robot  functions  and  tt  is  a  vector 
of  unknown  parameters  [26].  The  regression  matrix 
Y  and  the  unknown  parameter  vector  tt  of  two-link 
thumb  and  three-link  index  finger  are  given  in  Ap¬ 
pendix  B  [5].  Thetorque  vector  T(f)  can  be  calculated 
by 

r(f)  =  f(f)  -h  Kr>r{t).  (38) 

The  unknown  parameter  rate  vector  tt  can  be  updated 
by 

TT  =  T-^Y'r{t)  (39) 

where  F  is  a  tuning  parameter  diagonal  matrix. 


4  Simulation  Results  and  Discussion 

Figure  7  shows  that  five-fingered  prosthetic  hand  with 


Figure  7:  Five-Fingered  Prosthetic  Hand  Grasping  a 
Rectangular  Object 

14  DOFs  is  reaching  a  rectangular  rod  in  order  to 
grasp  the  object.  When  thumb  and  the  other  four  fin¬ 
gers  are  performing  extension/flexion  movements,  the 
workspace  of  fingertips  is  restricted  to  the  maximum 
angles  of  joints.  Referring  to  inverse  kinematics,  the 
first  and  second  joint  angles  of  the  thumb  fingertip  are 
constrained  in  the  ranges  of  [0,90]  and  [-80,0]  (de¬ 
grees).  The  first,  second,  and  third  joint  angles  of 
the  other  four  fingers  are  constrained  in  the  ranges  of 
[0,90],  [0,110]  and  [0,80]  (degrees),  respectively  [27]. 

Next,  we  present  simulations  with  an  adap¬ 
tive  controller  for  the  14  DOFs  five-fingered  smart 
prosthetic  hand.  The  parameters  of  the  two-link 
thumb/three-link  fingers  [28]  were  related  to  desired 
trajectory.  All  parameters  of  the  smart  prosthetic  hand 
selected  for  the  simulations  are  given  in  Table  1  and 
the  side  length  and  length  of  the  target  rectangular  rod 
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are  0.010  and  0.100  (m),  respectively.  All  initial  ac¬ 
tual  angles  are  zero.  The  relating  parameters  between 
the  global  coordinate  and  the  local  coordinates  are  de¬ 
fined  in  Table  2.  Besides,  in  this  work,  we  assumed 


Table  1 :  Parameter  Selection  of  the  Smart  Hand 


Parameters 

Values 

Thumb 

Time  (to, i/)* 

0,  20  (sec) 

Desired  Initial  Position** 

0.035,  0.060  (m) 

Desired  Final  Position** 

0.0495, 0.060  (m) 

Desired  Initial  Velocity* 

0,  0  (m/s) 

Desired  Final  Velocity* 

0,  0  (m/s) 

Length 

0.04,  0.04  (m) 

Index  Finger 

Desired  Initial  Position** 

0.065,  0.080  (m) 

Desired  Final  Position** 

0.010, 0.060  (m) 

Desired  Initial  00*** 

75  (deg) 

Desired  Final  0j*** 

160  (deg) 

Desired  Initial  0o*** 

0  (m/s) 

Desired  Final  0j*** 

0  (m/s) 

Length 

0.04,  0.04, 0.03  (m) 

Middle  Finger 

Desired  Initial  Position** 

0.065,  0.080  (m) 

Desired  Final  Position** 

0.005,  0.060  (m) 

Length 

0.04,  0.04, 0.03  (m) 

Ring  Finger 

Desired  Initial  Position** 

0.065,  0.080  (m) 

Desired  Final  Position** 

0.010, 0.060  (m) 

Length 

0.04,  0.04, 0.03  (m) 

Little  Finger 

Desired  Initial  Position** 

0.055,  0.080  (m) 

Desired  Final  Position** 

0.020,  0.060  (m) 

Length 

0.04,  0.04, 0.03  (m) 

*A11  fingers  use  same  parameters 
**Local  coordinates 

***  All  3-link  fingers  use  same  parameters 


that  each  link  of  all  fingers  is  a  circular  cylinder  with 
the  radius  (R)  0.010  (m),  so  the  inertia  of  each 
link  k  of  all  fingers  j  (=  f,  i,  m,  r  and  1)  can  be  cal¬ 
culated  as 

(40) 

Figure  8,  Figure  10,  Figure  12,  Figure  14  and 
Figure  16  show  the  tracking  errors  of  thumb,  index, 
middle,  ring,  and  little  fingers  for  the  proposed  five¬ 
fingered  smart  prosthetic  hand,  respectively.  Figure  9, 
Figure  11,  Figure  13,  Figure  15  and  Figure  17  show 
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Table  2:  Parameter  Selection  of  the  Conversion  from 
Global  to  Local  Coordinates 


Parameters 

Values 

Rotating  a 

90  (deg) 

Rotating  f3 

45  (deg) 

Translating 

(0.035,  0, 0)  (m) 

Translating 

(0.040, 0,  -0.020)  (m) 

Translating  d^ 

(0.035, 0,  -0.040)  (m) 

Translating  d^ 

(0.025, 0,  -0.060)  (m) 

the  desired/actual  angles  of  thumb,  index,  middle, 
ring,  and  little  fingers  for  the  proposed  five-fingered 
smart  prosthetic  hand,  respectively.  The  observation 
that  all  tracking  errors  dramatically  drop  within  one 
second  and  are  less  than  one  degree  after  conver¬ 
gence  provides  the  evidence  that  the  adaptive  con¬ 
troller  for  the  14-DOFs  prosthetic  hand  enhances  per¬ 
formance.  The  other  observation  that  after  conver¬ 
gence,  all  three-link  fingers  show  more  unstable  errors 
than  two-link  thumb  suggests  that  the  more  DOFs  in¬ 
crease  the  difficulty  of  the  adaptive  controller  without 
knowing  the  mass  and  inertia  of  the  links  of  all  fingers. 


Figure  8:  Tracking  Errors  of  Adaptive  Controller  for 
Two-Link  Thumb 
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Figure  9:  Tracking  Angles  of  Adaptive  Controller  for  Figure  10:  Tracking  Errors  of  Adaptive  Controller  for 
Two-Link  Thumb  Three-Link  Index  Finger 


5  Conclusions  and  Future  Work 

An  adaptive  control  strategy  was  developed  for  the  14 
degrees  of  freedom  (DOFs),  five-fingered  smart  pros¬ 
thetic  hand  with  unknown  mass  and  inertia  of  all  the 
fingers.  Further,  the  forward  and  inverse  kinematics 
of  the  system  regarding  the  analytical  relationship  be¬ 
tween  the  angular  positions  of  joints  and  the  positions 
and  orientations  of  the  end-effectors  (fingertips),  was 
obtained  using  a  desired  orientation  for  three-link  fin¬ 
gers.  The  simulations  of  the  resulting  adaptive  con¬ 
troller  showed  good  agreement  between  the  reference 
and  the  actual  trajectories.  Work  is  in  progress  for 
developing  an  adaptive/robust  controller  for  the  five 
fingered  hand  with  14-DOFs. 
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Appendix  A:  Dynamic  Equations  of  Two-link 
Thumb  and  Three-link  Index  Finger 

The  dynamic  equations  of  thumb  in  (21)  can  be  rewrit¬ 
ten  as  below. 


■  Ml, 

MI2  ■ 

ql  1 

■  Cl  ■ 

■  G\  ■ 

1 

_  Ml, 

MI2 

+ 

Cl 

+ 

Gl 

rl 

Here, 

Mh  =  2m2L\llcos{ql) 1712 171212^ 

+  7^1  +  Izz2^ 

MI2  =  m2L\l\cos{q2)  +  -f  7^2, 

Ml,  =  MI2, 

M22  =  mill  +  llz2^  (42) 

Ct  t  'T  t  Tt  •  /  "t  \  ^ "t  ^ "t  "b  'M~  "b  •  /  b  \  ^ b  ^b 

1  =  -2m2Lil2sm{q2)qiq2  -  m2Lil2sm{q2)q2q2, 

d  =  m2Lj/2sin(^2)<?i^i  -  rn2Lj/2sin(^2)^kL  (43) 

G\  =  g{m\llcos{ql)  +  mlL\cos{ql)  + 

7712/^05(^5  +^2)), 

Gl  =  gmlllcos{ql-\-ql),  (44) 

rl  and  are  the  given  torques  at  the  joints  1  and 
2,  respectively;  is  the  distance  between  the  end  of 
previous  link  and  the  center  of  mass  of  link  k;  L\.  is 
the  length  of  link  k\  the  angle  at  joint  k  and  a 
function  of  time;  g  is  the  acceleration  due  to  gravity; 
the  diagonal  elements  ~  1,2),  m  =  n  are 

called  polar  moments  of  inertia. 

Similarly,  dynamic  equations  of  index  finger  in 
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Figure  11:  Tracking  Angles  of  Adaptive  Controller 
for  Three-Link  Index  Finger 


Figure  12:  Tracking  Errors  of  Adaptive  Controller  for 
Three-Link  Middle  Finger 


(21)  can  be  also  obtained  as 


rj  ■ 

■  Mfi  Mfa  Mia  ' 

■  ■ 

T2 

Mil  MI2  MI3 

ql 

^^3 

Mil  MI2  MI3 

_  ^3 

■  ci  - 

■  Gi  - 

+ 

ci 

+ 

G| 

ci 

Gi 

(45) 


Here, 


Mil  =  2mlL\r2  sin(^l)  sin(^l  -f  ql) 

-\-2m2L\r2  cos{ql)  cos{ql  -h  ^2) 
-h2m3LlL2  sin(^l)  sin(^l  -h  ^2) 
-h2m3LlL2  cos(^l)  cos{ql  -h  ^2) 
-\-2mlL\ll  sin(^l)  sin(^l  +  ^2  +  ql) 
+2mlL\ll  cos{q\)  cos{q\  -h  ^2  +  ql) 

+2mlLlll  sin(^l  -h  (h)  sin(^l  +  ^2  +  ql) 

-\-2mlLlll  cos{q\  -h  ql)  cos{q\  +  ^2  +  ql) 

I  i  ,  i  Y  %  ,  i 

-\-mili  -h  m2-Li  -h  7712/2 
-I-7773L1  -h  7773^2  "T  Trials 
+-^Ll  +  Izz2  +  Ilz3^ 

Mi2  =  mlLlll  sm(q\)  sm{q\  -h  ql) 

-h 7772^1  ^2  cos(gl)  cos{ql  ql) 

+2mlLlll  sin(^l  +  ^2)  sin(^l  +  ^2  +  ql) 
+2mlLlll  cos{q\  -h  (h)  cos{q\  -h  ^2  +  ql) 
-\-mlL\Ll  sin(^i)  sin(^i  +  ql) 

-\-mlL\Ll  cos{ql)  cos{ql  -f  ql) 


-hTTigLl/g  sin(^l)  sin(^l  +  ^2  +  ql) 

-\-mlL\ll  cos{ql)  cos{ql  -h  ^2  +  ql) 

-\-mlll  -h  7773L2  -h  7773/3  Izz2  Ilz3^ 

MI3  =  mlLlll  sin(^l)  sin(^l  +  ^2  +  ql) 

-j-mlLlll  cos{q\)  cos(^l  -h  ^2  +  ql) 

-h7773L2/3  sin(^l  -h  ql)  sin(^l  +  ^2  +  ql) 
-^-mlLlll  cos{ql  -h  ql)  cos{ql  -h  ^2  +  ^3) 
-\-mllf  -h  /Ls,  (46) 

M^i  =  ML, 

ML  =  27773LL3  sin(^l  -h  sin(^l  +  ^2  +  ql) 

+2mlLir3  cos{q\  +  ql)  cos{q\  +  ql  +  ql) 
-\-mlll  -h  7773L2  -h  7773/3  +-^L2+-^L3, 

Mis  =  rnlLlll  sin(^l  -h  ql)  sin(^l  +  ^2  +  ql) 

-hTTigLLs  cos(^l  -h  ql)  cos{ql  -h  ^2  +  ql) 
+^3^3  +  Kz3^  (47) 

ML  =  ^13,  MI2  —  Mis, 

Mis  —  '^3^3  +  Kz3-  (48) 

Gl  =  cos{ql)  -h  mlL\  cos(^i)  -h  mlL\  cos(^i) 

-h777l/2  cos(^l  -h  ql)  -h  7773L2  cos(^l  -h  ql) 

-hTTlLs  COs(^l  +^2+^3)), 

Gl  =  gimlll  cos{q\  -\-ql)  mlLl  cos{q\  -h  ql) 

-hTTlLs  C0S(^1  +^2 

C3  =  ^'(^3^3  C0S(^1  -h  ^2  +  (49) 
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Figure  13:  Tracking  Angles  of  Adaptive  Controller 
for  Three-Link  Middle  Finger 

Cl  —  {2rri2L\r2  sin(^i)  cos(^i  +  ^2)  ~  2rri2L\r2  cos(^i) 
sin(^l  +  ^2)  +  2mlL\Ll  sm(ql)  cos{ql  -h  ql) 
-2mlL\Ll  cos{ql)  sin(^l  -h  ql)  +  2mlL\ll  sm{ql) 
cos{ql  -\-q2-\-  ql)  -  2mlL\ll  cos{ql) 

sm{ql+ql  +  ql))x 

+{2m3L\r3  sin(gn  cos(gJ  +  ql  +  ql) 

-2mlL[ll  cos(gi)  sin(gi  +  ql  +  ql) 

-\-2mlLlll  sin(qi  +  q^)  cos(gi  +  92  +  93)  “  “^mlLlll 

cos{q{  +  ql)  sin{q{  +  ql  +  ql))  X  j  (^) 

+{2mlL\ll  sin(gi)  cos(gi  +  ql  +  ql) 

-2mlL\ll  cos(gi)  sin(gj  +  Q2  +  93) 

-\-2mlLlll  sin(gi  +  92)  cos(qi  +  92  +  Qs)  “  ‘^mlLUl 

cos{q{  +  ql)  sin{q{  +  ql  +  ql))  X  j  (^) 

+(mlL\ll  sin(qi)cos(qi  +92) 

-mlL\ll  cos(qi)  sin(qi  +  ql) 

+mlL\Ll  sin(qi)  cos(qi  +  ql) 

-mlL\Llcos{ql)sin{ql  +  ql) 

+mlL\ll  sin{ql)  cos{ql  +  ql  +  ql)  -  mlL\ll 

/is.  .  /  i  ,  i  ,  ^  f  dql\  f  dql\ 

cos(gi)  sin(qi  +  q2  +  qs))  x  1  j  (  j 

+{mlL\ll  sin(gi)  cos(qi  +  ql  +  ql) 

-mlL\ll  cos(qi)  sin(gi  +ql+  ql) 

+mlLlll  sin(qj  +  ql)  cos{q{  +  ql  +  ql)  -  mlLlll 

cos{q{  +  ql)  sin{q{  +  ql  +  ql))  X  j  (^)  ’ 
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Figure  14:  Tracking  Errors  of  Adaptive  Controller  for 
Three-Link  Ring  Finger 

Cl  =  {mlL\ll  sin{ql)  cos{ql  +  ql) 
—mlL\llcos{ql)sin{ql  -1-92) 
-|-m3LiL2sin(gi)cos(gi  -|- Q2) 

-mlL\Ll  cos(gi)  sin(gi  -|-  ql) 

+mlL\ll  sin(gi)  cos(gi  -|-  Q2  +  ol)  -  mlL\ll 

cos(gi)sin(qi  +ql+ql))  x  (^) 

-|-(2m3L2Z3  sin(gi  -|-  ql)  cos{q\  +ql+  ql) 
-2mlLlll  cos{q\  +  ql)  sin(gi  -|-  Q2  +  93))  x 

(f )  (f ) 

-|-(2m3L2Z3  sin(gi  -|-  ql)  cos{q\  +ql+  ql) 
-2mlLlll  cos{q\  +  ql)  sin(gi  -|-  Q2  +  fe))  x 
dql\  ( dql\ 

dt  J  \dt  J 

+(-mlL\ll  sin(qi)  cos(qi  -|-  ga) 
+mlL\llcos{q\)si\i{q\  +  ql) 
-mlL\Llsm{q\)cos{q\  +  ql) 
+mlL\Llcos{q\)si\i{q\  +  ql) 

-mlL\ll  sin(gi)  cos(gi  +ql  +  ql) 

+mlL\ll  cos(gi)  sin(gi  +  q2  +  ql))  x 

(f)(f) 

+(mlLlll  sin(gi  -|-  ql)  cos{ql  +  ql  +  ql) 
-mlLlll  cos{q{  +  ql)  sin(gi  +  ql  +  ql))  x 
dq3\  ( dql\ 

dt  J  \dt  J  ’ 

(50) 
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Figure  15:  Tracking  Angles  of  Adaptive  Controller 
for  Three-Link  Ring  Finger 


Figure  16:  Tracking  Errors  of  Adaptive  Controller  for 
Three-Link  Little  Finger 


C3  —  (2m3L2/3  cos(^i  H- ^2)  sin(^i  +  ^2  +  ^3) 

sm{ql  -h  ql)  cos{q\  +  ^2  +  ^3))  x 

( dql 

dt  J  \dt 

-\-{mlL\rs  sin(^l)  cos(^l  +  ^2  +  ql) 
-mlLlll  cos(^l)  sin(^l  +  ^2  +  ql) 
+(m3L2/3  sin(^l  +  ^2)  cos(^l  +  ^2  +  ql) 
-mlLlll  cos{q\  +  c^)  sin(^l  +  ^2  +  ^3))  x 

^^1^  ( Oql 

dt  J  \dt 

+  (m3L2^3  sin(^l  +  q^)  cos{ql  +  ^2  +  ql) 
-mlLlll  cos{q\  +  ^2)  sin(^l  +  ^2  +  ^3))  x 

( Oql 

dt  J  \dt 

cos{ql)  sin(^l  +  ^2  +  ql) 
sin(^l)  cos(^l  +  ^2  +  ql) 

-\-mlLlll  cos{ql  +  ql)  sin(^l  +  ^2  +  ql) 
-mlLlll  sin(^l  -h  ^2)  cos(^l  +  ^2  +  ^3))  x 

dt )  \dt  ) 

+  (m3L2^3  cos(^l  +  ^2)  sin(^l  +  ^2  +  (&) 
-mlLlll  sin(^l  +  ql)  cos(^l  +  ^2  +  ^3))  x 
dql\  f dql 
dt  J  \  dt 


Appendix  B:  Regression  Matrix  Y  and  Unknown 
Parameter  Vector  tt 

In  Section  3.2,  the  regression  matrix  and  the  un¬ 
known  parameter  vector  tt^  of  two-link  thumb  can  be 
expressed  as 


FA 

F2^1 

[m{ 


^  12 
^2*2 


^  13 
^2*3 


f  14 
^2*4 


t  t  Tt  Tt 
^2  ^zzl  ^zz 


(51) 


where 

^11  — 
Y^  — 


Yi%  = 
Yi\  = 

Yii  = 

Y^  — 
^9.9.  — 


^24 

Cl 

S2 


=  sin 


A  A  {qdi  +  Aiei)  +  gliCi , 

{2L\iIC2  +  L\l\  +  AA)(^'cii  +  Aiei) 

+  (f^lAC2  +  AA)(^'ci2  +  ^2^2) 

— Li/26^2^2  (^di  +  Aiei) 

—Lil2S2{qi  +  q2){qd2  +  A2e2)  +  5'ACi2, 

^'di  +  Aiei, 

^di  +  Aiei  +  qd2  +  ^2^2 1 

Y2%  =  0, 

{L\IIC2  +  AA)(^'dl  +  Aiei)  +  AA(^'d2  +  ^2G2) 

-\-L\llS2qi{qdi  +  Aiei) 

—L\llS2qi{qd2  +  A2e2)  +  5'ACi2, 

^di  +  Aiei  +  qd2  +  ^2^2 1 

cos{ql),C2  =  cos(^2), 

-(^2),Ci2  =  cos(^5  +  ql). 
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Figure  17:  Tracking  Angles  of  Adaptive  Controller 
for  Three-Link  Little  Finger 

Similarly,  the  regression  matrix  and  the  un¬ 
known  parameter  vector  tt^  of  three-link  index  finger 
can  be  written  as 


■  Y,\ 

Y^*2 

Yis 

yL 

Yis 

Yis  ' 

II 

Yi2 

Yis 

yL 

Yis 

Yis 

Yi^ 

Yi2 

Yis 

yL 

Yis 

Yis 

i  r  ^  ^  i  ji  L 

TT  =  ^mi  1712  ms  4^2  Izz3\  ■ 

Here, 

Li\  =  lili{qdi gliCi gl2Ci2, 

Li  =  (244^1^12  -h  2Li4CiCi2  -h  44  -h  44)(gdi  -h  Ai4) 
-h(44^i^i2  +  44CiCi2  +  lUi){qd2  +  A2e2)  +  ^LiCi 
-h(44^iCi2  -  L\liCiSi2)qi{qd2  +  A2e2) 

-h(44^iCi2  -  44Ci 512)^2^1  +  Aiei) 

-\-{L\l2SiCi2  —  L\l2CiSi2)q2{qd2  +  A2e2), 

Yis  =  {2L1L2S1S12  +  2L1L2C1C12  +  2LilsSiSi23 

+  2L\liClCl23  +  2LUiSl2Sl23  +  2LUiCl2Cl23 

-\-LiLi  -h  L2L2  +  44)(^'di  +  Aiei) 

-|-(2L24*^12*Si23  +  2L2I3C12C123  +  LiL2ASlASl2 
-h44ciCi2  +  44^1^123  +  44ciCi23 
-\-L2L2  -h  44)  (^'d2  +  A2e2) 

-h(44^1^123  +  44C1C123  +  44^12^123 
-hLy3Cl2Cl23  +  44)(^'(i3  +  A3e3) 

-h^'LiCi  -h  gL2Ci2  +  5'4Ci23 

+  (TiL2*Si(7i2  —  LiL2CiSi2)qi{qd2  +  A2e2) 


-h(44^iCi2  -  L{LiCiSi2)q2{qdi  +  Aiei) 

-h(Li4*^iCi23  —  L\llC  I S 123)  qi{qd2  +  A2e2) 
-h(44^iCi23  -  L{liCiSi23)q2{qdi  +  Aiei) 
-h(Li4^iCi23  —  LlllC  I S 123)  qi{qd3  +  A3e3) 
-\-{L\llSiCi23  —  L\llC  I S 123)  q3{qdi  +  Aiei) 
-l-(Ly3  5'l2Cl23  —  Ty3Cl2*S'l23)4(^(i3  +  A3e3) 
-l-(Ly3  5'l2Cl23  —  Ty3Cl2S'l23)^3(^dl  +  AiCi) 
-h(Li4*S'lCl23  —  Ti4Cl5'l23)^2(^d3  +  A3e3) 
-h(Li4*^lCl23  —  Ti4Cl5'l23)^3(^d2  +  A2e2) 
-l-(Ly3  5'l2Cl23  —  Ty3Cl2*S'l23)^2(^d3  +  A3e3) 
-l-(Ly3  5'l2Cl23  —  Ty3Cl2*S'l23)^3(^d2  +  A2e2) 
-h(I/iL25'iCi2  —  L\L2CiSi2)q2{qd2  +  A2e2) 
-h(Li4*S'lCl23  —  Ti4Cl5'l23)^2(^d2  +  A2e2) 
-h(Li4*S'lCl23  —  Ti4Cl5'l23)^3(^d3  +  A3e3) 

-h  (1/^3  5^12  Cl23  —  Ty3Cl2S'l23)^3(^d3  +  A3e3), 

Li4  =  qdi  +  AiCi, 

Li5  —  qdi  +  AiCi  -f  qd2  +  A2e2, 

Lie  —  qdi  +  Aiei  -f  qd2  +  A2e2  -T  qd3  +  A3e3, 

V'i'  _  v'i'  _  _  n 

^21  —  -^24  —  -*^31  —  -*^32  —  -*^34  —  -*^35  —  U, 

ri  =  iL\llSiSi2  +  L\llCiCi2  +  l\l\){qdi  +  Aiei) 

+  44  (^'(i2  +  A2e2)  +  5'4Ci2 

-T(Li4*Si(7i2  —  Ti4Ci*Si2)^2(^di  +  Aiei) 

+  (Ti4Ci*Si2  —  Ti4*S^iCi2)^i  (^di  +  Aiei), 

L23  =  (2+24*^12*^123  +  2+24^124123+7/1+2*5^1*^12 

++i+^Cl4l2  +  +14*^1*^123  +  +i44l4l23 

++2+2  +  44)(^'dl  +  Aiei)  +  (2+y3ASl2*Sl23 

+  2+^3(7124123  +  +2+2  +  44)  (^'(i2  +  A2e2) 

+  (+y3  5'l2  *5^123  +  L2^lCl2Cl23  +  44)(^'(i3  +  A3e3) 
-\-gL2Ci2  +  5'44i23 

+  (+i+2*Si4i2  —  L\L2CiSi2)qi{qd2  +  A2e2) 

+  (+14*Si4i23  —  +l44lAS'l23)^l(^d2  +  A2e2) 

+  (+24*5'i24i23  —  +24  4i2  *5^123  )^l(^d3  +  A3e3) 

+  (+y35'l24l23  —  +^3  412*^123)  ^3  (^dl  +  AiCi) 

+  (+y3AS'l24l23  —  +^3  412*^123)  ^2  (^d3  +  A3e3) 

+  (+y35'l24l23  —  +y3  4l2*S'l23)^3(^d2  +  A2e2) 

+  {L\LiCiSi2  -  L\LiSiCi2)qi{qdi  +  Aiei) 
+(+144i5'i23  —  +i4*5'i4i23)^i(^di  +  Aiei) 

+  (+24*5'i24i23  —  +244l2*S'l23)^3(^d3  +  A3e3), 

L25  —  ^'di  +  AiCi  +  qd2  +  A2e2, 

L26  =  qdi  +  Aiei  +  qd2  +  A2e2  +  qd3  +  A3e3, 

L33  =  (+14*5^1*5^123  +  +144i4i23  +  +24*5^12*5^123 

++244i24i23  +  44)(^'dl  +  AiCi) 

+  (+24  *5^12  *5^123  +  +244i24i23  +  44)(^'d2  +  A2e2) 
+  44  (^'d3  +  A3e3)  +  gl3Cl23 
+  (+24412*5^123  —  +24*5'l2  4l23)^l(^d2  +  A2e2) 

+  (+24412*5^123  —  +24*5'l2  4l23)^2(^dl  +  AiCi) 

+  (+14*5'i4i23  —  +144l5'l23)^l(^d3  +  A3e3) 

+  (+24*5^124123  —  +24  4i2  *5^123  )^l(^d3  +  A3e3) 

+  (+24*5^124123  —  +24  412*5^123)  ^2  (^d3  +  A3e3) 

+  (+144i*Si23  ~  +14*5^l4l23)^l(^dl  +  AiCi) 
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-\-{L2^lCi2Si23  —  L2^lSi2Ci23)qi{qdi  +  Aiei) 
-\-{L2l3Cl2Sl23  —  ^2^3^12^123)^2  (^(i2  +  A2e2), 
^36  —  qdl  +  AiCi  +  qd2  +  A2e2  +  qd3  +  ^3^3  1 

Cl  =  cos(^l),  C12  =  cos(^l  +  ^2), 

Si  =  sin(^l),6'i2  =  Sin(^l  +  ^2), 

Cl23  =  COs(^l  +  ^2  +  ^3), 

S'123  =  sin(^l  +  ^2  +  ^3)- 


References: 

[1]  M.  Zecca,  S.  Micera,  M.  Carrozza,  andP.  Dario, 
“Control  of  multifunctional  prosthetic  hands  by 
processing  the  electromyographic  signal,”  Crit¬ 
ical  Reviews^^  in  Biomedical  Engineering, 
vol.  30,  pp.  459-485, 2002,  (Review  article  with 
96  references). 

[2]  J.  C.  K.  Lai,  M.  R  Schoen,  A.  Perez-Gracia, 
D.  S.  Naidu,  and  S.  W.  Leung,  “Prosthetic  de¬ 
vices:  Challenges  and  implications  of  robotic 
implants  and  biological  interfaces,”  Proceed¬ 
ings  of  the  Institute  of  Mechanical  Engineers 
(IMechE),  Part  H:  Journal  of  Engineering  in 
Medicine,  vol.  221,  no.  2,  pp.  173-183,  January 

2007,  special  Issue  on  Micro  and  Nano  Tech¬ 
nologies  in  Medicine. 

[3]  L.  Zollo,  S.  Roccella,  E.  Guglielmelli,  M.  C. 
Carrozza,  and  P  Dario,  “Biomechatronic  de¬ 
sign  and  control  of  an  anthropomorphic  arti¬ 
ficial  hand  for  prosthetic  and  robotic  applica¬ 
tions,”  lEEE/ASME  Transactions  on  Mechatron- 
ics,  vol.  12,  no.  4,  pp.  418-429,  August  2007. 

[4]  D.  S.  Naidu,  C.-H.  Chen,  A.  Perez,  and  M.  P 
Schoen,  “Control  strategies  for  smart  prosthetic 
hand  technology:  An  overview,”  in  Proceedings 
of  the  30th  Annual  International  IEEE  EMBS 
Conference,  Vancouver,  Canada,  August  20-24 

2008,  pp.  4314-4317. 

[5]  C.-H.  Chen,  “Hybrid  control  strategies  for  smart 
prosthetic  hand,”  Ph.D.  dissertation.  Measure¬ 
ment  and  Control  Engineering,  Idaho  State  Uni¬ 
versity,  May  2009. 

[6]  D.  S.  Naidu  and  C.-H.  Chen.,  Automatic  Control 
Techniques  for  Smart  Prosthetic  Hand  Technol¬ 
ogy:  An  Overview,  book  chapter  12,  to  appear  in 
a  book  titled  ''Distributed  Diagnosis  and  Home 
Healthcare  (D2H2):  Volume  2”.  California, 
USA:  American  Scientific  Publishers,  2011,  (in 
printing). 


[7]  C.-H.  Chen,  K.  W.  Bosworth,  M.  P  Schoen,  S.  E. 
Bearden,  D.  S.  Naidu,  and  A.  Perez,  “A  study  of 
particle  swarm  optimization  on  leukocyte  adhe¬ 
sion  molecules  and  control  strategies  for  smart 
prosthetic  hand,”  in  2008  IEEE  Swarm  Intelli¬ 
gence  Symposium  (IEEE  SIS08),  St.  Louis,  Mis¬ 
souri,  USA,  September  21-23  2008. 

[8]  C.-H.  Chen,  D.  S.  Naidu,  A.  Perez,  and  M.  P 
Schoen,  “Eusion  of  hard  and  soft  control  tech¬ 
niques  for  prosthetic  hand,”  in  Proceedings  of 
the  International  Association  of  Science  and 
Technology  for  Development  (lASTED)  Inter¬ 
national  Conference  on  Intelligent  Systems  and 
Control  (ISC  2008),  Orlando,  Elorida,  USA, 
November  16-18  2008,  pp.  120-125. 

[9]  C.-H.  Chen,  D.  S.  Naidu,  A.  Perez-Gracia,  and 
M.  P  Schoen,  “A  hybrid  control  strategy  for 
five-fingered  smart  prosthetic  hand,”  in  Joint 
48th  IEEE  Conference  on  Decision  and  Con¬ 
trol  (CDC)  and  28th  Chinese  Control  Confer¬ 
ence  (CCC),  Shanghai,  P  R.  China,  December 
16-18  2009,  pp.  5102-5107. 

[10]  P  Dostalek,  L.  Pekar,  V.  Vasek,  and  J.  Dolinay, 
“Microcontroller  based  self-tuning  digital  pid 
controller,”  in  The  1 4th  World  Scientific  and  En¬ 
gineering  Academy  and  Society  (WSEAS)  Inter¬ 
national  Conference  on  Systems,  Latest  Trends 
on  Systems  (Volume  I),  Corfu  Island,  Greece, 
July  22-24  2010,  pp.  248-251. 

[11]  L.  Macku  and  D.  Samek,  “Two  step,  pid  and 
model  predictive  control  applied  on  fed  batch 
process,”  in  The  1 4th  World  Scientific  and  Engi¬ 
neering  Academy  and  Society  (WSEAS)  Interna¬ 
tional  Conference  on  Systems,  Latest  Trends  on 
Systems  (Volume  II),  Corfu  Island,  Greece,  July 
22-24  2010,  pp.  470-473. 

[12]  D.  Naidu,  Optimal  Control  Systems.  Boca  Ra¬ 
ton,  PL:  CRC  Press,  2003. 

[13]  C.-H.  Chen,  D.  S.  Naidu,  A.  Perez-Gracia,  and 
M.  P  Schoen,  “A  hybrid  optimal  control  strat¬ 
egy  for  a  smart  prosthetic  hand,”  in  Proceedings 
of  the  ASME  2009  Dynamic  Systems  and  Con¬ 
trol  Conference  (DSCC),  Hollywood,  California, 
USA,  October  12-14  2009,  (No.  DSCC2009- 
2507). 

[14]  C.-H.  Chen  and  D.  S.  Naidu,  “Optimal  control 
strategy  for  two-fingered  smart  prosthetic  hand,” 
in  Proceedings  of  the  International  Associa¬ 
tion  of  Science  and  Technology  for  Development 
(lASTED)  International  Conference  on  Robotics 


ISSN:  1109-2777 


160 


Issue  5,  Volume  10,  May  201 1 


WSEAS  TRANSACTIONS  on  SYSTEMS 


and  Applications  (RA  2010),  Cambridge,  Mas¬ 
sachusetts,  USA,  November  1-3  2010,  pp.  190- 
196. 

[15]  F.  Lewis,  D.  Dawson,  and  C.  Abdallah,  Robot 
Manipulators  Control:  Second  Edition,  Revised 
and  Expanded.  New  York,  NY:  Marcel  Dekker, 
Inc.,  2004. 

[16]  C.-H.  Chen,  D.  S.  Naidu,  A.  Perez-Gracia,  and 
M.  P.  Schoen,  “A  hybrid  adaptive  control  strat¬ 
egy  for  a  smart  prosthetic  hand,”  in  The  31st  An¬ 
nual  International  Conference  of  the  IEEE  Engi¬ 
neering  Medicine  and  Biology  Society  (EMBS), 
Minneapolis,  Minnesota,  USA,  September  2-6 
2009,  pp.  5056-5059. 

[17]  C.-H.  Chen,  D.  S.  Naidu,  and  M.  P.  Schoen, 
“An  adaptive  control  strategy  for  a  five-fingered 
prosthetic  hand,”  in  The  14th  World  Scientific 
and  Engineering  Academy  and  Society  (WSEAS ) 
International  Conference  on  Systems,  Latest 
Trends  on  Systems  (Volume  11),  Corfu  Island, 
Greece,  July  22-24  2010,  pp.  405-410. 

[18]  M.  Bakosova,  A.  Vasickaninova,  and  M.  Kar- 
saiova,  “Robust  static  output  feedback  stabiliza¬ 
tion  of  an  exothermic  chemical  reactor  with  in¬ 
put  constraints,”  in  the  14th  World  Scientific 
and  Engineering  Academy  and  Society  (WSEAS) 
International  Conference  on  Systems,  Latest 
Trends  on  Systems  (Volume  1),  Corfu  Island, 
Greece,  July  22-24  2010,  pp.  341-346. 

[19]  R.  R.  Seeley,  T.  D.  Stephens,  and  P.  Tate, 
Anatomy  &  Physiology,  Eighth  Edition.  New 
York,  NY:  The  McGraw-Hill,  2007. 

[20]  R.  N.  Jazar,  Theory  of  Applied  Robotics.  Kine¬ 
matics,  Dynamics,  and  Control.  New  York, 
USA:  Springer,  2007. 

[21]  B.  Siciliano,  L.  Sciavicco,  L.  Villani,  and  G.  Ori- 
olo.  Robotics:  Modelling,  Planning  and  Control. 
London,  UK:  Springer- Verlag,  2009. 

[22]  R.  Schilling,  Eundamentals  of  Robotics:  Analy¬ 
sis  and  Control.  Englewood  Cliffs,  NJ :  Prentice 
Hall,  1990. 

[23]  R.  Kelly,  V.  Santibanez,  and  A.  Loria,  Control  of 
Robot  Manipulators  in  Joint  Space.  New  York, 
USA:  Springer,  2005. 

[24]  A.  Nikoobin  and  R.  Haghighi,  “Lyapunov-based 
nonlinear  disturbance  observer  for  serial  n-link 
robot  manipulators,”  Journal  of  Intelligent  and 
Robotic  Systems,  2008. 


Cheng-Hung  Chen,  D.  Subbaram  Naidu,  Marco  P.  Schoen 


[25]  Y.  Z.  Arslan,  Y.  Hacioglu,  and  N.  Yagiz,  “Pros¬ 
thetic  hand  finger  control  using  fuzzy  sliding 
modes,”  Journal  of  Intelligent  and  Robotic  Sys¬ 
tems,  vol.  52,  pp.  121-138,  2008. 

[26]  F.  Lewis,  S.  Jagannathan,  and  A.  Yesildirek, 
Neural  Network  Control  of  Robotic  Manipula¬ 
tors  and  Nonlinear  Systems.  London,  UK:  Tay¬ 
lor  &  Francis,  1999. 

[27]  P.  K.  Lavangie  and  C.  C.  Norkin,  Joint  Structure 
and  Eunction:  A  Comprehensive  Analysis,  Third 
Edition.  Philadelphia,  PA:  F  A.  Davis  Com¬ 
pany,  2001. 

[28]  S.  Arimoto,  Control  Theory  of  Multi-fingered 
Hands:  A  Modeling  and  Analytical-Mechanics 
Approach  for  Dexterity  and  Intelligence.  Lon¬ 
don,  UK:  Springer- Verlag,  2008. 


ISSN:  1109-2777 


161 


Issue  5,  Volume  10,  May  201 1 


Attachment  2A-2 


Proceedings  of  the  lASTED  International  Conference 
Robotics  and  Applications  (RA  2010) 

November  1-3,  2010  Cambridge,  Massachusetts,  USA 


OPTIMAL  CONTROL  STRATEGY  FOR  TWO-FINGERED  SMART 

PROSTHETIC  HAND 


Cheng-Hung  Chen 

Measurement  and  Control 
Engineering  Research  Center 
Department  of  Biological  Sciences 
College  of  Science  and  Engineering 
Idaho  State  University 
Pocatello,  Idaho  83209,  USA 
Email:  chenchen@isu.edu 

ABSTRACT 

This  paper  addresses  the  optimal  control  for  a  two-fingered 
(thumb  and  index  finger)  prosthetic  hand.  To  speed  up  the 
performance  and  improve  the  accuracy,  we  modified  the 
performance  index  by  including  an  exponential  term.  Eirst, 
we  developed  the  differential  kinematics  for  a  serial  n-link 
revolute-joint  planar  manipulator  to  computer  the  angular 
velocities  and  angular  accelerations  of  each  finger.  Eurther, 
the  trajectory  planning  of  the  orientation  was  designed  by 
using  cubic  polynomial.  Simulations  show  that  the  pro¬ 
posed  technique  provides  fast  action  with  high  accuracy 
and  30-fold  faster  than  ANEIS  or  GA  based  trajectory  plan¬ 
ning. 

KEY  WORDS 

Prosthetic  Hand,  Optimal  Control,  Stability,  ANEIS 

1  Introduction 

Hard  control  (HC)  techniques  comprise  proportional- 
integral-derivative  (PID)  control  [1-3],  optimal  control 
[4-6],  adaptive  control  [7-9]  etc.  with  specific  applications 
to  prosthetic  devices.  However,  our  previous  works  [2, 3] 
for  smart  prosthetic  hand  showed  that  PID  controller  re¬ 
sults  in  overshooting  and  oscillation.  Optimal  controller 
can  obtain  a  high  performance  [5,6].  However,  this  control 
technique  takes  time  to  be  convergent.  To  overcome  the 
overshooting  and  convergent  problems,  studying  the  stabil¬ 
ity  of  the  optimal  controller  is  precisely  the  main  goal  of 
this  work.  In  addition,  the  adaptive  neuro-fuzzy  inference 
system  (ANEIS)  and  genetic  algorithm  (GA)  based  trajec¬ 
tory  planning  [5, 6, 10]  take  much  time  to  train  the  neural 
layers,  especially  for  high  degree-of-freedom  (DOE)  prob¬ 
lems.  To  improve  the  performance,  it  is  also  the  goal  of  this 
paper. 

In  this  paper,  we  first  consider  briefiy  forward  kine¬ 
matics  and  inverse  kinematics  for  a  serial  n-link  revolute- 
joint  planar  manipulator  and  two-link  thumb  and  three-link 
index  finger,  respectively.  Then,  by  using  differential  kine¬ 
matics,  the  angular  velocities  and  angular  accelerations  of  a 
serial  n-link  revolute-joint  planar  manipulator  are  derived. 
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Moreover,  the  trajectory  planning  of  the  orientation  is  de¬ 
signed  by  using  cubic  polynomial.  The  dynamic  models  of 
the  smart  prosthetic  hand  and  linearization  technique  were 
briefiy  introduced.  Einally,  the  stability  of  finite- time  linear 
quadratic  optimal  controller  are  investigated  by  changing 
cost  function  J.  The  simulation  results  show  the  presented 
technique  can  be  fast  convergence  and  hold  the  high  per¬ 
formance  for  the  two-fingered  smart  prosthetic  hand. 


2  Modeling 

Eorward  and  inverse  kinematics  of  articulated  systems 
study  the  analytical  relationship  between  the  angular  po¬ 
sitions  of  joints  and  the  positions  and  orientations  of  the 
end-effectors  (fingertips).  A  desired  trajectory  is  usually 
specified  in  Cartesian  space  and  the  trajectory  controller 
is  easily  performed  in  the  joint  space.  Hence,  conversion 
of  Cartesian  trajectory  planning  to  the  joint  space  [11]  is 
necessary.  Using  inverse  kinematics,  the  joint  angular  po¬ 
sitions  of  each  finger  need  to  be  obtained  from  the  known 
fingertip  positions.  Then  the  angular  velocities  and  angu¬ 
lar  accelerations  of  joints  can  be  obtained  from  the  linear 
and  angular  velocities  and  accelerations  of  fingertips  (end- 
effectors)  by  differential  kinematics.  The  inverse  kine¬ 
matics  of  two-link  thumb  and  three-link  fingers  were  dis¬ 
cussed  in  our  previous  publications  [2,3,6, 10, 12]  for  a  two¬ 
fingered  (thumb  and  index  finger)  smart  prosthetic  hand. 
Here,  we  derive  the  general  form  of  forward  and  differen¬ 
tial  kinematics  for  a  serial  n-link  revolute-joint  planar  ma¬ 
nipulator. 


2.1  Forward  Kinematics 

Eigure  1  shows  the  illustration  of  a  serial  n-link  revolute- 
joint  planar  manipulator.  Li  is  the  length  of  the  link  i  and  qi 
is  the  angle  of  the  joint  i  (i  =  1,  2,  •  •  • ,  n).  is  the  actuator 
of  the  joint  i.  The  position  (X^,  Yn)  of  the  end-effector 
and  the  orientation  of  the  end-effector  frame  have  been 
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as 


L\cos{q\)  +  Llcos{q\  +  92), 
L\sin{q\)  +  L\sin{q\  +ql). 


(2) 

(3) 


Figure  1 .  Illustration  of  a  Serial  n-Link  Revolute- Joint  Pla¬ 
nar  Manipulator 


derived  [12]  as 


= 

= 


Here  L\  and  are  the  lengths  of  the  links  1  and  2  of  the 
thumb,  respectively;  q\  and  are  the  angular  positions  (or 
called  angles)  of  joints  1  and  2  of  the  thumb.  Choosing  the 
elbow  up  configuration,  the  angle  q^  of  the  joint  2  can  be 
obtained  from  [11] 


q\  =  —  cos  ^ 


2ZfZ| 


(4) 


Notice  that  in  this  paper,  all  positive  angles  are  defined 
counterclockwise.  When  choosing  the  elbow  up  configura¬ 
tion,  the  angle  q^  is  clockwise,  so  the  sign  of  q^  is  negative. 
Based  on  the  geometry,  we  can  get 


Xn  —  ^  Lj COS  I  ^  ^^qi  I , 

j=i  \i=i  J 


Yn  = 

3=1  \i=l  J 

n 

4^n  —  ^  (1) 


2.2  Inverse  Kinematics 
2.2.1  Two-Link  Thumb 

As  shown  in  Figure  2,  thumb  is  assumed  as  the  two-link 
(n  =  2)  finger  and  the  other  four  fingers,  such  as  index 
finger,  middle  finger,  ring  finger,  and  little  finger,  are  con¬ 
sidered  as  three-link  fingers.  Hence,  the  angular  positions, 
angular  velocities,  and  angular  accelerations  of  each  finger 
can  be  deduced  as  follows.  According  to  equation  (1),  the 


2.2.2  Three-Link  Index  Finger 

Figure  3  shows  the  illustration  of  three-link  (n  =  3)  index 


finger,  d  is  the  distance  between  the  global  (G)  frame  and 
index  finger  (i)  local  frame  base  (zero);  L\,  and  L\ 
are  the  lengths  of  the  links  1,  2  and  3  of  the  index  finger 
(i),  respectively;  q\,  q^,  and  q\  are  the  angles  of  the  joints 
1,  2,  and  3  of  the  index  finger.  Using  Denavit-Hartenberg 
(DH)  [11-15]  transformation  matrices,  the  fingertip  (end- 
effector)  coordinate  P*  (X%  Y^)  and  the  orientation  of 
the  index  finger  (i)  can  be  written  as 


Figure  2.  Schematic  Diagram  of  Thumb  and  Index  Finger 


fingertip  coordinate  (X^,F^)  of  thumb  (t)  can  be  described 


X*  =  d  +  cos(g^)  +  1/2  cos(g^  +  ^2)  +  ^3  cos((/)*), 
y®  =  L\  sin(gi)  +  i®2  sm{ql  +  q^)  +  ig  sin(^®), 

4’^  =  Qi  +  Q2  +  qI-  (6) 
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The  local  coordinate  P2  (X2,  Y^)  of  the  joint  2  can  be  ob¬ 
tained  as 


X\  =  -  Li  cos(0O  -  d, 

Yi  =  r*-L|sin(0').  (7) 


Choosing  the  elbow  down  configuration,  the  angles  gl 
q\  can  be  obtained  as 


^2  =  cos 


_i  f  Xf  +  Yf  -  L\^  - 
2L{L\ 


q\  =  tan 


-1 


Y^ 


—  tan 


-1 


L\  sin(gi) 


Xi  j  \L\+ L\cos{q^) )  ' 

Then  we  can  get  the  angle  q\  of  the  joint  3  as 

4  =  0'-  7i  -  ql 


(8) 


(9) 


2.3  Differential  Kinematics 

The  linear  velocity  and  angular  velocity  ^(jJ^  of  the 
origin  of  the  end-effector  frame  are  linear  relations  to  the 
joint  angular  velocities  q  [12].  The  linear  relation  repre¬ 
sents  the  differential  kinematics  equation  and  can  be  ex¬ 
pressed  as 


=  J(q)  q.  (10) 

Here,  =  [^Pn  ^^n]'  is  the  (6  x  1)  end-effector  veloc¬ 
ity  vector.  J(q)  =  [Jp(q)  Jo(q)]'^  is  the  (6  x  n)  geomet¬ 
ric  Jacobian  matrix  of  a  serial  n-link  revolute-joint  planar 
manipulator;  both  position  Jacobian  Jp  (q)  and  orientation 
Jacobian  Jo(q)  are  the  (3  x  n)  matrices  which  contribute 
the  joint  angular  velocities  q  to  the  linear  velocity  ^P^  and 
angular  velocity  ^(jJ^  of  the  end-effector,  respectively.  The 
entry  Jij  (i^j  G  N)  of  the  geometric  Jacobian  J  (q)  in  (10) 
can  be  rewritten  as 


Jij  —  \ 


-J2LjSm  J 

j=l  \k=l  J 

Y^qk 

j=i  \fe=i  / 

0 

1 


ifi  =  i,i  e  [1,6]; 


ifi  =  2,j  e  [1,6]; 

ifie  [3,5],ie  [1,6]; 
ifi  =  6,i  e  [1,6]. 


Then,  the  angular  velocities  q  can  be  written  as 


q  =  J-l(q) 


(11) 


Similarly,  the  angular  accelerations  q  can  be  obtained  as 

q  =  J“^(q)  (°A„- j(q)qj.  (12) 

Here,  =  [^Pn  ^OLn\  is  the  (6  x  1)  end-effector  accel¬ 
eration  vector,  including  linear  acceleration  ^P^  and  angu¬ 
lar  acceleration  The  differential  Jacobian  J  (q)  can  be 


also  written  as 


n  /  3 

-E  Lj  cos 

3=1  \k=i 

-^LjSin  j  j 

3=1  \k=l  J 

0 


ifi  =  l,j  e  [1,6]; 
ifi  =  l,j  e  [1,6]; 

ifi  e  [3,6],i  e  [1,6], 


2.4  Trajectory  Planning 


The  trajectory  planning  using  cubic  polynomial  for  finger¬ 
tip  position  control  was  discussed  in  our  previous  work 
[2, 3, 6, 10, 12]  for  a  two-fingered  (thumb  and  index  finger) 
smart  prosthetic  hand.  For  the  three-link  index  finger,  we 
present  the  same  technique  for  fingertip  orientation  control. 
A  time  history  of  desired  (d)  fingertip  orientation  (0)  and 
its  differentiation  (0  and  0)  is  given  as 


m 

—  LJo  ^it  ie2t^  ^ot^  ^ 

(13) 

m 

=  uji  “h  2ix)2t  3uJst^  ^ 

(14) 

m 

=  2cJ2  +  ficJst, 

(15) 

where  are  undetermined  constants  and  the  super¬ 

script  j  indicates  the  index  of  each  finger  (j  =  i,  m,  r  and 
/).  The  relations  (13)  and  (14)  need  to  satisfy  the  constraint 
conditions  at  initial  time  to  and  final  time  tf.  This  can  be 
written  as 


T  n  =  ^. 

Here,  the  matrices  T,  Fi,  and  ^  are 


n 


=  ^0 


to 

1 

1 

LOi 

<Po 


^0 


^0 


2to 


V 

2tf 

CO2 


1 

LJS 


(16) 


(17) 

(18) 
(19) 


Therefore,  the  4  unknown  constants,  can  be  com¬ 

puted  by  12  = 


2.5  Dynamics  of  Hand 


The  dynamic  equations  of  hand  motion  are  derived  via  La- 
grangian  approach  using  kinetic  energy  and  potential  en¬ 
ergy  as  [8,11,12,14,15] 


dt\dq)  dq  ^ 


(20) 


where  C  is  the  Lagrangian;  q  and  q  represent  the  angular 
velocity  and  angle  vectors  of  joints,  respectively;  r  is  the 
given  torque  vector  at  joints.  The  Lagrangian  C  can  be 
expressed  as 
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C  =  T-V, 


(21) 


where  T  and  V  denote  kinetic  and  potential  energies,  re¬ 
spectively.  Substituting  (21)  into  (20),  dynamic  equations 
can  be  obtained  as  below. 

M(q)q+ C(q,q)  +  G(q)  =  T,  (22) 

where  M(q)  is  the  inertia  matrix;  C(q,  q)  is  the  Corio¬ 
lis/centripetal  vector  and  G(q)  is  the  gravity  vector.  (22) 
can  be  also  written  as 

M(q)q  +  N(q,q)  =  T,  (23) 


from  which  the  control  function  can  be  defined  as 

u(t)  =  qd(t)  -h  M“^(q(t))  [N(q(t),q(t))  -  T(t)]  .  (31) 

This  is  often  called  the  feedback  linearization  control  law, 
which  can  also  be  inverted  to  express  it  as 

T(t)  =  M(q(f))  [q^(t)  -  u(t))  +  N(q(f),  q(f)]  .  (32) 

Using  the  relations  (29)  and  (31),  and  defining  state  vector 
x(t)  =  [e'{t)  e'(t)]',  the  tracking  error  dynamics  can  be 
written  as 


where  N(q,  q)  =  C(q,  q)  +  G(q)  represents  nonlinear 
terms.  The  dynamic  relations  for  the  two-link  thumb  and 
the  three-link  index  finger  are  quite  lengthy  and  omitted 
here  due  to  lack  of  space  [12, 16, 17]. 


3  Control  Techniques 

3.1  Feedback  Linearization 


The  nonlinear  dynamics  represented  by  (23)  is  to  be  con¬ 
verted  into  a  linear  state-variable  system  using  feedback 
linearization  technique  [8].  Alternative  state-space  equa¬ 
tions  of  the  dynamics  can  be  obtained  by  defining  the  posi¬ 
tion/velocity  state  x(t)  of  the  joints  as 

x(i)  =  [q'(i)  q'(i)]'.  (24) 


Let  us  repeat  the  dynamical  model  and  rewrite  (23)  as 

|q(i)  =  -M-i(q(i))  [N(q(i),q(i))  -  T{t)] .  (25) 

Thus,  from  (24)  and  (25),  we  can  derive  a  linear  system  in 
Brunov  sky  canonical  form  as 


x(i)  = 


0  I 
0  0 


x(i)  + 


(26) 


with  its  control  input  vector  given  by 


n{t)  =  -M  ^(q(i))  [N(q(i), q(i))  -  T{t)] .  (27) 


x{t)  = 


0  I 
0  0 


x{t)  + 


0 

I 


u{t). 


(33) 


Note  that  this  is  in  the  form  of  a  linear  system  such  as 


x(t)  =  Ax(t)  +  Bu(t).  (34) 


3.2  Finite-Time  Linear  Quadratic  Optimal  Control 

Figure  4  shows  the  block  diagram  of  finite-time  linear 


Linear  SyNiem 


Figure  4.  Block  Diagram  of  Hybrid  Optimal  Controller  for 
Prosthetic  Hand 


Let  us  suppose  the  prosthetic  hand  is  required  to  track  the 
desired  trajectory  qd(t)  described  under  path  generation  or 
tracking.  Then,  the  tracking  error  e(t)  is  defined  as 

e(t)  =  qd{t)  -  q(t).  (28) 

Here,  qd(t)  is  the  desired  angle  vector  of  joints  and  can  be 
obtained  by  trajectory  planning  [2, 3, 6, 10, 12];  q(t)  is  the 
actual  angle  vector  of  joints.  Differentiating  (28)  twice,  to 
get 

e(t)  =  qrf(t)  -  q(t),  e(t)  =  qd{t)  -  q(t).  (29) 

Substituting  (25)  into  (29)  yields 

e(t)  =  qd(t)  +M“^(q(t))  [N(q(t),  q(t))  -  T(t)]  (30) 


quadratic  optimal  controller  for  prosthetic  hand.  For  the 
linear  system  (34),  we  can  formulate  the  well-known  finite¬ 
time  linear  quadratic  optimal  control  problem  by  defining 
a  performance  index  J  [4]  such  as 

J  =  ix'(tj)F(tj)x(tj) 

+  -  f  [x'(t)Q(t)x(t)  +  u'(t)R(t)u(t)]  (35) 

2  Jto 

where  the  terminal  cost  matrix  F(tj)  and  the  error 
weighted  matrix  Q(t)  are  positive  semidefinite  matrices, 
respectively;  the  control  weighted  matrix  R(t)  is  a  positive 
definite  matrix.  The  optimal  control  u*  (t)  is  given  by 

u*(t)  =  -R-^(t)B'P(t)x*(t)  =  -K(f)x*(t).  (36) 
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Here,  K(t)  =  R“^(t)B'P(t)  is  called  Kalman  gain  and 
P(t),  the  symmetric  positive  definite  matrix  (for  all  t  G 
[to,^/]),  is  the  solution  of  the  matrix  differential  Riccati 
equation  (DRE) 

P{t)  =  -P(t)A  -  A'P(t)  -  Q(t)  +  P(t)BR-^(t)B'P(t)  (37) 

satisfying  the  final  condition 

P{t  =  tf)  =  (38) 

The  optimal  state  x*  is  the  solution  of 

±*{t)  =  [A  -  BR-i(i)B'P(i)]  (39) 

Therefore,  the  required  torque  T*{t)  can  be  calculated  by 
the  optimal  control  u*(f). 

T*{t)=  M(q(f) )  (qd  (f)  -  u* (f) )  +  N (q(f) ,  q(f) ) .  (40) 

3.3  The  Stability  of  Finite-Time  Optimal  Control 

Our  previous  work  [5,  6,  12]  shows  optimal  control  can 
avoid  overshooting  and  get  better  results  than  PID  control, 
but  the  regular  optimal  control  takes  time  to  be  convergent. 
To  study  the  convergent  stability  of  the  optimal  control,  we 
modify  the  performance  index  J  [4]  as 

J  + 

-  f  [x'(t)Q(t)x(t)  +  u'(t)R(t)u(t)]  (it,  (41) 

2  Jto 

where  a  is  a.  positive  parameter.  To  find  the  optimal  con¬ 
trol  which  minimizes  the  performance  index  (41)  under  the 
dynamical  constraint  (34).  This  problem  can  be  solved  by 
changing  the  previous  system,  so  the  following  transforma¬ 
tions  can  be  developed  as 

x(t)  =  e°'^x(t);  u(t)  =  e"^u(t).  (42) 

Then,  using  the  transformations  (42),  it  is  easy  to  see  that 
the  modified  system  becomes 

i(i)  =  A{e«‘x(f)}  =  ae“*x(f)  +  e“*x(f) 

=  Q(x(t)  -h  e°'^[Ax(t)  +  Bu(t)] 
x(t)  =  (A  +  (3T)x(t)  +  Bu(t).  (43) 

Considering  the  minimization  of  the  modified  system 
(43)  and  the  performance  index  (41),  we  see  that  the  opti¬ 
mal  control  [4]  is  given  by 

u*(t)  =  -R-^B'Px*(t)  =  -Kx*(t),  (44) 

where  K  =  R“^B'P  and  the  matrix  P  is  the  positive  def¬ 
inite,  symmetric  solution  of  the  algebraic  Riccati  equation 

P(A  -h  al)  -h  (A'  -h  al)P  -  PBR“^B'P  +  Q  =  0.  (45) 

Using  the  optimal  control  (44)  in  the  modified  system  (43), 
we  get  the  optimal  closed-loop  system  as 

i*(t)  =  (A  +  QT-BR-^B'P)x*(t).  (46) 


Hence,  applying  the  transformations  (43)  in  the  modified 
system  (44),  the  optimal  control  of  the  original  system  (34) 
and  the  associated  performance  measure  (41)  is  given  by 

U*(()  =  e"“*u*(()  =  -e"“*R"^B'Pe“*x*(() 

=  -R“iB'Px*(f)  =  -Kx*(f).  (47) 

We  see  that  the  closed-loop  optimal  control  system  (46)  has 
eigenvalues  with  real  parts  less  than  —a.  In  other  words, 
the  state  x*(f)  approaches  zero  at  least  as  fast  as 


4  Simulation  Results  and  Discussion 

Referring  to  inverse  kinematics.  Figure  5  exhibits  that  the 


Figure  5.  The  Fingertip  Workspace  of  Thumb  and  Index 
Finger  and  a  Square  Object 


fingertip  workspace  of  the  thumb  and  index  finger.  We 
present  simulations  with  the  stability  of  optimal  controller 
for  the  two-link  thumb  and  three-link  index  finger  of  a 
smart  prosthetic  hand.  All  used  parameters  are  the  same 
to  our  previous  work  [6].  The  initial  and  final  orienta¬ 
tion  fio  and  (j)f  are  75  and  160  degrees,  respectively.  Fig¬ 
ure  6  displays  the  tracking  errors  and  desired/actual  angles 
of  thumb  for  the  smart  prosthetic  hand  by  using  the  pre¬ 
sented  optimal  controller  with  the  stability  (a  =  0,  0.1,  and 
1).  Figure  7  to  Figure  9  are  the  tracking  errors  and  de¬ 
sired/actual  angles  of  index  finger  for  the  smart  prosthetic 
hand  (a  =  0,  1,  and  10).  To  compare  with  the  original  sys¬ 
tem  (a  =  0),  these  results  demonstrate  that  the  presented 
optimal  controller  behaves  fast  convergent  and  accurate  as 
the  stability  a  increases.  For  the  three-link  index  finger, 
we  design  the  orientation  cj)  to  calculate  the  angular  posi¬ 
tions  via  inverse  kinematics.  To  compare  with  our  previous 
works  [5,6, 10, 12]  by  using  adaptive  neuro-fuzzy  inference 
system  (ANFIS)  and  genetic  algorithm  (GA),  the  simula¬ 
tions  show  that  the  presented  method  is  not  time  consum¬ 
ing. 
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Figure  6.  Tracking  Errors  (left)  and  Joint  Angles  (right)  of 
Thumb  for  Optimal  Control  with  the  Stability  (a  =  0,  0.1, 
and  1) 


Figure  7.  Tracking  Errors  (left)  and  Joint  1  Angles  q\ 
(right)  of  Index  Finger  for  Optimal  Control  with  the  Sta¬ 
bility  (a  =  0,  1,  and  10) 


5  Conclusion  and  Future  Work 

This  paper  developed  the  differential  kinematics  for  a  serial 
n-link  revolute-joint  planar  prosthetic  hand  to  compute  the 
angular  velocities  and  angular  accelerations  of  each  finger. 
Then,  the  cubic  polynomial  function  was  designed  to  track 
the  orientation  (p  in  order  to  calculate  inverse  kinematics 
and  differential  kinematics.  To  make  the  optimal  controller 
fast  acting,  the  performance  index  J  included  an  exponen¬ 
tial  term.  The  simulation  results  demonstrated  a  30-fold 
increase  in  fast  response  compared  to  ANFIS  or  GA  based 
trajectory  planning  [6].  Work  is  underway  to  extend  this 
methodology  to  five-fingered,  three-dimensional  prosthetic 
hand. 
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Abstract:  In  this  paper,  an  adaptive  control  strategy  is  developed  for  the  14  degrees  of  freedom  (DOEs),  five¬ 
fingered  smart  prosthetic  hand  with  unknown  mass  and  inertia  of  all  the  fingers.  In  particular,  the  forward  and 
inverse  kinematics  of  the  system  regarding  the  analytical  relationship  between  the  angular  positions  of  joints  and 
the  positions  and  orientations  of  the  end-effectors  (fingertips)  have  been  obtained  using  a  desired  orientation  for 
three-link  fingers.  The  simulations  of  the  resulting  adaptive  controller  with  five-fingered  prosthetic  hand  show 
enhanced  performance. 

Key-Words:  adaptive  control,  prosthetic  hand,  hard  control,  five  finger  hand,  feedback  linearization,  trajectory 
planning 


1  Introduction 

Due  to  the  extreme  complexity  of  human  hand,  that 
has  27  bones,  controlled  by  about  38  muscles  to  pro¬ 
vide  the  hand  with  22  degrees  of  freedom  (DOEs), 
and  incorporates  about  17,000  tactile  units  of  4  dif¬ 
ferent  units,  reproducing  the  human  hand  in  all  its 
various  functions  and  appearance  is  still  a  challeng¬ 
ing  task  [1].  Prosthetic  hands  have  been  built  to  re¬ 
place  human  hands  that  can  fully  operate  the  various 
motions,  such  as  holding,  moving,  grasping,  lifting, 
twisting  and  so  on  [1-5].  However,  about  35%  of  the 
users  do  not  regularly  use  their  prosthetic  hands  be¬ 
cause  of  several  reasons,  including  poor  functionality 
of  the  presently  available  prosthetic  hands  and  psy¬ 
chological  problems.  Thus,  designing  and  developing 
an  artificial  hand  which  can  “mimics  the  human  hand 
as  closely  as  possible”  both  in  functionality  and  ap¬ 
pearance  can  overcome  these  problems. 

Hard  computing/control  (HC)  techniques  can  be 
used  at  lower  levels  for  accuracy,  precision,  stability 
and  robustness.  HC  comprises  proportional-integral- 
derivative  (PID)  control  [6],  optimal  control  [7,  8], 
adaptive  control  [9-11]  etc.  with  specific  applica¬ 
tions  to  prosthetic  devices.  However,  our  previous 
work  [11]  for  a  two-fingered,  thumb  and  index  fin¬ 
ger,  prosthetic  hand  showed  that  adaptive  controller 
can  overcome  overshooting  and  oscillation.  However, 
a  five-fingered  prosthetic  hand  with  adaptive  control 
technique  has  not  been  developed  yet. 

In  this  work,  we  first  describe  briefly  the  trajec¬ 


tory  planning  problem,  human  hand  anatomy  and  the 
inverse  kinematics  for  two-link  thumb  and  the  remain¬ 
ing  three-link  fingers  (index,  middle,  ring  and  little). 
Next,  the  dynamics  of  the  prosthetic  hand  is  derived 
and  feedback  linearization  technique  is  used  to  ob¬ 
tain  linear  tracking  error  dynamics.  Then  the  adap¬ 
tive  controller  is  designed  to  minimize  the  tracking  er¬ 
ror.  The  simulation  results  show  that  the  five-fingered 
prosthetic  hand  with  the  presented  adaptive  controller 
can  grasp  an  object  without  overshooting  and  oscilla¬ 
tion.  Conclusions  and  future  work  are  provided  in  the 
last  section. 


2  Modeling 

2.1  Trajectory  Planning  and  Inverse  Kine¬ 
matics 

The  trajectory  planning  using  cubic  polynomial  was 
discussed  in  our  previous  work  [5,  6,  11,  12]  for  a 
two-fingered  (thumb  and  index  finger)  smart  pros¬ 
thetic  hand.  Eigure  1  shows  that  index  finger,  mid¬ 
dle  finer,  ring  finer  and  little  finger  contain  three 
revolute  joints  in  order  to  do  the  angular  move¬ 
ments.  Metacarpal-phalangeal  (MCP)  joint  is  lo¬ 
cated  between  metacarpal  and  proximal  phalange 
bone;  proximal  and  distal  interphalangeal  (PIP  and 
DIP)  joints  separate  the  phalangeal  bones.  Thumb 
contains  metacarpal-phalangeal  (MCP)  and  interpha¬ 
langeal  (IP)  joints.  In  this  work,  q[,  q2  Qs  repre- 
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Figure  1:  The  Joints  of  Five-Finger  Prosthetic  Hand 
Reaching  a  Rectangular  Rod 


Figure  2:  The  Definition  of  Global  Coordinate  and 
Local  Coordinates 


sent  the  angular  positions  (or  joint  angles)  of  the  first 
joint  MCP^ ,  the  second  joint  PIP^  and  the  third 
joint  DIP^  of  index  finger  (j  =  i),  middle  finger 
(j  =  m),  ring  finger  (j  =  r)  and  little  finger  (j  =  /), 
respectively;  q\  and  are  the  angular  positions  of  the 
first  joint  MCP^  and  the  second  joint  I P^  of  thumb 
(t). 

Forward  and  inverse  kinematics  of  articulated 
systems  study  the  analytical  relationship  between  the 
angular  positions  of  joints  and  the  positions  and  orien¬ 
tations  of  the  end-effectors  (fingertips).  A  desired  tra¬ 
jectory  is  usually  specified  in  Cartesian  space  and  the 
trajectory  controller  is  easily  performed  in  the  joint 
space.  Hence,  to  convert  Cartesian  trajectory  plan¬ 
ning  to  the  joint  space  [13]  is  necessary.  Using  inverse 
kinematics,  the  joint  angular  positions  of  each  finger 
need  to  be  obtained  from  the  known  fingertip  positions 
(joint  space).  Then  the  angular  velocities  and  angular 
accelerations  of  joints  can  be  obtained  from  the  linear 
and  angular  velocities  and  accelerations  of  fingertips 
(end-effectors)  by  the  geometric  Jocobian.  As  shown 
in  Figure  2,  and  are  the  three  axes  of 

the  global  coordinate.  The  local  coordinate  x^-y^-z^ 
of  the  thumb  can  be  reached  by  rotating  through  an¬ 
gles  a  and  f3  to  and  of  the  global  coordinate, 
subsequently.  The  local  coordinate  x'^-y'^-z'^  of  index 
finger  can  be  obtained  by  rotating  through  angle  a  to 
and  then  translating  the  vector  of  the  global 
coordinate;  similarly,  the  local  coordinate  x^-y^-z^  of 
middle  finger  (j  —  m),  ring  finger  (j  —  r),  and  little 
finger  (j  —  1)  can  be  obtained  by  rotating  through  an¬ 
gle  aio  X^  and  then  translating  the  vector  (j  —  m, 
r  and  1)  of  the  global  coordinate.  The  inverse  kine¬ 
matics  of  two-link  thumb  and  three-link  fingers  was 
discussed  in  our  previous  publications  [5,6, 1 1, 12]  for 


a  two-fingered  (thumb  and  index  finger)  smart  pros¬ 
thetic  hand. 

2.2  Dynamics  of  Hand 

The  dynamic  equations  of  hand  motion  are  derived  via 
Lagrangian  approach  using  kinetic  energy  and  poten¬ 
tial  energy  as  [5] 

dt  vdqj  dq 

where  C  is  the  Lagrangian;  q  and  q  represent  the 
angular  velocity  and  angle  vectors  of  joints,  respec¬ 
tively;  T  is  the  given  torque  vector  at  joints.  The  La¬ 
grangian  C  can  be  expressed  as 

C^T-V,  (2) 

where  T  and  V  denote  kinetic  and  potential  energies, 
respectively.  Substitute  (2)  into  (1)  and  dynamic  equa¬ 
tions  of  thumb  can  be  obtained  as  below. 

M(q)q+C(q,q)  +  G(q)  =T,  (3) 

where  M(q)  is  the  inertia  matrix;  C(q,  q)  is  the  Cori¬ 
olis/centripetal  vector  and  G(q)  is  the  gravity  vector. 
(3)  can  be  also  written  as 

M(q)q  +  N(q,q)  =  T,  (4) 

where  N(q,  q)=C(q,  q)-i-G(q)  represents  nonlinear 
terms.  The  dynamic  relations  for  the  two-link  thumb 
and  the  remaining  three-link  fingers  are  quite  lengthy 
and  omitted  here  due  to  lack  of  space  [5]. 
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3  Control  Techniques 


3.2  Adaptive  Control  Technique 


3.1  Feedback  Linearization 

The  nonlinear  dynamics  represented  by  (4)  is  to 
be  converted  into  a  linear  state-variable  system  by 
finding  a  transformation  using  feedback  linearization 
technique  [10].  Alternative  state-space  equations  of 
the  dynamics  can  be  obtained  by  defining  the  posi¬ 
tion/velocity  state  x(f)  of  the  joints  as 

x{t)  =  [q(t)'  q(t)']'.  (5) 

Let  us  repeat  the  dynamical  model  and  rewrite  (4)  as 


|q(i)  =  -M{q{())-‘  [N(q(i),  q{t))  -  T(i)] .  (6) 


Thus,  from  (5)  and  (6),  we  can  derive  a  linear  state- 
variable  equation  in  Brunovsky  canonical  form  as 


±{t)  = 


0  I 
0  0 


x(t)  + 


(7) 


with  its  control  input  vector  given  by 
u{t)  =  -M(q(t))“^  [N(q(t),  q(t))  -  T(t)] .  (8) 


Let  us  suppose  the  prosthetic  hand  is  required  to  track 
the  desired  trajectory  c[d{t)  described  under  path  gen¬ 
eration  or  tracking.  Then,  the  tracking  error  e{t)  is 
defined  as 


e(i)  =  qd(i)  -  q(i)-  (9) 

Here,  qd(t)  is  the  desired  angle  vector  of  joints  and 
can  be  obtained  by  trajectory  planning  [5, 6, 11, 12]; 
q(f)  is  the  actual  angle  vector  of  joints.  Differentiat¬ 
ing  (9)  twice,  to  get 

e(f)  =  qd(f)  -  q(f),  e(t)  =  qd(t)  -  q(t).  (10) 

Substituting  (6)  into  (10)  yields 

e(f)  =  qd(f)  +  M(q(t))“^  [N(q(t),  q(t))  -  T(t)]  (11) 

from  which  the  control  function  can  be  defined  as 

u(f)  =  qd(f)  +  M(q(t))“^  [N(q(t),  q(t))  -  T(t)] .  (12) 

This  is  often  called  tho  feedback  linearization  control 
law,  which  can  also  be  inverted  to  express  it  as 

T{t)  =  M(q(t))  [qd(t)  -u(t))  +N(q(t),q(t)]  .(13) 


Using  the  relations  (10)  and  (12),  and  defining  state 
vector  x(f)  =  [^{tY  ^he  tracking  error  dy¬ 

namics  can  be  written  as 


x(f)  = 


0  I 
0  0 


x(f)  + 


0 

I 


u{t). 


(14) 


Note  that  this  is  in  the  form  of  a  linear  system  such  as 


The  tracking  error  e  and  the  filtered  tracking  error  r 
are  defined  as 


e  =  qd  -  q,  (16) 

r  =  e  +  Ae.  (17) 

Here,  qu  is  the  desired  angle  vector  of  joints;  q  is  the 
actual  angle  vector  of  joints;  A  is  the  positive-definite 
diagonal  gain  matrix.  The  filtered  error  (17)  ensures 
stability  of  the  overall  system  so  that  the  tracking  error 
(16)  is  bounded.  Figure  3  shows  the  block  diagram  of 
the  adaptive  controller.  Here,  the  filtered  signal  r(f) 
is  derived  from  the  tracking  error  e(f)  and  the  trajec¬ 
tory  planner  and  is  fed  to  the  adaptive  controller  of  the 
prosthetic  hand. 


Figure  3:  Block  Diagram  of  Adaptive  Control  Tech¬ 
nique 

Differentiating  and  substituting  (17)  into  (3)  gives 
the  dynamic  equation  in  terms  of  the  filtered  error  r  as 

M(q)r  = -C^(q,q)r  +  f-T  (18) 

where  C(q,  q)  =  Cm(q,  q)q  and  the  nonlinear  term  f 
can  be  defined  as 

f  =  M(q)(qd  + Ae) +  C^(q,q)(qd  + Ae) 
+64(q)  +  Tdis 

=  Ytt.  (19) 

Here,  the  regression  matrix  Y  is  a  matrix  of  known 
robot  functions  and  tt  is  a  vector  of  unknown  param¬ 
eters  [9].  The  regression  matrix  Y  and  the  unknown 
parameter  vector  tt  of  two-link  thumb  and  three-link 
index  finger  are  expressed  in  [5].  The  torque  vector  r 
can  be  calculated  by 


x(f)  =  Ax(f)  +  Bu(f).  (15) 


T  =  Ytt  +  Kdt.  (20) 
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The  unknown  parameter  rate  vector  tt  can  be  updated 
by 

TT  =  r“^Y'r  (21) 

where  F  is  a  tuning  parameter  diagonal  matrix. 

4  Simulation  Results  and  Discussion 

When  thumb  and  the  other  four  fingers  are  doing  ex¬ 
tension/flexion  movements,  the  workspace  of  finger¬ 
tips  is  restricted  to  the  maximum  angles  of  joints.  Re¬ 
ferring  to  inverse  kinematics,  the  first  and  second  joint 
angles  of  the  thumb  fingertip  are  constrained  in  the 
ranges  of  [0,90]  and  [-80,0]  (degrees).  The  first,  sec¬ 
ond,  and  third  joint  angles  of  the  other  four  fingers  are 
constrained  in  the  ranges  of  [0,90],  [0,1 10]  and  [0,80] 
(degrees),  respectively  [14].  Next,  we  present  simula¬ 
tions  with  an  adaptive  controller  for  the  14  DOFs  five¬ 
fingered  smart  prosthetic  hand.  The  parameters  of  the 
two-link  thumb/three-link  index  finger  [15]  were  re¬ 
lated  to  desired  trajectory.  All  parameters  of  the  smart 
prosthetic  hand  selected  for  the  simulations  are  given 
in  Table  1  and  the  side  length  and  length  of  the  target 
rectangular  rod  are  0.010  and  0.100  (m),  respectively. 
The  relating  parameters  between  the  global  coordinate 
and  the  local  coordinates  are  defined  in  Table  2.  Be¬ 
sides,  all  links  are  assumed  as  a  circular  cylinder  with 
the  radius  (R)  0.010  (m),  so  the  inertia  of  each 
link  k  of  each  finger  j  (j  =  f,  i,  m,  r,  and  /)  can  be 
calculated  as 

(22) 

All  initial  actual  angles  are  zero. 

Figure  4  to  Figure  8  are  the  tracking  errors  and 
desired/actual  angles  of  thumb,  index  finger,  middle 
finger,  ring  finger,  and  little  finger  for  the  proposed 
five-fingered  smart  prosthetic  hand. 

5  Conclusions  and  Future  Work 

An  adaptive  control  strategy  was  developed  for  the  14 
degrees  of  freedom  (DOFs),  five-fingered  smart  pros¬ 
thetic  hand  with  unknown  mass  and  inertia  of  all  the 
fingers.  Further,  the  forward  and  inverse  kinematics 
of  the  system  regarding  the  analytical  relationship  be¬ 
tween  the  angular  positions  of  joints  and  the  positions 
and  orientations  of  the  end-effectors  (fingertips),  was 
obtained  using  a  desired  orientation  for  three-link  fin¬ 
gers.  The  simulations  of  for  the  resulting  adaptive 
controller  with  five-fingered  prosthetic  hand  showed 
good  agreement  between  the  reference  and  the  actual 
trajectories.  Work  is  in  progress  for  developing  an 


Table  1 :  Parameter  Selection  of  the  Smart  Hand 


Parameters 

Values 

Thumb 

Time  (to,tf  )* 

0,  20  (sec) 

Desired  Initial  Position** 

0.035,  0.060  (m) 

Desired  Final  Position** 

0.0495,  0.060  (m) 

Desired  Initial  Velocity* 

0,  0  (m/s) 

Desired  Final  Velocity* 

0,  0  (m/s) 

Length 

0.04,  0.04  (m) 

Index  Finger 

Desired  Initial  Position** 

0.065,  0.080  (m) 

Desired  Final  Position** 

0.010,  0.060  (m) 

Length 

0.04,  0.04,  0.03  (m) 

Middle  Finger 

Desired  Initial  Position** 

0.065,  0.080  (m) 

Desired  Final  Position** 

0.005,  0.060  (m) 

Length 

0.04,  0.04,  0.03  (m) 

Ring  Finger 

Desired  Initial  Position** 

0.065,  0.080  (m) 

Desired  Final  Position** 

0.010,  0.060  (m) 

Length 

0.04,  0.04,  0.03  (m) 

Little  Finger 

Desired  Initial  Position** 

0.055,  0.080  (m) 

Desired  Final  Position** 

0.020,  0.060  (m) 

Length 

0.04,  0.04,  0.03  (m) 

*A11  fingers  use  same  parameters 
**Local  coordinates 


adaptive/robust  controller  for  the  five  fingered  hand 
with  14-DOFs. 
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Abstract:  The  robotic  hands  can  be  divided  into  two  major  groups:  fully-actuated  and  underactuated  hands.  In 
fully-actuated  hands  all  the  joints  have  separate  motors,  while  in  underactuated  hands  the  number  of  motors  is 
less  than  number  of  degrees  of  freedom.  The  underactuated  hands  can  adapt  to  the  object  shape  by  use  of  their 
mechanical  design  while  they  have  less  functionality.  A  relationship  between  forces  and  displacement  is  found 
through  virtual  work  method.  Based  on  this  relationship  an  analytical  approach  is  used  to  optimize  hand  based 
on  two  criteria:  isotopic  force  and  maximum  chance  of  stable  grasping.  A  PD  type  of  controller  is  designed  for 
this  class  of  hands  and  the  functionality  of  designed  hand  is  compared  with  fully  actuated  hand  using  virtual 
spring  damper  hypothesis. 

Key-Words:  Prosthetic  Hand,  Underactuated,  Virtual  Spring  Damper,  Control,  Comparison  Analysis,  Grasping 


1  Introduction 

Human  hand  is  one  of  the  most  important  and 
complex  parts  of  the  body,  which  has  the  ability  to 
handle  different  tasks.  The  ultimate  goal  of  robotic 
hand  is  to  achieve  the  functionality  of  a  human 
hand.  In  the  past  three  decades,  there  have  been 
numerous  investigations  to  achieve  dexterity  and 
ability  of  human  hand,  especially  in  the  fields  of 
humanoid  robotics  and  prosthetic  hand  [1-6].  In 
spite  of  all  these  advances  in  this  field,  the  current 
state  of  research  on  prosthetic  hands  is  far  from  that 
objective  of  achieving  the  functionality  of  human 
hand.  Commercially  available  prosthetic  hands 
have  very  limited  functionality  and  they  are  just 
simple  grippers.  The  present  research  on  prosthetic 
hands  involves  complex  control  schemes  to  achieve 
the  most  important  functions  of  the  hand  [7-8]. 

There  are  two  main  categories  of  robotic  hands 
including  fully  actuated  and  underactuated 
mechanism.  In  underactuated  mechanisms  the 
number  of  actuators  is  less  than  their  degree  of 
freedom.  These  mechanisms  are  widely  used  in 
prosthetic  hands  because  of  two  useful  properties: 
the  first  advantage  is  less  weight  due  to  less  actuator 
which  is  used  in  their  design  and  the  second 
advantage  is  easier  control  method. 

In  fully  actuated  hands  all  joints  are  active.  In  this 
type  of  hands  many  control  methods  require  the 


knowledge  of  the  shape  of  the  object.  For  humans 
this  information  is  available  by  visual  feedback 
from  eyes,  while  in  case  of  a  prosthetic  hand  this 
visual  information  is  not  directly  available  for  hand 
controller,  and  the  only  available  information  is 
electromyographic  (EMG)  signal  related  to  patient’s 
arm  muscle  activities.  However,  normally  the  EMG 
signal  is  not  available  for  all  individual  joints  and 
besides,  due  to  measurement  noise,  accessing  high 
quality  EMG  signal  is  hard  [10].  Moreover,  using 
EMG  signal  to  control  all  the  movements  requires 
lot  of  attention  during  grasping  and  leads  to  fatigue 
for  the  amputees  [11].  Hence  it  is  required  for 
prosthetic  hand  to  be  semi-autonomous  which 
means  a  part  of  command  information  will  be 
provided  by  the  EMG  signal  and  the  rest  of  the 
required  command  should  be  provided 
automatically  by  hand  controller. 

Defining  finger  trajectory  without  the  knowledge  of 
shape  of  object  to  be  grasped  is  a  challenging  task 
for  many  path  planning  techniques.  For  multi  DOFs 
robots  there  are  two  common  methods  for  trajectory 
planning  which  are  ‘‘inverse  kinematic”  and 
“inverse  dynamic”  [12-15].  Both  these  methods 
require  object  shape  and  are  based  on  solving 
optimization  problem  which  requires  high 
computation,  hence  they  are  hard  to  implement  for 
real-time  applications. 


To  avoid  solving  the  path  planning  problem  in  our 
previous  paper  [2]  we  developed  a  control  method 
based  on  “virtual  spring  damper  hypothesis”  for 
power  grasping.  The  “virtual  spring-damper 
hypothesis”  is  introduced  by  Arimoto  et  al  to 
control  arm  movement.  This  method  is  based  on  the 
use  of  Jacobian  matrix  to  relate  task  space 
movement  to  joint  space.  In  [20]  it  is  shown  that  any 
kind  of  force  can  be  defined  between  two  points  and 
the  other  study  [2]  shows  that  use  of  spring-damper 
forces  will  result  in  human  like  movement.  From 
physiological  point  of  view,  human  skilled  multi¬ 
joint  reaching  movement  has  these  characteristics 
that : 

1)  endpoint  trajectory  become  a  quasi- straight  line 
and  less  variable 

2) velocity  profiles  of  the  endpoint  has  a  bell-shape 

3)  joint  trajectories  are  rather  variable  from  trial  to 
trial  [2]. 

In  this  paper,  design  and  optimization  of  an 
underactuated  mechanism  is  investigated.  Then  a 
control  method  is  developed  for  this  type  of  hands. 
Later  on  the  functionality  of  this  hand  is  compared 
with  functionality  of  fully  actuated  hands  using 
virtual  spring  damper  hypothesis. 


2  Force  Analysis  of  Underactuated 
Finger 

A  two  phalanx  finger  is  considered  in  Fig.2.  The 
input  torque  Tf  is  applied  to  the  link  a  which 
transmits  the  torque  to  the  whole  finger  trough 
phalanges.  A  rotational  spring  with  force  T  is 
located  at  O  which  moves  the  phalanx  back  to  its 
original  position  in  absence  of  external  force.  The 
closing  process  is  shown  in  Fig  2.  Providing  a 
mechanical  limit  can  help  in  order  to  make  pre¬ 
tension  for  the  spring  to  prevent  undesirable  motion 
of  the  second  phalanx  and  also  hyper-flexion  of  the 
finger. 

To  obtain  the  static  model  between  inputs  and 
outputs  of  the  finger  the  virtual  work  principle  is 
used.  Equating  the  input  and  output  virtual  powers 
results 


Fig.  1 .  Underactuated  hand  model  and  exerted  forces 


Where  t  is  the  input  torque  vector  exerted  by  the 
actuator  and  the  spring,  ooiis  the  rotational  velocity 
vector,  f  is  the  vector  of  contact  forces,  and  v  is  the 
velocity  of  the  contact  points  along  the  normal 
vector  of  each  phalanx.  Contact  forces  are  assumed 
to  be  normal  to  the  phalanges  and  without  friction. 
Each  element  in  the  above  equation  can  be 
expressed  as 
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The  normal  velocities  of  the  contact  point  can  be 
expressed  as  a  Jacobian  matrix  and  the 
derivatives  of  the  phalanx  joint  coordinates  which  is 
a  natural  choice,  SiS  v  =  or 
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Through  differential  calculus,  one  also  can  relate 
vector  0)1  to  the  derivatives  of  the  phalanges  joint 
coordinates  defined  previously  with  an  actuation 
Jacobian  matrix  Ja  as  0  =  Ja^u  or 
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where  X=1  and 


t^O)i  =  f^v 


yr  _  c[ZiSin(6>2-V^)-a  sin(6>i-6>a+6>2-V^)] 

a[l^  sin(0i-0(i)+c  sin(0i-0(j+02-V^)] 

Finally,  one  obtains 


case,  another  step  is  necessary  since  /z  is  a  function 
of  the  design  parameters  and  the  angle  02- 
Furthermore,  many  design  variables  are  available  to 
satisfy  the  latter  equation,  namely  a,  b,  c,  and  d. 


f=]T^]ft 


(9) 


which  is  the  equation  that  provides  a  practical 
relationship  between  the  actuator  torque  and  contact 
forces.  If  the  spring  contribution  is  neglected  the 
analytical  expression  are  rather  simple  linear 
functions  of  the  actuator  torque. 
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For  instance,  if  one  chooses  a  =  b,  3.  known  c  (e.g. 
resulting  from  minimal  distance  considerations)  and 
a  is  completely  defined  as 

_  2  liCsm92+c^+li^jA  .... 

^  ~  2  B  ^  ^ 

with , 

A  =  (C  —  1)((C  -  l)c^  +  2cCli  sin02)  +  (15) 

B  =  —c^  +  Cc^  —  liC  sin  62  +  2CliC  sin  02  +  Cli  (16) 


where  h  =  c(cos  (O2  —  ip)  —  sin  (O2  —  ip)  cot  jS)  is 
the  distance  between  point  O^and  the  intersection  of 
lines  (OOi)  and  (PiP2)-  Also,  a^is  the  angle 
between  link  a  and  the  first  phalanx.  It  can  be 
shown  that 

cot  B  cos  cti  +  sin  (12) 

^  ^  ^  sin 


c  =  -a:  02  + 


k2 

k2  +  li  cos  02+^1 


(17) 


The  above  mentioned  relationship  can  be  used  in 
order  achieving  isotropic  design.  However,  the 
isotropic  property  is  not  very  robust  with  respect  to 
design  parameters,  so  it  suggests  using  the  following 
method. 


where  X  is  the  angle  between  links  a  and  b. 


4  Design  Optimization 

After  obtaining  the  forces  equation  two 
consideration  form  the  guidelines  for  design 
parameters  selection:  first  grasp  should  be  stable 
which  means  ejection  should  be  prevented  and 
differences  between  the  phalanx  forces  should  be 
minimum  possible  value.  In  ejection  phenomena  the 
finger  slide  and  push  the  object  out  instead  of  a 
secure  grasping.  To  prevent  ejection  the  exerted 
forces  by  each  phalanx  to  the  object  should  be 
positive.  It  is  also  desirable  that  forces  at  each 
phalanx  to  be  close  to  their  mean  value  and  force 
distribute  evenly  between  phalanxes  which  is 
referred  to  as  force  isotropy.  So  the  conditions 
which  should  be  satisfied  can  be  expressed  as: 

(  fi-f2  ^^2) 

l/i  >  0  and  /2  >  0  ^  ^ 

In  order  to  have  force  isotropy  it  is  necessary  that 
forces  by  each  phalanx  are  equal,  but  forces  are 
function  of  contact  position  and  02  angle  hence  it  is 
a  local  property.  Therefore  if  the  object  moves  these 
conditions  are  not  true  anymore.  However  in  this 


If  one  obtains  an  isotropic  and  therefore  stable 
design  for  a  particular  contact  set  (/ci, /C2, 02),  it 
may  be  of  interest  that  the  finger  is  also  robust  with 
respect  to  ejection  around  this  isotropic  point,  in 
order  to  ensure  that  a  deviation  from  this 
configuration  does  not  lead  to  an  unstable  grasp. 
The  final  aim  is  to  guaranty  stability  for  all  grasps  if 
possible  and  satisfy  certain  “quality”  based  indices 
like  the  isotropy.  An  index  that  can  be  used  to 
ensure  the  grasp  stability,  even  if  the  proximal 
contact  is  lost,  is: 


Sw  2) ^^2^^ 2 

Sy^dk2de2 


(18) 


Where  5(/c2,02)is  a  Kronecker-like  symbol  for 
characterizing  the  stability  of  the  contact  situation: 


S(k2,d2)^[^ 


if  the  final  grasp  is  stable 
0  otherwise 


(19) 


This  index  is  the  ratio  between  the  stable  and 
unstable  areas  in  the  grasp-state  plane  of  the  finger. 
Contour  plots  of  the  index  p  is  illustrated  in  Fig.  2 
for  a  mechanically  actuated  finger.  The  optimal 
design  parameter  values  can  be  obtained  using  the 
following  plot.  In  our  design  equal  lengths  are 
considered  for  both  phalanxes  (l2/li=l),  so  the 
optimal  value  for  c/a  is  around  0.6  . 


5  Control  Method 

The  control  is  aimed  at  exploiting  the  main 
properties  of  underactuation  to  perform  motion  tasks 
close  to  reference  angles  obtained  by  EMG  signal. 
The  ordinary  task  considered  for  design  and 
development  of  the  motion  control  law  is  the  finger 
preshaping  for  the  palmer  grasp  of  a  cylindrical 
object. 

Kinematic  coupling  among  the  joints  is  related  by 
the  relation 

X5  —  +  ^2(^1  "f  ^2)  (20) 

Xs  =  l^Oi  +  1201  +  ^2)  (21) 


where  x  is  endpoint  position,  and  I2  are  link 
lengths,  and  6^,  62  are  angle  between  links  (Fig.l). 


Fig.2.  Performance  index  for  linkage  driven  2 
phalanx  underactuated  hand 


5.1  PD  Control  in  the  joint  space  with  elastic 
compensation 

Dynamic  relation  (20)  and  (21)  is  used  to  actively 
control  the  first  joint  and  passively  move  the  second 
joint.  The  proposed  control  law  is  a  modified 
version  of  the  standard  PD  control  in  the  joint  space 
with  gravity  compensation  and  is  expressed  as 

(22) 


where  9  =  9q  —  9  is  the  joint  position  error  defined 
as  the  difference  between  the  reference  set  point 
0£,and  the  current  joint  angle  9,g(9)  is  the 
estimation  of  joint  gravitational  torque,  and  Kp  and 
K^^are  the  diagonal  gain  matrices  for  the 
proportional  and  derivative  control  actions, 
respectively.  In  addition  to  the  standard  PD  control 
plus  gravity  compensation,  an  elastic  term  is 
introduced  in  order  to  compensate  for  the  preload 
spring  located  between  phalanxes  joint. 

The  joint  elastic  torque  is  expressed  as  =  /cA02- 

For  fully  actuated  hand  based  on  our  previous  paper 
[2]  we  used  a  controller  which  simulates  effect  of 
virtual  elements.  These  virtual  elements  are  dampers 
at  each  joint  and  a  spring-damper  attached  to  tip  of 
the  finger  and  the  other  side  moves  along  a  semi¬ 
circle.  Using  this  method  the  hand  can  grasp  an 
object  which  is  located  inside  the  semi-circle.  The 
virtual  elements  are  shown  in  Fig. 3. 

Desired  Point 


Fig.3.  Virtual  Elements  Used  for  Control  of 
Fullyactuated  Hand 


6  Numerical  Simulations 

Based  on  results  of  optimal  design  a  model  of  two 
phalanx  finger  is  made  in  Adams  multi-body 
dynamic  modelling  software  linked  with  Matlab  and 
Simulink  software  to  implement  the  controller.  Both 
phalanxes  have  the  equal  length  and  c/a  ratio  is  0.6 
based  on  optimal  design  analysis.  Torsion  spring  is 
located  between  two  phalanxes.  The  revolute  joint  is 
located  at  joints  and  a  motor  is  moving  the  finger 
which  is  shown  by  round  arrow.  A  circular  object  is 
chosen  to  be  grasped  and  the  proposed  controller  is 
used  to  control  finger  movement. 


Ta^Kpd-KDd  +  g(e)  +  Te 


By  applying  the  control  algorithm  to  the  mechanism 
the  finger  can  grasp  the  object.  The  grasping 
sequence  is  shown  in  Fig.  3. 


Fig.  4.  The  grasping  sequence  of  a  circular  object  by 
underactuated  hand 


The  finger  tip  angle  respect  to  horizontal  plane  is 
shown  in  Fig.  5.  It  starts  from  90  degree  and  after 
first  phalanx  has  contact  with  the  object  the  rate  of 
change  of  angle  is  changed. 


Fig.  7.  The  grasping  sequence  of  a  circular  object  by 
a  fully  actuated  hand 


Angle  between  two  phalanxes  is  shown  in  Fig.  5. 
The  angle  starts  from  180  degree  and  gradually 
changes  until  second  phalanx  touches  the  object. 


Fig.  5.  Finger  tip  angle  respect  to  horizontal  plane 
for  underactuated  hand 
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Fig.  8.  Finger  tip  angle  respect  to  horizontal  plane 
for  fully  actuated  hand 


Fig. 9.  Angle  between  two  phalanxes  for  fully 
actuated  hand 


Fig.6.  Angle  between  two  phalanxes  for 
underactuated  hand 


Two  general  design  which  are  fully  actuated  and 
underactuated  and  appropriate  control  methods  for 
each  of  them  are  provided  for  prosthetic  hand.  In 
order  to  compare  the  functionality  of  these  two 
methods  a  fully  actuated  finger  with  the  same 
dimension  and  with  a  similar  object  to  grasp  is 
simulated.  Power  grasping  algorithm  which 
described  before  is  used  in  order  to  control  the 
movement.  The  sequence  of  movement  is  shown  in 
Fig.  6.  The  finger  tip  angle  respect  to  horizontal 
plane  is  shown  in  Fig.  7  and  the  angle  between  two 
joints  is  shown  in  Fig.  8.  As  we  can  see  both 
methods  are  capable  to  perform  grasping  and  the 
graphs  are  very  similar  for  both  methods. 


Conclusion 

In  this  paper  two  type  of  hand  which  are  fully 
actuated  and  underactuated  hand  studied. 
Appropriate  control  methods  are  provided  for 
precision  and  power  grasping  for  fully  actuated 
hand.  For  underactuated  hand  the  optimal  design 
condition  derived  and  tested.  Appropriate  controller 
for  hand  movement  proposed  and  tested  through 
numerical  simulation.  Two  methods  of  power 
grasping,  based  on  fully  actuated  and  underactuated 
hand  compared  and  the  results  were  close  which 
means  both  method  are  capable  of  providing  secure 
grasp  for  prosthetic  hand. 
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Abstract:  -  This  paper  presents  a  robust  control  approach  to  control  the  movement  of  a  prosthetic  hand  based  on 
an  estimation  of  the  finger  angles  using  surface  electromyographic  (sEMG)  signals.  All  the  available  prosthesis 
uses  the  motion  control  strategy  which  is  pre-programmed  get  initiated  when  some  threshold  value  of  the 
measured  sEMG  signal  is  reached  for  a  particular  motion  set.  Here  we  use  a  novel  approach  to  model  the  finger 
angle  which  utilizes  System  Identification  (SI)  techniques.  The  dynamic  model  obtained  allows  the 
instantaneous  control  for  the  finger  motions.  sEMG  data  is  acquired  using  an  array  of  nine  sensors  and  the 
corresponding  finger  angle  is  acquired  using  a  finger  angle  measuring  device  and  a  data  glove.  A  nonlinear 
Teager-Kaiser  Energy  (TKE)  operator  based  nonlinear  spatial  filter  is  used  to  filter  sEMG  data  whereas  the 
angle  data  is  filtered  using  a  Chebyshev  type- II  filters.  An  EMG-angle  estimation  model  is  proposed  then  the 
estimated  angles  are  used  to  control  to  control  movement  of  a  prosthetic  hand  using  a  robust  approach  which 
can  deal  with  modeling  uncertainty.  The  overall  performance  of  the  prosthetic  hand  are  measured  based  on 
numerical  simulation.  The  resulting  fusion  based  output  of  this  approach  plus  the  robust  controller  gives 
improved  the  prosthetic  hand  motion  control. 

Key-Words:  Robotics,  Control,  Prosthetics,  Robust  Control,  sEMG,  Finger  Angle  Model,  System  Identification. 


1  Introduction 

over  1.6  million  people  were  reported  to  have 
amputations  during  2005  in  the  United  States,  [1]. 
The  ongoing  wars  in  the  Afghanistan  and  Iraq 
results  in  the  continuously  increase  of  this  number, 
[2].  This  makes  it  important  to  have  an  efficient  and 
dexterous  prosthesis  that  can  improve  the  daily  lives 
of  the  amputees.  Currently  available  prosthesis  lacks 
the  tactile  or  proprioceptive  feedback  for  grasping 
which  makes  the  30-50%  of  the  upper  extremity 
amputees  not  to  use  their  prosthesis  [3,  4].  One  of 
the  most  important  aspects  of  the  prosthesis  is  to 
have  a  good  control  for  the  daily  life  tasks  which  is 
a  prime  factor  to  make  the  amputee  to  accept  the 
device  for  regular  use.  There  is  lots  of  work  need  to 
be  done  before  we  reach  to  have  a  fully  dexterous 
hand  and  the  precise  and  effective  control  is  of  high 
demand.  The  prosthetic  hand  need  to  be  able  to  have 
good  control  for  the  intended  finger  angle  sand 
forces  to  perform  a  certain  task.  The  input  signal  for 
the  control  of  the  prosthesis  is  the  surface 
electromyographic  (sEMG)  which  is  originates  from 
the  mind  of  the  amputee.  The  sEMG  signals  can  be 


acquired  from  skeletal  muscles  on  the  residual  part 
of  the  upper  extremity.  In  this  work,  we  assume  that 
the  amputation  is  transradial,  and  hence  sufficient 
muscle  mass  is  accessible  for  sEMG  data 
acquisition.  There  are  two  types  of  EMG  electrodes 
available  for  use,  one  that  needs  to  be  imbedded  in 
the  muscle  mass  i.e.  needle  electrodes  and  the  others 
are  the  surface  electrodes.  This  makes  the  sEMG  an 
obvious  choice  as  a  control  input  signal  because  it 
eliminates  the  problems  associated  with  surgeries 
and  regular  hygiene  for  the  user  of  implanted 
electrodes.  sEMG  signal  is  an  electric  voltage  signal 
with  amplitude  ranging  between  -5  and  -i-5  [mV]. 
The  sEMG  signals  are  highly  dynamic  in  nature 
which  changes  with  different  limb  movements  and 
required/applied  forces  for  these  movements  and 
other  tasks.  The  issue  of  muscle  fatigue  makes  the 
sEMG  signal  further  intricate.  Therefore  to  have 
prosthesis  with  good  control  of  hand/finger 
positions,  required  forces  and  at  the  same  time  that 
can  compensate  for  the  issue  of  muscle  fatigue,  the 
sEMG  seems  to  be  the  best  choice.  Almost  all  of  the 
currently  available  prosthetics  using  EMG  or  sEMG 


sensors  and  compute  some  threshold  value  of  this 
signal  -  for  example  the  RMS  value  -  to  activate  a 
pre-programmed  motion  and/or  force  set  of  the 
artificial  prosthetic  hand.  The  user  only  initiates  the 
resulting  motion/force,  but  the  further  control  is  not 
available  which  is  quite  different  than  what  a 
healthy  subject  uses  to  control  his/her  hand.  The 
natural  hand  of  a  non-amputee  executes  the  complex 
motion  sets  by  controlling  the  motion  of  the  fingers 
at  every  instance  in  time.  To  mimic  this 
characteristic  of  the  natural  hand,  we  propose  to  use 
dynamic  models  relating  sEMG  data  with  finger 
movement.  The  potential  of  such  models  is  obvious 
from  the  operational  point  of  view,  but  also  allows 
the  incorporation  of  muscle  fatigue  dynamics  to  be 
included  in  the  control  algorithm  [9-13]. 

The  control  algorithm  of  a  prosthetic  hand  can  be 
divided  into  two  parts.  The  first  part  is  extracting 
information  from  sEMG  signal  to  find  the  intended 
motion,  and  the  second  part  is  using  this  command 
signal  to  control  a  robotic  hand. 

Previously  there  have  been  numerous  efforts  to 
extract  the  useful  information  the  sEMG  signals  [5]. 
Some  of  these  methods  are  based  on  the  wavelet 
analysis,  artificial  neural  networks,  and  other  feature 
extraction  methods  to  make  use  of  sEMG  for 
prosthetic  control  [5].  sEMG  is  presented  as  an 
autoregressive  (AR)  model  with  the  delayed 
intramuscular  EMG  signal  as  the  input  in  the 
research  work  of  [6].  In  our  work,  we  rely  only  on 
sEMG  since  no  injected  electrodes  will  be  used  to 
obtain  EMG  signals.  Hence  the  task  is  to  develop  a 
model  and  an  estimation  scheme  for  describing  the 
dynamics  of  the  skeletal  muscle  force  and  finger 
angles  from  the  sEMG  signals.  Some  of  the  recent 
efforts  in  this  direction  are  evident  in  the  research 
work  of  [7-13]. 

Present  research  focus  on  the  dynamic  modeling  and 
estimation  of  the  angles  of  the  proximal 
interphalangeal  (PIP)  joint  of  the  index  and  the 
middle  finger  with  the  corresponding  sEMG  signal 
and  Robust  Control  design  for  prosthetic  hand  to 
follow  this  signal.  Two  different  systems  and 
experimental  set-ups  are  used  to  acquire  the  data  for 
the  index  and  middle  finger  angles  and  the 
corresponding  sEMG  signals.  Eor  the  index  finger 
data  an  array  of  nine  sEMG  sensors  is  used  to  record 
sEMG  signals  and  joint  angles  are  recorded  using  a 
wheel  potentiometer  from  the  arm  of  a  healthy 
subject.  Eor  the  middle  finger  data  an  array  of  three 
sensors  is  used  to  record  sEMG  signals  and  joint 
angles  are  recorded  using  a  NODNA  X-IST 


2  EMG  Angle  Estimation  Model 

The  filtered  sEMG  and  angle  data  is  smoothed  with 
a  smoothing- spline  curve  fitting.  Smoothing  spline 
is  a  piecewise  polynomial  computed  from  a 
smoothing  parameter  (p)  of  0.993  is  fitted  to  the 
filtered  sEMG  and  angle  data.  Smoothing  parameter 
(p)  is  a  number  between  0  and  1.  By  varying  the 
value  of  p  from  0  to  1  we  can  change  the  smoothing 
spline.  Eor  p  =  0  the  smoothing  spline  is  a  least- 
square  straight-line  approximation  to  the  data, 
whereas  for  p  =  1  it  gives  the  "natural”  cubic  spline 
interpolant  to  the  data  [1].  Smoothing  spline  s  is 
designed  for  a  specific  weight  (Wj)  and  smoothing 
parameter  and  minimizes  the  function  /,  which  is 
given  as: 

y  =  p Si Wiiji  -  s(xi)y  +  (1  -  p)  j i^Ydx,  (1) 

where  Xj  and  yi  are  predictor  and  response  data 
respectively.  By  choosing  a  suitable  value  of  the 
smoothing  parameter  p  we  make  the  error  E{s)  = 

dE  S 

and  roughness  small. 

In  our  case  we  took  the  smoothing  parameter  p  as 
0.993  [I]. 

Both  the  filtered  and  smoothed  sEMG  and  angle 
data  (input  and  output)  are  used  to  make  model  by 
applying  System  Identification  (SI)  techniques.  The 
sEMG  is  the  input  to  the  system  and  the  intended 
PIP  joint  angle  is  the  output.  Multiple  linear  and 
nonlinear  models  are  obtained  for  modeling  of 
sEMG  and  PIP  joint  angle  signals  for  the  index 
finger  of  the  dominant  hand  of  a  healthy  subject. 
Eive  linear  and  three  nonlinear  models  are  obtained 
for  the  input  and  output  data  set. 

The  model  order  of  the  various  models  used  in  this 
work  are  as  follows:  linear  models  for  the  input  and 
output  data  set,  OE  model  of  order  16,  ARX  model 
of  order  18,  ARM  AX  model  of  model  order  16, 
State-Space  model  with  subspace  method  (N4SID) 
of  order  18  and  a  State-Space  model  with  prediction 
error/maximum  likelihood  method  (PEM)  of  order 
12  are  obtained  using  SI,  [2]. 

The  nonlinear  models  for  the  input  and  output  data 
set  are  obtained  as,  the  nonlinear  Wiener- 
Hammerstein  models  with  nonlinearity  estimators  of 
‘piecewise  linear  -  pwlinear,’  ‘sigmoidnet,’  and 
‘wavelet  network,’  [2]. 


All  these  linear  and  nonlinear  models  are  simulated 
and  the  simulated  output  i.e.  estimated  angle  data 
and  the  measured  angle  data  is  used  in  an  adaptive 
data  fusion  based  algorithm  to  obtain  the  final 
fusion  based  output.  The  final  fusion  based  output  is 
used  as  a  control  signal  to  design  a  controller  which 
controls  the  angles  of  the  joint  of  the  two  link  robot. 
Results  are  presented  in  the  following  parts.  Fig.  1 
shows  the  measured  and  data  fusion  based  angle 
signal.  This  signal  is  used  as  a  control  input  for  the 
controller. 


Curve  Fitted  Angle  Vs.  Data  Fusion  Using  Linear  -  NL  Models 


Fig.  7:  Curve  Fitted  Vs.  Data  Fusion  Based  Angle 
Using  Linear-Nonlinear  Models. 


3  Prosthetic  Hand  Control 

The  controller  performance  of  a  prosthetic  hand  is 
relying  on  two  factors.  Accurate  intention 
estimation  model  and  powerful  control  algorithm  to 
which  use  the  command  signal  from  the  estimation 
model  and  provide  accurate  movement  for  robotic 
part  of  the  hand.  The  later  part  good  performance 
requires  the  consideration  of  efficient  dynamic 
models  and  sophisticated  control  approaches. 
Traditionally,  control  law  is  designed  based  on  a 
good  understanding  of  system  model  and 
parameters.  Thus,  a  detailed  and  correct  model  of  a 
robotic  hand  is  needed  for  this  approach  [21,  22]. 

A  finger  can  be  considered  as  a  3  link  robot,  while 
in  extracting  the  model  for  angle  estimation,  the  PIP 
joint  (the  second)  angle  is  considered,  the  third  link 
angle  normally  has  about  70%  of  the  second  joint 
angle  and  the  first  link  angle  is  not  considered  in 
this  research.  As  a  result  a  two-link  planar  robot  is 


considered  as  a  plant  to  investigate  the  control 
approach  performance. 

A  dynamic  model  can  be  derived  from  the  general 
Lagrange  equation  method.  The  modeling  of  a  two- 
link  planar  nonlinear  robotic  system  with 
assumption  of  only  masses  in  the  two  joints  can  be 
found  in  the  literature,  e.g.,  [3,  4].  However,  in 
practice,  the  robot  arms  have  their  mass  distributed 
along  their  arms,  not  only  masses  in  the  joints  as 
assumed.  Thus,  it  is  desired  to  develop  a  detailed 
model  for  two-link  planar  robotic  systems  with  the 
mass  distributed  along  the  arms.  We  present  a  new 
detailed  consideration  of  any  mass  distributions 
along  robot  arms  in  addition  to  the  joint  mass. 
Moreover,  it  is  also  necessary  to  consider  numerous 
uncertainties  in  parameters  and  modeling.  Thus, 
robust  control,  robust  adaptive  control  and  learning 
control  become  important  when  knowledge  of  the 
system  is  limited.  We  need  robust  stabilization  of 
uncertain  robotic  systems  and  furthermore  robust 
performance  of  these  uncertain  robotic  systems. 
Robust  stabilization  problem  of  uncertain  robotic 
control  systems  has  been  discussed  in  [21-24]  and 
many  others.  Also,  adaptive  control  methods  have 
been  discussed  in  [21,23]  and  many  others.  Because 
the  closed-loop  control  system  pole  locations 
determine  internal  stability  and  dominate  system 
performance,  such  as  time  responses  for  initial 
conditions,  papers  [26,28]  consider  a  robust  pole 
clustering  in  vertical  strip  on  the  left  half  splane  to 
consider  robust  stability  degree  and  degree  of 
coupling  effects  of  a  slow  subsystem  (dominant 
model)  and  the  other  fast  subsystem  (non-dominant 
model)  in  a  two-time-scale  system.  A  control  design 
method  to  place  the  system  poles  robustly  within  a 
vertical  strip  has  been  discussed  in  [22,  23], 
especially  [24]  for  robotic  systems.  However,  as 
mentioned  above,  for  accurate  prosthetic  hand 
control  there  is  a  need  of  a  detailed  and  practical 
two-link  planar  robotic  system  modeling  with  the 
practically  distributed  robotic  arm  mass  for  control. 

Therefore  a  practical  and  detailed  two-link  planar 
robotic  systems  modeling  and  a  robust  control 
design  for  this  kind  of  nonlinear  robotic  systems 
with  uncertainties  considered  for  robust  control 
approach  with  both  Hoc  disturbance  rejection  and 
robust  pole  clustering  in  a  vertical  strip.  The  design 
approach  is  based  on  the  new  developing  two-link 
planar  robotic  system  models,  nonlinear  control 
compensation,  a  linear  quadratic  regulator  theory 
and  Lyapunov  stability  theory. 


4  Modeling  of  Prosthetic  Hand 

Systems 

The  dynamics  of  a  rigid  revolute  robot  manipulator 
can  be  described  as  the  following  nonlinear 
differential  equation  [21,  22,  24]: 

Fe  =  M(q)q  +  V(q,q)q  +  N(q,q)  (2) 

N(q,q)  =  G(q)  +  Fdq+Fs(q)  (3) 

where  M(q)  is  an  n  x  n  inertial  matrix,  V(q,  q)  an  n 
X  n  matrix  containing  centrifugal  and  coriolis  terms, 
G(q)  an  n  X  1  vector  containing  gravity  terms,  q(t) 
an  n  xl  joint  variable  vector,  Fc  an  n  xl  vector  of 
control  input  functions  (torques,  generalized  forces), 
F^an  n  x  n  diagonal  matrix  of  dynamic  friction 
coefficients,  and  Fs(q)  an  n  x  1  Nixon  static  friction 
vector. 

However,  the  dynamics  of  the  robotic  system  (2,3) 
in  detail  is  needed  for  designing  the  angle  control, 
i.e.,  especially,  what  matrices  M(q)  ,  V(q,  q)  and 
G(q)  are. 

Consider  a  two-link  planar  robotic  system 
representing  the  prosthetic  hand  finger  in  Fig.  8, 
where  the  system  has  its  joint  mass  m^  and  m2  of 
joints  1  and  2,  respectively,  robot  arms  mass  m^^ 
and  m2r  distributed  along  arms  1  and  2  with  their 
lengths  li  and  I2  ,  generalized  coordinates  and 
q2  ,  i.e.,  their  rotation  angles,  q  =  [qi.q2]5  control 
torques  (generalized  forces)  fi  and  f2  ,  Fc  =  [fi,  f2]. 


Fig  8-  A  two  link  robot  system  representing 
prosthetic  hand 


5  Robust  Control 

In  view  of  possible  uncertainties,  the  terms  in  (2,3) 
can  be  decomposed  without  loss  of  any  generality 
into  two  parts,  i.e.,  one  is  known  parts  and  another  is 
unknown  perturbed  parts  as  follows  [22,  23]: 

M  =  Mo  +  AM,  N  =  No  +  AN,  V  =  Vo  +  AV  (4) 

where  Mo,  No,  Vo  are  known  parts,  AM,  AN,  AV  are 
unknown  parts.  Then,  the  models  in  previous 
section  can  be  used  not  only  for  the  total  uncertain 
robotic  systems  with  uncertain  parameters,  but  also 
for  a  known  part  with  their  nominal  parameters  of 
the  systems. 

Following  [24],  we  develop  the  torque  control  law 
as  two  parts  as  follows: 

Fc  =  Mo(q)qd  +  Vo(q,  q)q  +  No(q,  q)  - 

Mo(q)u  (5) 

where  the  first  part  consists  of  the  first  three  terms 
in  the  right  side  of  (5),  the  second  part  is  the  term  of 
u  that  is  to  be  designed  for  the  desired  disturbance 
rejection  and  pole  clustering, q^  is  the  desired 

trajectory  of  q,  however,  the  coefficient  matrices  are 
with  all  nominal  parameters  of  the  system.  Define 

an  error  between  the  desired  q^  and  the  actual  q  as: 

e  =  qd  -  q  (6) 

From  (2)  and  (4)-(6),  it  yields: 

e  =  M-Hq)[AM(q)qd  +  AV(q,  q)q  +  AN(q,  q)  + 
Mo(q)u]  =  w  +  Ee  +  Fu  +  u  (7) 

E  = -M-Hq)AV(q,q), 

F  =  -M-Hq)AM(q), 

w  =  — Fqd  ~  Eqd  +  M“^AN  (8) 

From  [24],  we  can  have  the  fact  that  their  norms  are 
bounded: 

llwll  <  6w,  IIEII  <  6e,  IlFll  <  6f  (9) 

Then,  it  leads  to  the  state  space  equation  as: 

X  =  Ax  +  Bu  +  B[0  E]x  +  BFu  +  Bw 


(10) 


X  = 


[ei  e2  ei  62]', 


A  = 


Lo 


(1 -6f)/6e  >  £1  >  0  ,(1 -6f-£i6e)6  >  £2  >  0  (19) 

there  always  exists  a  matrix  P  >  0  satisfying  the 
(12)  following  Riccati  equation: 


The  last  three  terms  denote  the  total  uncertainties  in 
the  system.  The  desired  trajectory  for 

manipulators  to  follow  is  to  be  bounded  functions  of 
time.  Its  corresponding  velocity  q^  and  acceleration 
qd,  as  well  as  itself  q^  ,  are  assumed  to  be  within 
the  physical  and  kinematic  limits  of  manipulators. 
They  may  be  conveniently  generated  by  a  model  of 
the  type: 


A'„iP  +  PA„i  -  (l  -  6f  -  £i6e  -  f )  PBB'P  + 
where 


A„i  =  A  +  ttil 


I2 

.  0  ail2 


(21) 


qd(t)  +  Kvqd(t)  +  Kpqd(t)  =  r(t)  (13) 

where  r(t)  is  a  2-dimensional  driving  signal  and  the 
matrices  Ky  and  Kp  are  stable. 

The  design  objective  is  to  develop  a  state  feedback 
control  law  for  control  u  in  (7)  as 


Then,  a  robust  pole-clustering  and  disturbance 
rejection  control  law  in  (7)  and  (14)  to  satisfy  (17) 

and  (18)  for  all  admissible  perturbations  E  and  F  in 
(11)  is  as: 

u  =  -Kx  =  -rB'Px  (22) 


u(t)  =  Kx(t)  (14) 

such  that  the  closed-loop  system: 

X  =  (A  -  BK  +  B[0  E]  -  BFK)x  +  Bw  (15) 

has  its  poles  robustly  lie  within  a  vertical  strip  : 
A(Ac)  G  n  =  {s  =  X  -h  jy|  —  a2  <  X  <  — <  0}  (16) 

and  a  S -degree  disturbance  rejection  from  the 

disturbance  to  the  state  x,  i.e., 

llTxw(s)lloo  =  ll(sl-Ac)-^B||oo  <6  (17) 

Ac  +  A  -  BK  +  B[0  E]  -  BEK  (18) 

we  derive  the  following  robust  control  law  to 
achieve  this  objective  is  discussed  in  [20,24]. 

Consider  prosthetic  hand  uncertain  system  (15)  with 
(2)-(18)  where  the  unstructured  perturbations  in  (8) 
with  the  norm  bounds  in  (9),  the  disturbance 

rejection  index  6  >  0  in  (17),  the  vertical  strip  ^  in 
(16)  and  a  matrix  Q  >  0. 


if  the  gain  parameter  r  satisfies  the  following  two 
conditions: 

(i)  r  >  0.5  and  (23) 

(ii)  2a2P  +  A'P  +  PA-(^)l-[2r(H-6f)  + 

£i6e]PBB'P  >  0  "  (24) 

Proof  for  the  approach  is  provided  in  [24]. 

It  is  also  noticed  that: 


It  is  evident  that  condition  (i)  is  for  the  degree 

stability  and  S  degree  disturbance  rejection,  and 
condition  (ii)  is  for  the  a2  degree  decay,  i.e.,  the  left 
vertical  bound  of  the  robust  pole-clustering. 

There  is  always  a  solution  for  relative  stability  and 
disturbance  rejection  in  this  form.  It  is  because  the 
Riccati  equation  (20)  guarantees  a  positive  definite 
solution  matrix  P,  and  thus  there  exists  a  Lyapunov 
function  to  guarantee  the  robust  stability  of  the 
closed  loop  uncertain  robotic  systems.  The 
nonlinear  compensation  part  in  (7)  has  a  similar 
function  to  a  feedback  linearization. 


With  the  selection  of  the  adjustable  scalars  Si  and 
S2,  i.e.. 


6  Numerical  Simulation 


Based  on  the  proposed  control  approach,  a  two  link 
robot  is  modeled  considering  uncertainties.  Then  the 
input  signal  from  sEMG- Angle  estimation  model  is 
used  as  reference  signal  to  the  plant  and  the 
performance  is  evaluated. 

The  system  parameters  are:  link  mass:  m2  =  m2  = 
O.OSKg  ,  lengths  li  =  I2  =  0.03m,  angular 
positions  qi;q2(rad),  applied,  torques  fi,f2(Nm). 

The  initial  states  are  set  as  qi(0)  =  q2(0)  =  0,  and 
qi(0)  =  (^2(0)  =  0.  The  parametric  uncertainties 
are  assumed  to  satisfy  (11)  with  6f  =  0.05,  dg  =  0.4 
,  6n  =  0.1.  Select  the  adjustable  parameters 
El  =  0.01,  £2  =  0.01  from  (19),  disturbance 
rejection  index  6  =  0.1  ,  the  relative  stability  index 
ai  =  0.1  ,  and  the  left  bound  of  vertical  strip 
a2  =  2000  since  we  want  a  fast  response.  We 
solved  the  Riccati  equation  (20) 

to  get  the  solution  matrix  P  and  the  gain  matrix  as: 

ri2693l2  158412' 

^  “  158412  164312. 

K  =  rB'P  =  [95OI2  985I2] 


Numerical  simulation  is  done  in  Matlab  software. 
For  the  plant  the  above  mentioned  parameters  is 
used.  Two  sets  of  simulation  are  done.  In  the  first 
simulation  nominal  plant  is  used  and  for  the  second 
simulation  the  perturbed  model  considering 
uncertainty  is  tested.  The  input  signal  for  both 
simulations  is  measured  angles  from  the  above 
mentioned  experiments  from  PIP  joint.  For  the  third 
joint  the  70%  of  the  measured  angle  of  PIP  joint 
used  which  is  a  good  estimate  of  that  signal. 

The  system  response  with  nominal  plant  and 
perturbed  plant  to  the  input  signal  respectively  are 
shown  in  Fig.  9  and  Fig.  10.  As  it  is  shown  the  input 
and  output  signals  are  close  and  system  is  capable  of 
following  the  command  signal  with  sufficient 
accuracy.  Obviously  the  system  has  a  better 
performance  in  case  of  nominal  plant  compare  to  the 
perturbed  model  in  which  the  uncertainties  are 
applied. 


4)»S 


Fig.  9-  System  response  to  the  nominal  plant 


Fig.  9-  System  response  to  the  perturbed  plant 


7  Conclusion 

The  dynamic  modeling  of  the  filtered  and  smoothed 
sFMG  and  PIP  joint  angle  of  the  index  and  middle 
finger  is  achieved  using  SI  with  sFMG  as  the  input 
and  the  joint  angle  as  the  output.  Multiple  linear  and 
nonlinear  models  are  obtained  for  the  input  and 
output  data.  To  achieve  a  better  estimate  of  the 
finger  angles,  an  adaptive  probabilistic  Kullback 
Information  Criterion  (KIC)  for  model  selection 
based  data  fusion  algorithm  is  applied  to  the  linear 
and  nonlinear  models  outputs.  The  estimation 
method  is  mixed  with  a  robust  control  algorithm  for 
a  two  link  robot  to  show  the  performance  and 
functionality  of  the  prosthetic  hand. 

As  this  initial  study  shows  potential  in  the  pursuit  of 
controlling  an  artificial  hand  on  an  instantaneous 
basis,  we  will  further  this  work  in  the  future  by 
improving  the  data  collection  techniques  and 
optimizing  the  experimental  procedure  as  well  as 
using  other  advanced  control  techniques  as  adaptive 
control. 
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ABSTRACT 

A  control  scheme  for  achieving  object  power  grasping  by 
a  prosthetic  hand  is  proposed.  The  control  scheme  is 
based  on  defining  virtual  spring -damper  between  finger 
tip  and  desired  point,  and  a  semi  circular  path  for  finger 
tip.  It  is  shown  that  the  suggested  control  scheme  provides 
satisfactory  performance  in  power  grasping  of  prosthetic 
hand,  without  the  need  for  additional  complexity 
regarding  equations  for  inverse  kinematics,  or  inverse 
dynamics,  and  the  information  on  tactile  or  force  sensing 
or  even  object  shape. 
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1.  Introduction 

Human  hand  is  one  of  the  most  important  and  complex 
parts  of  the  body,  which  has  the  ability  to  handle  different 
tasks.  The  ultimate  goal  of  robotic  hand  is  to  achieve  the 
functionality  of  a  human  hand.  In  the  past  three  decades, 
there  have  been  numerous  investigations  to  achieve 
dexterity  and  ability  of  human  hand,  especially  in  the 
fields  of  humanoid  robotics  and  prosthetic  hand  [1-6].  In 
spite  of  all  these  advances  in  this  field,  the  current  state  of 
research  on  prosthetic  hands  is  far  from  that  objective  of 
achieving  the  functionality  of  human  hand. 
Commercially  available  prosthetic  hands  have  very 
limited  functionality  and  they  are  just  simple  grippers. 
The  present  research  on  prosthetic  hands  involves 
complex  control  schemes  to  achieve  the  most  important 
functions  of  the  hand  [7-8]. 

Grasping  can  be  categorized  into  two  main  groups: 
precision  and  power  grasping.  In  precision  grasping  the 
object  is  held  by  tips  of  the  fingers,  while  in  power 
grasping,  the  whole  the  finger  is  active  and  in  contact 
with  the  object  [9].  Many  research  works  addressed  the 
precision  grasping  problem  [12-15]  mainly  because  of  the 
well-established  techniques  for  control  of  end  effector; 
however  the  problem  of  power  grasping  is  not  studied  in 
depth. 

Many  control  methods  require  the  knowledge  of  the  shape 
of  the  object.  For  humans  this  information  is  available  by 


visual  feedback  from  eyes,  while  in  case  of  a  prosthetic 
hand  this  visual  information  is  not  directly  available  for 
hand  controller,  and  the  only  available  information  is 
electromyographic  (EMC)  signal  related  to  patient’s  arm 
muscle  activities.  However,  normally  the  EMG  signal  is 
not  available  for  all  individual  joints  and  besides,  due  to 
measurement  noise,  accessing  high  quality  EMG  signal  is 
hard  [10].  Moreover,  using  EMG  signal  to  control  all  the 
movements  requires  lot  of  attention  during  grasping  and 
leads  to  fatigue  for  the  amputees  [11].  Hence  it  is  required 
for  prosthetic  hand  to  be  semi-autonomous  which  means  a 
part  of  command  information  will  be  provided  by  the 
EMG  signal  and  the  rest  of  the  required  command  should 
be  provided  automatically  by  hand  controller. 

Defining  finger  trajectory  without  the  knowledge  of  shape 
of  object  to  be  grasped  is  a  challenging  task  for  many  path 
planning  techniques.  Eor  multi  DOEs  robots  there  are  two 
common  methods  for  trajectory  planning  which  are 
“inverse  kinematic”  and  “inverse  dynamic”  [12-15].  Both 
these  methods  require  object  shape  and  are  based  on 
solving  optimization  problem  which  requires  high 
computation,  hence  they  are  hard  to  implement  for  real¬ 
time  applications. 

To  avoid  solving  the  path  planning  problem  for  prosthetic 
hands,  many  researchers  advocated  under-actuated 
mechanisms,  which  are  capable  of  adapting  to  object 
shape  mechanically  and  without  additional  computation 
[16-18].  In  these  mechanisms,  the  number  of  actuators  are 
less  than  the  DOEs,  and  because  of  less  actuators  they 
have  less  weight.  However  fewer  actuators  result  in  less 
functionality,  because  fingers  joints  can’t  move 
independently. 

Arimoto  et  al.  [19]  used  “virtual  spring-damper 
hypothesis”  for  control  of  robotic  arm-hand  systems.  A 
similar  method  called  “virtual  model  control”  is  also 
suggested  by  J.Pratt  et  al.  [20]  used  for  walking  robots, 
and  it  is  based  on  defining  virtual  forces  between  two 
points.  Both  methods  are  based  on  the  use  of  Jacobian 
matrix  to  relate  task  space  movement  to  joint  space.  In 
[20]  it  is  shown  that  any  kind  of  force  can  be  defined 
between  two  points  and  the  other  study  [19]  shows  that 
use  of  spring-damper  forces  will  result  in  human  like 
movement.  Erom  physiological  point  of  view,  human 
skilled  multi -joint  reaching  movement  has  these 


characteristics  that  1)  endpoint  trajectory  become  a  quasi¬ 
straight  line  and  less  variable,  2)velocity  profiles  of  the 
endpoint  has  a  bell- shape,  and  3)  joint  trajectories  are 
rather  variable  from  trial  to  trial  [19]. 

In  this  paper,  a  new  control  scheme  is  proposed  that  can 
efficiently  address  the  problem  of  power  grasping  without 
complete  knowledge  of  the  shape  of  the  object  which  may 
be  called  “blind  power  grasping”  for  prosthetic  hand.  The 
proposed  method  is  based  on  the  works  by  Arimoto  et  al. 
[19]  using  virtual  spring-damper  (VSD)  hypothesis  used 
for  control  of  robotic  arm-hand  systems.  In  our  paper,  we 
use  the  above  mentioned  hypothesis,  in  particular  for  the 
power  grasping  of  a  prosthetic  hand.  In  this  method,  we 
define  a  virtual  spring-damper  between  finger  tip  and 
desired  point  for  control  of  movement  of  fingers.  Further, 
in  this  method  there  is  no  need  to  introduce  any 
performance  indices  to  solve  inverse  kinematics  uniquely 
and  Jacobian  pseudo-inverse  or  inverse  dynamics  which 
are  common  methods  to  define  trajectories  of  redundant 
DOFs  robots.  Besides,  in  the  present  method,  there  is  no 
need  for  any  information  on  tactile  or  force  sensing. 

The  paper  is  organized  as  follows.  In  Section  2  modeling 
of  prosthetic  hand  is  discussed.  Section  3  covers  virtual 
spring  damper  method.  Section  4  describes  control 
strategy.  Section  5  analyzes  the  efficiency  of  the  proposed 
control  scheme  using  numerical  simulation.  Finally, 
conclusion  and  discussion  are  presented  in  section  6. 


2.  Modeling  of  Prosthetic  Hand 

In  this  control  method,  controller  is  not  derived 
directly  from  dynamic  model  of  the  system.  Kinematics 
equation  and  Jacobian  matrix  are  the  required  for 
controller  design. 

A  model  of  a  robotic  hand  system  is  shown  in  Fig.l. 
The  model  consists  of  a  finger  with  3DOF  which 
represents  three  joints  of  a  finger  and  palm. 


Fig.  1:  Model  of  a  Robotic  Hand  System. 

In  this  paper  we  assume  the  following: 

1-  Movement  of  both  finger  and  object  are  confined  to  a 
two  dimensional  horizontal  plane,  and  therefore  there  is 
no  gravity  effect. 

2-  The  object  is  assumed  to  be  initially  stable  in  its 
position. 


3-  The  initial  movement  toward  object  is  handled  by 
amputee,  so  the  hand  is  close  enough  to  the  object  before 
grasping. 

The  position  of  the  tip  of  the  finger  is  evaluated  as  (see 
Figure  1): 

X  =  cos  +  I2  cos(qi  +  ^2) 

+  ^3  cos((7i  +  (72  +  qs)  (1) 

y  =  k  sin  (7i  + 12  sin(q^  +  ^2) 

+  I3  sin(qi  +  (72  +  (73)  (2) 

where,  h,  I2,  and  1 3  are  lengths  of  each  finger  and  qj,  q2, 
and  qs  are  angles  of  each  corresponding  joint. 

Based  on  above  equation  the  Jacobian  matrix  is  as: 


L/21  722  723J’ 

ill  =  -k  sin  (7i  -  I2  sin(qi  +  (72)  - 
I3  sin(qi  +  q2  +  qsl 

ji2  =  -I2  siniq^  +  (72)  -  I3  siniq^  +  ^2  +  ^3).  (5) 

ji2  =  -I2  siniq^  +  (72)  -  I3  siniq^  +  ^2  +  ^3).  (6) 

As  =  -k  sin((7i  +  ^2  +  ^3)  .  0) 

ill  =  k  cos  (7i  +  I2  cos(q^  +  ^2)  + 

k  cos(qi  +  q2+  ^3)  . 

>22  =  k  cos((7i  +  (72)  +  k  cos(qi  +  ^2  +  Q'a).  (9) 

>23  =  k  cos((7i  +  (72  +  (73)-  (10) 


3.  Virtual  Spring-Damper  Method 

“Virtual  model  control”  is  a  motion  control  scheme  that 
uses  simulations  of  virtual  components  to  generate 
desired  joint  torques  [20].  These  joints  produce  the  same 
effect  that  the  virtual  elements  placed  on  robot  would 
have  created;  hence  they  create  the  illusion  that  these 
virtual  elements  are  connected  to  the  real  robot.  Virtual 
elements  can  be  any  kind  of  real  physical  elements  such 
as  springs,  dampers,  gravity  fields,  nonlinear  fields  or  any 
other  components. 

Virtual  model  control  was  proposed  by  J.  Pratt  et  al  [20] 
for  biped  walking  robot.  In  a  study  by  Arimoto  [19]  on 
robotic  hand  arm  system,  it  is  shown  that  using  a  virtual 
spring  damper  between  robot  end  effector  and  desired 
point,  and  virtual  dampers  at  each  joint,  human  like 
movement  can  be  achieved. 

For  power  grasping  by  a  prosthetic  hand,  one  of  the  best 
options  is  the  use  of  Virtual  Spring-Damper  (VSD) 
hypothesis.  Some  benefits  of  VSD  control  scheme  are  that 
it  has  a  simple  structure  and  requires  relatively  less 
computation.  Besides,  it  doesn’t  need  inverse  dynamics  to 
precisely  define  the  robot  movement.  Thus,  we  use  spring 
set  points  instead  of  commanded  movement  and  robot 
automatically  adapts  its  shape.  Since  finger  joints  at 
prosthetic  hand  work  as  virtual  dampers,  which  is 
sensitive  to  velocity  and  not  to  position,  they  don’t  have  a 
forced  shape,  instead  just  finger  tip  follow  a  defined  path 
as  will  be  discussed  more  in  control  strategy  section. 

The  joint  torques  to  virtual  forces  is  given  by: 


T  =  fF, 


(11) 


where  x  is  the  torque,  and  F  is  the  force  due  to  virtual 
spring  damper  given  as 

F  =  —{^y[kx  +  /cAx),  (12) 

and 

'^spring -damper  ~  ~J  “f  kAx^,  (12) 

where  k  represents  the  stiffness  of  the  virtual  spring,  Ax  is 
distance  between  finger  tip  and  desired  point,  and  ^  is  the 
damping  ratio.  The  damping  force  is  defined  at  each  joint 
as 


^joints  damping 


=  -Cq, 


(14) 


where,  C  denotes  a  diagonal  positive  definite  matrix  as 
follows: 


C  =  fo  diagict, 


(15) 


Hence  control  signal  would  be  sum  of  these  two  terms 

u  =  -Cq  —  f  {q'){^^^kx  +  kAx).  (16) 

Higher  values  of  k  result  in  more  accurate  and  faster 
response  to  the  desired  point  and  higher  C  provides  more 
stability.  Thus  k  and  C  are  chosen  as  design  variables. 


4.  Control  Strategy 

Virtual  spring-damper  hypothesis  is  suitable  for  point  to 
point  control.  Defining  the  desired  trajectory  as  a 
semicircle  (in  order  to  have  a  full  grasp  of  the  object) 
given  by, 

^d  =  ih  +  ^2  +  h)  cos(t),  (17) 

ya  =  di  +  I2  +  (3)  0.  (18) 

Where  t  is  proportional  to  EMG  signal  which  is  scaled  to 
change  between  0<t<7r. 

As  shown  in  Fig.  2,  after  passing  this  semi-circle,  finger 
tip  goes  toward  center  to  make  a  tighter  grasping.  This  is 
achieved  by  defining  a  desired  point  close  to  center. 

As  mentioned  earlier,  the  goal  is  not  exactly  following  the 
defined  path.  If  the  object  is  big,  due  to  contact  of  hand 
and  object,  it  would  be  impossible  to  follow  exact  path 
and  following  this  path  is  just  to  achieve  grasping. 

Fig.  3  illustrates  the  physical  counterparts  of  the  virtual 
forces  for  control  strategy  and  Fig.  4  shows  structure  of 
the  proposed  control  system.  As  shown,  the  command 
force  comes  from  EMG  signal,  and  controller  provides 
the  movement  for  hand  which  has  dynamic  interaction 
with  the  object. 


Fig.  2:  Semi-Circle  Path  of  Finger  Tip 


Desired  Point 


Fig  3:  Physical  Counterparts  of  the  Virtual  Forces 


Fig.  4:  Control  Diagram  of  Prosthetic  Hand  System 


5.  Numerical  Simulation 

In  order  to  show  the  effectiveness  of  the  proposed  control 
strategy,  numerical  simulations  were  conducted  to  grasp 
three  different  objects,  based  on  the  physical  parameters 
of  a  hand  system  and  objects  summarized  in  Table  1. 

In  order  to  simulate  dynamics  of  the  hand  and  interaction 
with  object,  Adams  software  is  used.  This  software  is  a 
multi-body  analysis  simulation  program  that  solves  the 
rigid  body  dynamic  equilibrium  equations  and  directly 
interfaces  with  Matlab/Simulink  software  in  order  to 
implement  controller.  The  contact  between  object  and 
hand  is  modeled  and  three  sets  of  simulations  with 
different  objects  are  performed.  In  all  three  simulations 


the  same  control  strategy  is  used  which  shows  controller 
can  handle  grasping  without  information  about  physical 
parameters  of  object.  Fingers  and  objects  are  assumed  to 
be  rigid.  In  these  simulations  the  EMG  signal  is  assumed 
to  increase  linearly  with  time. 

Table  1.  Parameters  used  for  simulation 


Index  finger  link  1_ 5  cm 


Index  finger  link  2 

2.5  cm 

Index  finger  link  3 

2.5  cm 

Damping  at  joints 

0.01  kg/s 

Virtual  damping  ratio  (c) 

1 

Virtual  spring  stiffness  (k) 

50N/m 

Rectangular  object  width 

3  cm 

Circular  object  radius 

3  cm 

Star  shape  object  outer  radius 

2  cm 

5.1  Simulation  One 

For  first  simulation  a  rectangular  (cubic)  object  is  used, 
and  as  mentioned  earlier  the  movement  is  restricted  to  2D 
movement.  Object  is  not  moving  initially.  Hand  starts 
movement  from  open  finger  configuration.  The  hand 
positions  at  1  second  time  interval  are  shown.  Fig.  5 
shows  finger  tip  angle  with  respect  to  palm. 

As  it  is  shown  in  Fig.  6  the  grasping  is  accomplished 
successfully. 


I 

I 


Fig.  5:  Finger’s  Tip  Angle  at  Rectangular  Object 
Grasping 


5.2  Simulation  Two 

For  the  second  simulation  a  glass  (circular  object)  is  used. 
The  control  parameters  are  identical  to  previous 
simulation. 

As  shown  in  Fig.  7  the  grasping  is  done  successfully  and 
the  hand  positions  for  1  second  time  interval  are  depicted. 
Similarly  the  finger  tip  angle  respect  to  palm  is  shown  in 
Fig.  8. 

Regardless  of  object  shape,  by  use  of  proposed  control 
scheme  the  hand  can  successfully  grasp  objects. 


Fig.  6:  Rectangular  Object  Grasping  (1  Sec  Intervals) 


Fig.  7  (a-h)  :  Grasping  of  a  Glass  (1  sec.  Intervals) 
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Fig.  8:  Finger’s  Tip  Angle  at  Grasping  a  Glass 


5.3  Simulation  Three 

For  the  third  simulation  a  star  shape  object  is  used.  The 
control  parameters  are  identical  to  previous  simulation. 

As  shown  in  Fig.  9  the  grasping  is  done  successfully  and 
the  hand  positions  for  1  second  time  interval  are 
illustrated.  Final  position  of  grasping  in  3D  (isometric) 
view  is  depicted  in  Fig.  10.  Similarly  the  finger  tip  angle 
respect  to  palm  is  shown  in  Fig.  11. 

The  complicated  shape  of  object  shows  that  controller  is 
able  to  handle  grasp  for  wide  variety  of  objects,  without 
information  of  object  shape. 


(c) 


Fig.  9  (a-h)  :  Grasping  of  Star  Shape  Object  (1  sec. 
Intervals) 


Fig.  10  :  3D  (Isometric)  View  of  Star  Shape  Object  After 
Grasping 


Fig.  11:  Finger’s  Tip  Angle  at  Star  Shape  Object  Grasping 


6.  Conclusion 

In  this  paper  a  control  scheme  for  achieving  object  power 
grasping  by  a  prosthetic  hand  was  proposed.  The  control 
scheme  was  based  on  defining  virtual  spring-damper 
between  finger  tip  and  desired  point,  as  well  as,  damping 
at  finger  joints,  and  a  semi  circular  path  for  finger  tip.  It 
was  shown  through  three  sets  of  numerical  simulations  for 
different  objects  that  the  proposed  control  scheme  can 
effectively  be  used  for  power  grasping  of  prosthetic  hand. 
It  is  shown  that  regardless  of  object  shape  proposed 
control  method  is  successful  for  wide  variety  of 
situations.  The  proposed  method  did  not  rely  on  complex 
equations  of  inverse  kinematics,  or  inverse  dynamic  and 
hence  this  method  is  better  suitable  for  real-time 
applications.  The  immediate  future  investigation  is  the 
application  of  the  proposed  method  to  precision  grasping 
of  prosthetic  hand. 
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Abstract —  A  control  strategy  for  achieving  object  precision 
grasping  by  a  prosthetic  hand  is  proposed.  The  control 
strategy  is  based  on  defining  virtual  spring-damper  between 
two  finger  tips  and  damping  force  at  each  finger  joint.  It  is 
shown  that  the  proposed  control  strategy  provides  a 
satisfactory  performance  in  precision  grasping  of  a  prosthetic 
hand,  without  the  need  for  additional  complexity  regarding 
equations  for  inverse  kinematics,  or  inverse  dynamics,  and  the 
information  on  tactile  or  force  sensing  or  even  object  shape. 

1.  Introduction 

UMAN  hand  is  one  of  the  most  important  and  complex 
parts  of  the  body,  which  has  the  ability  to  handle 
different  tasks.  Loss  of  hand  can  highly  affect  the  quality  of 
life;  hence  there  is  a  high  demand  among  amputees  for 
prosthetic  hands.  The  goal  is  to  design  an  anthropomorphic 
prosthetic  hand  which  is  capable  to  be  controlled  through 
mind  and  has  functionality  close  to  normal  human  hand. 

The  muscle  movements  in  humans  are  controlled  by 
electromyographic  (EMG)  signal  which  comes  from  brain  to 
the  body.  In  case  of  a  lower  hand  amputee  the  remaining 
part  of  muscles  are  capable  to  measure  EMG  and  through  it 
find  the  subject’s  intention. 

Grasping  can  be  categorized  into  two  main  groups: 
precision  and  power  grasping.  In  precision  grasping  the 
object  is  held  by  tips  of  the  fingers,  while  in  power  grasping, 
the  whole  finger  is  active  and  in  contact  with  the  object  [1]. 
Our  previous  work  [2]  addressed  the  problem  of  power 
grasping  and  here  we  study  the  problem  of  precision 
grasping  of  a  prosthetic  hand. 

Many  control  methods  require  the  knowledge  of  the  shape 
of  the  object.  For  humans  this  information  is  available  by 
visual  feedback  from  eyes,  while  in  case  of  a  prosthetic  hand 
this  visual  information  is  not  directly  available  for  hand 
controller,  and  the  only  available  information  is 
electromyographic  (EMG)  signal  related  to  patient’s  arm 
muscle  activities.  However,  normally  the  EMG  signal  is  not 
available  for  all  individual  joints  and  besides,  due  to 
measurement  noise,  accessing  high  quality  EMG  signal  is 
hard  [3].  Moreover,  using  EMG  signal  to  control  all  the 
movements  requires  lot  of  attention  during  grasping  and 
leads  to  fatigue  for  the  amputees  [4].  Hence  it  is  required  for 
prosthetic  hand  to  be  semi-autonomous  which  means  a  part 
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of  command  information  will  be  provided  by  the  EMG 
signal  and  the  rest  of  the  required  command  should  be 
provided  automatically  by  hand  controller. 

Defining  finger  trajectory  without  the  knowledge  of  shape 
of  object  to  be  grasped  is  a  challenging  task  for  many  path 
planning  techniques.  For  multi  DOFs  robots  there  are  two 
common  methods  for  trajectory  planning  which  are  “inverse 
kinematics”  and  “inverse  dynamics”  [5] -[7].  Both  these 
methods  require  object  shape  and  are  based  on  solving 
optimization  problem  which  requires  high  computation, 
hence  they  are  hard  to  implement  for  real-time  applications. 

To  avoid  solving  the  path  planning  problem  for  prosthetic 
hands,  many  researchers  advocated  under-actuated 
mechanisms,  which  are  capable  of  adapting  to  object  shape 
mechanically  and  without  additional  computation  [8]-[10]. 
In  these  mechanisms,  the  number  of  actuators  is  less  than  the 
DOFs,  and  because  of  less  number  of  actuators  they  have 
less  weight.  However  fewer  actuators  result  in  less 
functionality,  because  fingers  joints  can’t  move 
independently. 

Arimoto  et  al.  [11]  used  “virtual  spring-damper 
hypothesis”  for  control  of  robotic  arm-hand  systems.  A 
similar  method  called  “virtual  model  control”  is  also 
suggested  by  J.Pratt  et  al.  [12]  used  for  walking  robots,  and 
it  is  based  on  defining  virtual  forces  between  two  points. 
Both  methods  are  based  on  the  use  of  Jacobian  matrix  to 
relate  task  space  movement  to  joint  space.  In  [12]  it  is 
shown  that  any  kind  of  force  can  be  defined  between  two 
points  and  the  other  study  [II]  shows  that  use  of  spring- 
damper  forces  will  result  in  human  like  movement.  From 
physiological  point  of  view,  human  skilled  multi-joint 
reaching  movement  has  these  characteristics:  1)  endpoint 
trajectory  become  a  quasi-straight  line  and  less  variable, 
2) velocity  profiles  of  the  endpoint  has  a  bell-shape,  and  3) 
joint  trajectories  are  rather  variable  from  trial  to  trial  [11]. 

In  this  paper,  a  new  control  scheme  is  proposed  that  can 
efficiently  address  the  problem  of  precision  grasping 
without  complete  knowledge  of  the  shape  of  the  object 
which  may  be  called  “blind  precision  grasping”  for 
prosthetic  hand.  The  proposed  method  is  based  on  the  works 
by  Arimoto  et  al.  [11]  using  virtual  spring-damper  (VSD) 
hypothesis  for  control  of  robotic  arm-hand  systems.  In  our 
paper,  we  use  the  above  mentioned  hypothesis,  in  particular 
for  the  precision  grasping  of  a  prosthetic  hand.  In  this 
method,  we  define  a  virtual  spring-damper  between  finger 
tip  and  desired  point  for  control  of  movement  of  fingers. 
Further,  in  this  method  there  is  no  need  to  introduce  any 
performance  indices  to  solve  inverse  kinematics  uniquely 
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and  Jacobian  pseudo-inverse  or  inverse  dynamics  which  are 
common  methods  to  define  trajectories  of  redundant  DOFs 
robots.  Besides,  in  the  present  method,  there  is  no  need  for 
any  information  on  tactile  or  force  sensing. 

The  paper  is  organized  as  follows.  In  Section  2  modeling 
of  prosthetic  hand  is  discussed.  Section  3  covers  virtual 
spring  damper  method.  Section  4  describes  control  strategy. 
Section  5  analyzes  the  efficiency  of  the  proposed  control 
scheme  using  numerical  simulation.  Finally,  conclusion  and 
discussion  are  presented  in  section  6. 

II.  Modeling  of  Prosthetic  Hand 

In  this  control  method,  controller  is  not  designed  based  on 
dynamic  model  of  the  system.  Instead,  kinematics  equation 
and  Jacobian  matrix  are  used  for  controller  design. 

A  model  of  a  robotic  hand  system  is  shown  in  Fig.l.  The 
model  consists  of  a  finger  with  3 DOF  which  represents  three 
joints  of  index  finger,  palm  and  a  finger  with  2DOF  which 
represents  thumb. 


In  this  paper  we  assume  the  following: 

1)  Movement  of  both  finger  and  object  are  confined  to  a  2 
dimensional  horizontal  plane,  and  therefore  there  is  no 
gravity  effect. 

2)  The  object  is  assumed  to  be  initially  stable  in  its 
position. 

3)  The  initial  movement  toward  object  is  handled  by 
amputee,  so  the  hand  is  close  enough  to  the  object  before 
grasping. 

The  position  of  the  tip  of  index  fingers  is  evaluated  as 

(see  Fig.  1): 

Xi  =  cosqa  +  hz  cos(qa  +  +  hs  cos(qa  + 


qi2+qi3),  (1) 

yi  =  sinqi^  +  li2  sin(qi^  +  ^^2)  +  hs  sin(qi^  + 
qi2+qi3),  (2) 

where.  In,  la,  and  la  are  lengths  of  index  finger  and  qu,  qa, 
and  qa  are  angles  of  each  corresponding  joint.  Similarly  the 
position  of  thumb  finger  is  evaluated  as: 

cos  qti  +  ^2  cos(qti  +  q^2)>  (3) 

yt  =  sin  qti  +  ^2  sin^q^^  +  ^^2).  (4) 


Based  on  above  equation  the  Jacobian  matrix  for  index 
finger  is  as: 


III.  Virtual  Spring  Damper  Method 

Virtual  model  control  was  first  proposed  by  J.  Pratt  et  al 
[12]  for  biped  walking  robot.  This  method  is  a  motion 
control  scheme  that  uses  simulations  of  virtual  components 
to  generate  desired  joint  torques  [12].  These  joints  produce 
the  same  effect  that  the  virtual  elements  placed  on  robot 
would  have  created;  hence  they  create  the  illusion  that  these 
virtual  elements  are  connected  to  the  real  robot.  Virtual 
elements  can  be  any  kind  of  real  physical  elements  such  as 
springs,  dampers,  gravity  fields,  nonlinear  fields  or  any 
other  components.  In  a  study  by  Arimoto  [II]  on  robotic 
hand  arm  system,  it  is  shown  that  using  a  virtual  spring 
damper  between  robot  end  effecter  and  desired  point,  and 
virtual  dampers  at  each  joint,  human  like  movement  can  be 
achieved. 

For  precision  grasping  by  a  prosthetic  hand,  one  of  the 
best  options  is  the  use  of  Virtual  Spring-Damper  (VSD) 
hypothesis.  Some  benefits  of  VSD  control  scheme  are  that  it 
has  a  simple  structure  and  requires  relatively  less 
computation.  Besides,  it  doesn’t  need  inverse  dynamics  to 
precisely  define  the  robot  movement.  Thus,  we  use  spring 
set  points  instead  of  commanded  movement  and  robot 
automatically  adapts  its  shape.  Since  finger  joints  at 
prosthetic  hand  work  as  virtual  dampers,  which  is  sensitive 
to  velocity  and  not  to  position,  they  don’t  have  a  forced 
shape,  instead  just  finger  tip  follow  a  defined  path  as  will  be 
discussed  more  in  control  strategy  section. 

The  joint  torques  to  virtual  forces  is  given  by: 

T=fF,  (7) 

where  x  is  the  torque,  and  F  is  the  force  due  to  virtual  spring 
damper  given  as 

F  =  -(fVfci  +  kLx),  (8) 

and 

^spring -damper  ~  ~J  T  kAx^,  (^) 


where,  Ig  and  la  are  lengths  of  thumb  finger  and  qg  and  qa, 
are  angles  of  corresponding  joints. 
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where  k  represents  the  stiffness  of  the  virtual  spring.  Ax  is 
distance  between  finger  tip  and  desired  point,  and  ^  is  the 
damping  ratio.  The  damping  force  is  defined  at  each  joint  as 


^joints  damping  -Cq.  (10) 

where,  C  denotes  a  diagonal  positive  definite  matrix  as 
follows: 

C  =  ^odia9(.Ci>->Cn)-  (H) 

Hence  control  signal  would  be  sum  of  these  two  terms: 
u  =  —Cq  -  J^(q){^Vkx  +  kAx).  (12) 

IV.  Control  Strategy 

Virtual  spring-damper  hypothesis  is  suitable  for  point  to 
point  control.  In  precision  grasping  two  approaches  can  be 
considered.  1)  Defining  a  virtual  spring  damper  between 
fingers  tip  and  geometrical  center  of  the  object,  which 
requires  information  about  the  object  position  and  shape, 
and  this  information  is  not  available  in  case  of  a  prosthetic 
hand  for  the  controller  which  is  used  in  [13]  2)  Defining  a 
virtual  spring  damper  between  tips  of  two  fingers,  then 
fingers  attract  together  and  grasp  the  object  in  between, 
without  exact  knowledge  of  object  position  and  shape.  In 
this  case  the  amputee  should  place  the  hand  close  to  the 
object  and  in  appropriate  position.  Besides,  a  virtual  damper 
force  is  considered  at  each  finger  joint.  The  latter  method  is 
used  and  physical  counterpart  of  virtual  forces  are  depicted 
at  Fig.  2. 


Virtual  Spring  Damper 


Fig.  2.  Physical  counterparts  of  the  virtual  forces 


Higher  values  of  k  (virtual  spring  stiffness)  results  in 
faster  movement  of  fingers  as  well  as,  higher  grasping  force. 
Thus  by  defining  k  proportional  to  EMG  signal,  amputee 
have  control  over  speed  of  movement  and  grasping  force. 
The  damping  coefficient  of  finger  joints,  can  change  the 
final  shape  of  fingers.  The  joints  with  lower  damping  tends 
to  move  more,  while  higher  damped  joints  move  more.  The 
appropriate  values  of  damping  are  evaluated  based  on  trial 
and  error  to  reach  positions  close  to  normal  hand  and  they 
are  held  constant  for  further  simulations. 

V.  Numerical  Simulation 

In  order  to  show  the  effectiveness  of  the  proposed  control 
strategy,  numerical  simulations  were  conducted  to  grasp  two 


different  objects,  based  on  the  physical  parameters  of  a  hand 
system  and  objects  summarized  in  Table  I. 

The  Adams  software  which  is  multi-body  dynamic 
simulation  software  is  used  for  numerical  analysis.  The 
software  is  capable  to  conduct  information  between  Matlab/ 
Simulink  software  environment,  hence  the  plant  is  modeled 
by  Adams  and  controller  is  implemented  in  Matlab/Simulnk. 


TABLE  I 

Parameters  Used  eor  Simueation 


Parameter 

Value 

index  finger  link  1  length 

5  cm 

index  finger  link  2  length 

2.5  cm 

index  finger  link  3  length 

2.5  cm 

thumb  finger  link  1  length 

4  cm 

thumb  finger  link  2  length 

3  cm 

distance  between  thumb  and  index 

6  cm 

damping  at  joints 

0.01  kg/s 

virtual  damping  ratio 

1 

virtual  spring  stiffness 

50  N/m 

rectangular  object  width 

2  cm 

circular  object  radius 

2  cm 

Fig.  3.  Finger  movements  in  4  different  position  (0.25  sec.  intervals) 


For  first  simulation,  two  fingers  are  modeled  without  any 
object  in  between.  As  shown  in  Fig.  3,  two  fingers  come 
together,  and  final  position  is  close  to  normal  hand 
coordination. 


Fig.  4.  Rectangular  object  grasping  (0.25  sec  intervals) 


For  the  second  simulation,  a  rectangular  object  is  chosen 
to  be  grasped.  The  object  is  free  to  move  in  2  dimensional 
plane,  and  contact  and  friction  force  are  simulated  between 
finger  tip  and  the  object.  The  object  is  placed  at  arbitrary 
final  position  of  previous  experiment.  The  finger  movement 
at  0.25  sec  time  intervals  and  finger  tip  angles  relative  to 
palm  are  shown  respectively  in  Figs.  4  and  5. 
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Fig.  5.  Finger  tips  angle  at  rectangular  object  grasping 
(index  finger  solid  line  and  thumb  finer  dashed  line) 

As  it  is  shown  after  contact  with  object  at  approximately 
1.5  second  the  angles  are  not  changing  much.  The  small 
changes  are  due  to  object  movements  toward  left. 


thumb 


index  finger 

Fig.  6.  Circular  object  grasping  (0.25  sec  intervals) 


For  third  simulation  a  round  object  is  selected.  The  object 
is  not  subjected  to  any  constrain  in  2  dimensional  plane.  The 
contact  and  friction  force  are  defined  between  object  and 
finger  tip.  The  virtual  spring  coefficient  which  is 
proportional  to  EMG  signal  is  assumed  to  be  constant. 
Almost  after  1  sec,  the  fingers  contacted  with  the  object.  The 
finger  movement  at  0.25  sec  time  intervals  and  finger  tip 
angles  relative  to  palm  are  shown  respectively  in  Figs.  6  and 
7. 


Fig.  7.  Finger  tips  angle  at  circular  object  grasping 
(index  finger  solid  line  and  thumb  finer  dashed  line) 


Appropriate  object  position  and  friction  force  between 
fingers  and  object  are  important  parameters  that  help 
successful  grasping.  For  the  case  of  a  round  object  if  the 
object  has  inappropriate  position  or  friction  is  not  enough, 
the  grasping  might  be  unstable,  but  guarantied  successful 
grasping  under  all  conditions  require  information  about 
object  shape  and  position  which  are  not  available  for  case  of 
a  prosthetic  hand  hence  this  control  strategy  is  appropriate 
for  most  of  the  daily  activities. 


VI.  Conclusion 

Based  on  virtual  spring  damper  hypothesis,  a  control 
strategy  for  precision  grasping  of  a  prosthetic  hand  was 
proposed.  The  controller  doesn’t  require  extensive 
computation  of  inverse  kinematic  or  inverse  dynamics  to 
describe  finger  movement  and  hence  the  method  is 
appropriate  for  real-time  applications.  The  control  strategy  is 
independent  of  object  shape  or  force  and  contact  sensor.  By 
numerical  simulation,  the  capability  and  effectiveness  of 
control  strategy  are  shown.  The  same  strategy  was  used  for 
two  different  objects  and  grasping  was  successful. 

The  future  work  will  focus  on  precision  grasping  by 
gravity  cancelation  and  analysis  in  three-dimensional  space 
and  experimental  implementation  with  EMG  signals. 

References 

[1]  Eynette  A.  Jones  and  Susan  J.  Eederman,  Human  Hand  Function, 
New  York:  Oxford  University  Press,  2006,  pp.  131-149. 

[2]  Amir  Fassih,  D.  Subbaram  Naidu,  Steve  Chiu,  and  Marco  P.  Schoen, 
“power  grasping  of  a  prosthetic  hand  based  upon  virtual  spring- 
damper  hypothesis”,  Proc.  lASTED  Int.  Conf.  Robotics  and 
Applications,  Cambridge,  Massachusetts,  2010,  pp.  214-220. 

[3]  Mohammad  Asghar  Oskooei,  Housheng  Hu,  “Myoelectric  control 
systems,  a  survey”.  Biomedical  Signal  Processing  and  Control,  vol. 

2,  2007,  pp  275-294. 

[4]  Chiristian  Cipriani,  Franco  Zaccone,  Silvestro  Micera,  Chiara 
Carrozza,  “On  the  shared  control  of  an  emg-controlled  prosthetic 
hand:  analysis  of  user-prosthesis  interaction”,  IEEE  Transaction  on 
Robotics,  vol.24,  Nol,  February  2008. 

[5]  Erik  D  Engeberg,  Sanford  G.  Meek,  “Backsptepping  and  sliding 
mode  control  hybridized  for  a  prosthetic  hand”,  IEEE  Trans,  on 
Neural  Systems  and  Rehabilitation  Engineering,  vol.  17,  No.l, 
February  2009. 

[6]  D.E.  Whitney,  “Resolved  motion  rate  control  of  manipulators  and 
human  prostheses”,  IEEE  Trans.  Man-Machine  Syst.,  vol.  MMS-10, 
No.2,  1969,  pp.47-53. 

[7]  Y.  Nakamura,  “Advanced  robotics:  redundancy  and  optimization”, 
Addison-Wesley,  Reading,  MA,  1991. 

[8]  N.  Dechev,  W.L.  Cleghron,  S.  Naumann,  Multiplefinger,  “Passive 
adaptive  grasp  prosthetic  hand”.  Mechanism  and  Machine  Theory, 
vol.36,  2001,  pp.l  157-1 173. 

[9]  Ramiero  Cabas,  Euis  Maria  Cabas,  Carlos  Balaguer,  “Optimized 
design  of  the  underactuated  robotic  hand”.  Proceeding  of  the  2006 
IEEE  International  Conferences  on  Robotics  and  Automation, 
Orlando,  Florida,  May  2006. 

[10]  Da-Peng  Yang,  Jing-dong  Zhao,  Yi-kun  Gu,  Xin-qing  Wang,  Nan 
Ei,  Ei  Jiang,  Hong  Liu,  Hai  Huang,  Da-wei  Zhao,  “An 
anthropomorphic  robot  hand  develeoped  based  on  underactuated 
mechanism  and  controlled  by  EMG  signals”.  Journal  of  Bionic 
Engineering,  vol.  6,  2009,  pp  255-263. 

[11]  Suguru  Arimoto,  Masahiro  Sekimoto,  “Human-like  movements  of 
robotic  arms  with  redundant  dofs:  virtual  spring-damper  hypothesis 
to  tackle  the  brenestein  problem”,  Prec.  of  IEEE  Int.  Conf.  on 
Robotics  and  Automation,  Orlando,  Florida,  May  2006. 

[12]  Jerry  Pratt,  Chee-Meng  Chew,  Ann  Torres,  Peter  Dilworth,  Gill 
Pratt,  “Virtual  model  control:  an  intuitive  approach  for  bipedal 
locomotion”.  The  International  Journal  of  Robotics  Research,  vol. 

20,  No.  2,  pp.  129-143,  February  2001. 

[13]  Thomas  Wimboeck,  Christian  Ott,  Gerhard  Hirzinger,  “Passivity- 
based  object-level  impedance  control  for  a  multifmgered  hand” 
Proceedings  of  the  2006  lEEE/RSJ,  International  Conference  on 
Intelligent  Robots  and  Systems,  Beijing,  China,2006. 


82 


REAL-TIME  sEMG  ACQUISITION  AND  PROCESSING  USING  A 

PIC  32  MICROCONTROLLER 


Chandrasekhar  Potluri,  Madhavi  Anugolu,  Parmod  Kumar,  Amir  Fassih,  Pavan  Yarlagadda,  Yimesker 

Yihun,  and  Steve  Chiu,  Member,  IEEE. 


Abstract  -  This  paper  presents  a  novel  approach  for  the  signal 
acquisition  and  processing  using  an  embedded  platform.  A  PIC 
32  microcontroller  is  used  to  acquire  Surface  Electromyographic 
(sEMG)  signals  and  the  corresponding  skeletal  muscle  force 
signal  for  the  respective  motor  point  in  this  case  the  ring  finger  of 
the  dominant  hand  of  a  healthy  subject.  The  data  is  acquired  by 
MATLAB*/SIMULINK®.  Both  sEMG  and  force  signals  are 
acquired  at  a  rate  of  2000  samples  per  sec.  The  acquired  sEMG 
data  is  filtered  using  three  different  types  of  nonlinear  Bayesian 
filter,  Exponential,  Poisson,  and  Half-Gaussian  filter  and  the 
force  signal  is  filtered  using  a  Chebyshev  type  II  filter.  The  data 
acquired  from  the  PIC  32  and  embedded  test  bed  are  compared 
with  the  standard  Lab  VIEW™  data  acquisition  system  using 
these  three  filters  and  Half-Gaussian  filter  with  DE  3.1  electrodes 
gives  the  best  results. 

1.  Introduction 

Human  body  is  one  of  the  most  complex  and  intricate 
system  available.  In  the  same  way  the  human  body  signals 
such  as  sEMG  are  quite  complex  and  challenging  to 
understand.  To  aid  the  peoples  with  upper  extremity 
amputations  there  has  been  an  active  research  in  the  field  of 
upper  limb  prosthesis.  Loss  of  upper  extremity  brings  a 
reduction  in  functions  to  amputees  and  also  struggle  with 
numerous  psychological  issues  which  may  further  complicate 
the  appropriate  control  and  use  of  the  prosthesis.  Research 
work  in  [1]  and  [2]  was  mainly  based  on  the 
electromyography  (EMG)  signals.  The  EMG  signal  is  a 
naturally  available  and  can  be  recorded  at  the  surface  of  the 
limb  which  is  known  as  surface  EMG  (sEMG). 
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The  sEMG  is  simply  an  electric  voltage  ranging  between  - 
5  and  +5  mV,  which  is  a  result  of  the  electrical  activity 
associated  with  voluntary  muscle  contraction.  This  made  the 
sEMG  signal  of  great  use  for  the  position  and  force  control  of 
the  hand  prosthesis  [3,  4]. 

Since  the  skeletal  muscle  force  and  the  sEMG  signals  are 
related  and  an  increase  force  production  results  in  the 
increased  sEMG  activity.  Therefore  the  latter  is  used  as  a 
control  input  to  realize  force  and  motion  control  of  a 
prosthetic  hand.  This  makes  the  precise  interpretation  of  the 
sEMG  signal  an  essential  task. 

In  today’s  research  environment  the  embedded  systems 
have  become  pervasive  and  as  research  advances,  more  and 
more  functions  of  analog  circuits  are  being  realized  by 
microcontrollers.  Analog  to  Digital  Converters  (ADCs)  and 
Digital  to  Analog  Converters  (DACs).  In  a  modern  control 
system,  embedded  system  and  control  performs  most  of  the 
data  acquisition,  processing  and  control  functions.  To  realize 
the  excellent  system  performance  we  need  to  have  a  well- 
designed  embedded  control  which  can  deals  with  widely 
varying  operating  conditions.  For  robust,  fast,  precise  and 
consistent  high  performance,  the  embedded  system  should  be 
designed  carefully  and  in  balance.  In  case  of  a  prosthetic  hand 
we  need  to  have  a  real-time  embedded  control  system  that 
performs  the  desired  force  and  motion  control  [5-7]. 

Present  work  is  a  step  in  this  direction  where  the  authors 
explore  the  PIC  32  microcontroller  as  an  embedded  platform 
to  simultaneously  acquire  the  sEMG  and  skeletal  muscle 
force.  sEMG  sensors  are  placed  on  the  ring  finger  motor  point 
of  the  dominant  hand  of  a  healthy  subject  and  the  subject  is 
asked  to  squeeze  a  stress  ball  which  has  a  force  sensing 
resistor  attached  to  it.  The  data  is  simultaneously  captured 
using  the  PIC  32  embedded  platform  with 
MATLAB®/SIMULINK®  real-time  workshop  (RTW)  and 
regular  NI  Lab  VIEW  data  acquisition.  Both  sEMG  and 
force  data  is  captured  at  2000  Hz.  The  sEMG  signal  is  filtered 
using  three  different  types  of  nonlinear  Bayesian  filters. 
Exponential,  Poisson,  and  Half-Gaussian  filter  and  the 
corresponding  skeletal  muscle  force  is  filtered  by  a 
Chebyshev  type-II  filter  [8].  Among  these  three  different 
types  of  filters  the  Half-Gaussian  filter  is  giving  the  best 
results  [8-14]. 

The  paper  is  organized  as  follows:  present  section 
followed  by  the  ‘Experimental  Set-Up,’  then  the  ‘Signal  Pre- 
Processing,’  ‘Proposed  Design,’  ‘Results  and  Discussion,’  are 
presented.  The  paper  is  concluded  with  the  section  of 
‘Conclusion  and  Future  Work.’ 


11. 


Experimental  Set-Up 

Using  a  muscle  stimulator  the  motor  point  for  the  ring 
finger  of  the  dominant  hand  of  a  healthy  subject  are  marked. 
Prior  to  placing  the  sEMG  sensors,  the  skin  surface  of  the 
subject  was  prepared  according  to  International  Society  of 
Electrophysiology  and  Kinesiology  (ISEK)  protocols. 
Different  sets  of  experiments  are  conducted  with  DE  2.1  and 
DE  3.1  DELSYS®  Bagnoli  sEMG  sensors.  One  sensor  was 
placed  on  top  of  the  motor  point  location  and  two  sensors 
were  placed  next  to  the  motor  point.  Subject  is  asked  to 
squeeze  the  stress  ball  with  the  ring  finger  which  has  a  0.5 
inch  force  sensing  resistor  from  Interlink  Electronics.  The 
sEMG  and  skeletal  muscle  force  signals  were  acquired  using 
the  16-channel  DELSYS®  Bagnoli  sEMG  and  NI  ELVIS™ 
respectively.  Similar  experimental  set-up  was  designed  using 
a  PIC  32  embedded  platform  where  the  sEMG  and  the  force 
data  is  acquired  using  this  platform.  Both  the  data  are 
captured  at  a  sampling  frequency  of  2000Hz.  Fig.  1  and  2 
show  the  two  experimental  set-ups. 


Fig.  1.  Experimental  Set-Up  withNI  ELVIS  and  DELSYS® 
EMG  System. 


in.  Signal  Pre-Processing 

Previous  research  work  [15]  shows  that  the  Bayesian  based 
filtering  method  yields  the  most  suitable  sEMG  signals.  These 
nonlinear  filters  significantly  reduce  noise  and  extract  a  signal 
that  best  describes  EMG  signals  and  can  be  effective  for 
prosthetic  hand  signal  processing.  The  latent  driving  signal  x 
results  in  the  EMG  which  can  be  computed  using  an 
instantaneous  conditional  probabilityP(EMC  |  x),  [15]. 

Research  work  in  [16]  describes  EMG  signal  as  amplitude- 
modulated  zero  mean  Gaussian  noise  sequence.  This 
estimation  algorithm  uses  the  model  of  the  conditional 
probability  of  the  rectified  EMG  signal  emg  =  \EMG\,  [15]. 

Equation  (1)  gives  an  “Exponential  Measurement  Model” 
for  the  rectified  EMG  signal  [15]. 

-emg. 

P(emg\x)  =  — •  (1) 


Equation  (2)  gives  a  “Poisson  Measurement  Model”  for 
the  rectified  EMG  signal  [15]. 

P(emg\x)  «  .  (2) 


In  equation  (2)  n  is  the  number  of  events.  Equation  (3) 
presents  the  “Half-Gaussian  measurement  model”  for  the 
rectified  EMG  signal  [15]. 


P(emg\x)  = 


2*exp(-g^) 

V(2nx^) 


(3) 


The  model  for  the  conditional  probability  of  the  rectified 
EMG  is  a  filtered  random  process  with  random  rate  and  the 
likelihood  function  for  the  rate  evolves  in  time  according  to  a 
Fokker-Planck  partial  differential  equation  [15].  The  discrete 
time  Fokker-Planck  Equation  is  given  by  Equation  (4). 


p(x,  t-)  «  a  *  p(x  -  t  -  1)  +  (1  -  2  *  a)  *  p(x,  t  -  1)  + 
a  *  p(x  +  t  -  1)  +  +  (1  -  *  p(x,  t  -  1)  (4) 

In  the  Equation  (4)  a  and  P  are  two  free  parameters,  where 
a  is  the  expected  rate  of  gradual  drift  and  P  is  the  expected 
rate  of  sudden  shift  in  the  signal  [15].  The  latent  driving  signal 
X  is  discretized  into  bins  of  s.  An  elitism  based  Genetic 
Algorithm  (GA)  is  used  to  optimize  these  free  parameters  of 
the  non-linear  Half-Gaussian  filter  model.  GA  is  an 
optimization  algorithm  which  is  based  on  observing  nature 
and  its  corresponding  processes  to  imitate  solving  complex 
problems,  most  often  optimization  or  estimation  problems,  see 
[17-19].  Skeletal  muscle  force  signal  from  FSR  is  filtered 
utilizing  a  Chebyshev  type  II  low  pass  filter  with  a  550  Hz 
pass  band  frequency. 


IV.  Proposed  Design 

In  this  proposed  design  the  analog  input  and  the  UART 
modules  of  the  PIC  32  are  used  for  the  acquisition  and 
transmission  of  the  sEMG  signals.  The  outputs  from  the 
DELSYS®  Bagnoli  system  are  connected  to  the  analog  input 
channels  of  the  PIC  32  micro  controller.  In  this  present  work 
the  signal  from  the  motor  unit  (middle  sensor)  is  acquired  and 
pre-processed.  The  sEMG  signal  and  the  corresponding 
skeletal  muscle  force  are  acquired  at  2000  samples  per 
second.  A  dsPIC  blockset  is  used  to  generate  the  C  code  for 
the  PIC32  from  SIMULINK®.  The  dsPIC  blockset  generates  a 
‘.hex’  file,  and  this  file  is  imported  by  MPLAB®  to  program 
the  PIC32.  The  Analog  Input  module  is  used  for  reading  the 
sEMG  and  the  corresponding  skeletal  muscle  force  data.  The 
PIC32  has  an  internal  analog  to  digital  converter  (ADC) 
which  has  a  10-bit  resolution  so  that  it  can  distinguish  up  to 
1024  different  voltages,  usually  in  the  range  of  0  to  3.3  volts, 
and  it  yields  3mV  resolution.  The  UART  module  in  the 
PIC32  is  used  to  transmit  the  signals  from  the  microcontroller 
to  the  PC  using  serial  communication.  In  this  design,  a  virtual 
‘com  port’  is  created  to  feed  the  data  via  USB  cable  to  the 
computer.  MATLAB®  is  used  to  read  the  signals  from  the 


ports.  The  acquisition  system  using  the  PIC  32  micro 
controller  is  shown  in  the  Fig.  2. 


DELSYSsIMG 

Systei 
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Fig.  2.  Experimental  Set-Up  with  PIC  32  Embedded 
Platform  and  DELSYS®  EMG  System. 

V.  Results  and  Discussion 

sEMG  and  the  corresponding  skeletal  muscle  force  data  is 
acquired  from  the  microcontroller  through  UART  channel  2 
of  the  PIC32MX360F512L  by  a  virtual  com  port  via  USB  at 
57600  baud  rate.  The  data  from  the  microcontroller  is 
converted  into  uintl6  data  before  it  is  transmitted  through  the 
UART.  The  PIC32  microcontroller  is  running  at  80  million 
instructions  per  second  (MIPS)  with  its  phase  lock  loop  (PEL) 
activated.  It  is  running  at  an  external  clock  frequency  of  8 
MHz  with  internal  scaling  enabled.  Fig.  3  and  4  show  the 
sEMG  signal  acquired  by  the  proposed  acquisition  system 
using  DE  2.1  electrodes.  Fig.  5  and  6  show  the  sEMG  signals 
acquired  by  the  proposed  acquisition  system  using  DE  3.1 
electrodes.  These  acquired  signals  are  processed  using  the 
Half-Gaussian  filter. 


Fig.  3.  Unfiltered  sEMG  Signal  from  the  Proposed 
Acquisition  System  Using  DE  2.1  Electrodes. 


The  following  experiment  is  repeated  several  times  to  check 
the  consistency  and  the  accuracy  of  the  proposed  acquisition 
system.  Fig.  7  and  8  show  the  validation  for  the  proposed 
acquisition  system  for  repeated  experiments  using  DE  2.1  and 
DE  3.1  electrodes.  It  is  evident  from  the  Fig.  6  that  the  DE  3.1 
electrodes  are  giving  good  results  when  compared  to  DE  2.1 
results. 


Fig.  4.  Filtered  sEMG  Signal  from  the  Proposed  Acquisition 
System  Using  DE  2.1  Electrodes. 
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Fig.  5.  Unfiltered  sEMG  Signal  from  the  Proposed 


Acquisition  System  Using  DE  3.1  Electrodes. 

The  sEMG  signals  acquired  from  the  proposed  acquisition 
system  using  DE  3.1  electrodes  are  in  good  correlation  with 
the  sEMG  signals  acquired  from  the  standard  acquisition 
system.  The  sEMG  signals  and  the  corresponding  skeletal 
muscle  force  acquired  from  the  standard  acquisition  system 
are  given  in  Fig.  9  and  10.  Since  the  sEMG  is  a  random  signal 
corrupted  with  noise  it  is  hard  to  achieve  the  same  correlation 
every  time. 


I’nlered  sEMG  with  DE  3.1  Electrodes 
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Fig.  7.  sEMG  Signal  from  the  Proposed  Acquisition  System 
Using  DE  2.1  Electrodes  with  Repeated  Experiment. 
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Using  3.1  Electrodes  with  Repeated  Experiment. 
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1 

I 

I’’ 

:  jh' 

Jl . 

' 

. 7 

! '  1 

i'' 

h 

i: ' ;; 

I  G'  1  ^  1 

0.8 -i 
0.6- 
0.4 
0.2' 


f-tH-e 


4P 


ilil' 


4 


6  8 
Time  (30  Secs) 


10  12 
XIO' 

Fig.  9.  sEMG  Signal  from  the  Standard  Acquisition  System. 
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Fig.  10.  Filtered  Force  Signal  from  the  Standard  Acquisition 
System. 

VI.  Conclusion  and  Future  Work 

A  real-time  sEMG  acquisition  system  was  designed  for  the 
control  of  the  robotic  hand  prototype.  The  proposed  design 
gives  good  performance  when  compared  with  the  standard 
EMG  acquisition  system.  Comparison  between  DE  2.1  and 
the  DE  3.1  electrodes  is  done  and  the  DE  3.1  electrodes  are 
giving  good  results.  This  proposed  acquisition  system 
facilitates  the  transmission  of  the  data  from  the 
microcontroller  to  the  computer.  This  enables  the  user  to 
compare  the  accuracy  and  performance  of  the  acquisition 
system.  Investigation  was  done  on  various  other  filters  and 
finally  Half-Gaussian  filter  with  DE  3.1  elctrodes  is  giving 
good  results. 

For  future  work  we  are  planning  to  implement  real  time 
model-based  force  estimation  and  along  with  controller  design 
for  position  and  force  control,  based  on  this  embedded 
platform  [20,  21].  It  will  be  interesting  to  acquire  signals  from 
the  three  sensors  and  then  make  a  comparison  between  the 
standard  and  the  proposed  acquisition  system.  Finally,  we 
plan  to  implement  the  Acquisition  and  control  for  a  five 
fingered  prototype. 
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Abstract:  -  This  paper  presents  a  novel  approach  of  a  surface  electromyographic  (sEMG)-based,  real-time 
Model  Reference  Adaptive  Control  (MRAC)  strategy  for  joint  angle  estimation  and  control  of  a  prosthetic  hand 
prototype.  The  proposed  design  is  capable  of  decoding  the  pre-recorded  sEMG  signal  as  well  as  the  sensory 
force  feedback  from  the  sensors  to  control  the  joint  angle  of  the  prosthetic  hand  prototype  using  a  PIC 
32MX360F512L  microcontroller.  The  input  sEMG  signal  is  rectified,  filtered  using  a  Half-Gaussian  filter  and 
fed  to  a  Kullback  Information  Criterion  (KIC)  based  fusion  algorithm,  which  give  the  overall  estimated  joint 
angle  (position).  This  estimated  angle  is  given  as  input  to  the  prosthetic  hand  prototype.  Then  the  MRAC  along 
with  a  two  stage  proposed  embedded  design  is  used  for  the  position  control  of  the  prosthetic  hand.  For  the  real¬ 
time  operation,  the  measured  angle  data  at  the  joint  is  fed  back  to  the  controller.  The  data  is  transmitted  to  the 
computer  through  a  universal  asynchronous  receiver/transmitter  (UART)  interface  of  the  proposed  embedded 
design.  The  experimental  results  in  real  time  show  good  performance  in  controlling  the  angle  of  the  prosthetic 
hand  prototype. 


Key -Words:  -  Prosthetic  Hand,  sEMG,  Data  fusion,  Kullback  Information  Criterion,  MRAC,  Angle  control 


1  Introduction 

For  60  years,  there  has  been  active  research  going 
on  in  the  area  of  Prostheses.  Due  to  the 
unavailability  of  prosthetic  devices  with  full  human 
hand  functionality  at  an  affordable  price,  more  than 
30%  of  upper  extremity  amputees  chose  not  to  use 
a  prosthetic  device  on  regular  basis  [1,  2].  Besides 
that,  most  of  the  available  prosthetic  devices  do  not 
have  tactile  or  proprioceptive  feedback  [3].  Previous 
researchers  insisted  that  human-centered  robots 
must  be  independent  with  a  great  functionality, 
comfort  and  ease  of  use  [4].  In  rehabilitation 
robotics,  human-machine  interface,  which  requires  a 
natural  means  of  communication,  is  an  interesting 
domain  [5].  The  electromyographic  (EMG)  signal  is 
the  electric  potential  generated  by  muscles.  There 
are  two  kinds  of  EMG  signals:  Intramuscular 
(needle)  EMG  and  the  Surface  EMG  (sEMG). 
Under  the  assumption  that  amputation  is  transradial 
and  which  does  not  require  surgery,  we  relied  on 
sEMG  signals  in  this  work  whose  amplitude  ranges 
from  -5  to  -i-5  (mV).  sEMG  signals  are  acquired 
from  the  surface  of  the  skin,  as  they  penetrate 
through  various  tissue  layers  [6].  Thus,  they  tend  to 
create  cross-talk,  interference  and  noise.  The  sEMG 
is  a  temporally  and  spatially  composed  signal  [7]. 


Due  to  the  complexity  and  nonlinearity  of  the 
human  hand,  the  control  of  a  multi-fingered 
prosthetic  hand  is  a  challenging  task  [8].  From  the 
past  research,  it  is  clear  that  the  most  widespread 
approach  for  controlling  the  prosthetic  hand  is  by 
using  a  position  or  force  control  [9].  The 
challenging  task  involved  in  this  work  is  the 
prediction  of  the  Proximal  Inter  Phalangeal  (PIP) 
joint  angle  corresponding  to  the  sEMG  signal. 

In  this  paper,  we  used  a  three-by-three  array  of 
sEMG  sensors  and  a  wheel  potentiometer  device  to 
acquire  the  EMG  signal  and  the  corresponding  PIP 
joint  angle.  The  data  from  the  array  of  sEMG 
sensors  were  fused  using  a  probability  based  fusion 
algorithm  in  order  to  have  a  better  estimate  [10].  A 
real-time  embedded  MRAC  control  system  with 
sensory  feedback  was  implemented  to  accomplish 
the  goal  of  this  design.  Considering  the  probability 
based  fused  joint  angle  estimate  as  input  to  the  real¬ 
time  control  system,  a  two  stage  embedded  platform 
with  a  simple  MRAC  strategy  was  chosen  for  the 
PIP  joint  angle  control  of  the  prosthetic  hand 
prototype. 
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Fig.l:  Experimental  set-up. 


Fig.l.  illustrates  the  experimental  design  used  in  this 
work  for  capturing  the  sEMG  signal  and  the 
corresponding  joint  angle  of  the  PIP  joint  of  the 
index  finger.  Prior  to  placing  the  sEMG  sensors  on 
the  skin  surface,  the  test  subject  was  prepared 
according  to  ISEK  standards  [11].  The  motor  point 
was  identified  by  using  a  wet  probe  muscle  point 
stimulator  (Richmar  HV-1000).  Nine  DE-3.1  sEMG 
sensors  of  the  DELSYS  Bagnoli-16  EMG  system 
were  arranged  on  the  skin  surface  in  a  three -by-three 
array.  The  middle  row  of  sensors  was  placed  on  the 
motor  point  of  the  index  finger.  An  angle 
measurement  device  was  designed  using  a  10k- 
Ohm  wheel  potentiometer  shown  in  Fig.l.  It  was 
used  to  measure  the  PIP  joint  angle.  Force  Sensitive 
Resistor  (FSR)  was  mounted  on  the  stress  ball  and 
was  used  to  measure  the  force.  All  the  data  was 
acquired  at  a  sampling  rate  of  2000  samples/sec. 

3  Proposed  Design 

The  objective  of  the  proposed  design  is  to  track  a 
joint  angle  of  the  prosthetic  hand  as  closely  as 
possible.  Here,  the  joint  angle  signal  is  inferred  from 
the  sEMG  signals  obtained  from  the  array  of  the 
sEMG  sensors  located  at  the  arm. 

Sensor  fusion  is  done  in  the  time  domain  for  the 
sEMG  data  using  a  probability  based  Kullback 
information  criterion  (KIC)  fusion  algorithm.  The 
data  from  the  nine  sensors  were  collected  around  the 
corresponding  individual  motor  unit  at  the 
transradial  arm  location  (flexor  digitorum 
superficial! s)  and  before  fusing  the  sEMG  signals 
are  rectified  and  filtered  using  a  Half  -Gaussian 
filter,  as  given  by  (1). 

f  EMG^\ 
exp - ^-2- 

p(EMC\x)  =  2  X  (1) 


where  p(EMG\x)  is  a  conditional  probability 
density  function,  x  is  a  latent  driving  signal. 

A  System  Identification  (SI)  tool  was  used  to 
determine  the  dynamic  relationship  between  the 
input-output  data.  The  sEMG  signal  was  used  as 
input  and  the  corresponding  PIP  joint  angle  as 
output.  In  particular,  nonlinear  Wiener  Hammerstein 
one-dimensional  polynomial  models  were  obtained 
for  the  sEMG/joint  angle  data. 


The  mathematical  representation 
modeling  is  given  by, 

of  the 

w(t)  =  /(u(t)) 

(2) 

x(t)  =  w{t  nk)  +  e(t) 

(3) 

y(t)  =  h(x(t)) 

(4) 

where  u(t)  is  the  sEMG  signal  and  y(t)  is  the  PIP 
joint  angle.  /  and  h  are  nonlinear  functions,  w(t) 
and  x(t)  are  internal  variables,  Bj  i(q)  and  Fj  i(q) 
are  polynomials,  q  is  the  back  shift  operator,  and 
e(t)  is  the  output  error.  From  (3),  the  WH  model 
structure  utilizes  a  linear  OE  model,  which  is  given 

by, 

where  nk  is  the  system  delay  and  t  is  time  index 

The  resulting  nine  WH  models  were  fused  together 
by  using  a  probabilistic  KIC  algorithm  [12].  It 
assigns  a  particular  probability  to  each  model  [13]. 
The  overall  estimated  model  output  and  the 
individual  models  outputs  were  compared  by  using 
the  Pearson’s  correlation  coefficient. 

From  the  previous  research,  it  was  shown  that  the 
KIC  algorithm  performs  better  than  the  other  criteria 
[10,  12].  KIC  is  an  asymmetric  measure  of  the 
models’  dissimilarity  which  can  be  obtained  by  the 
sum  of  the  two  directed  divergences  known  as  J- 
divergence  or  Kullback’ s  symmetric  [14].  It  is  given 
by 

KIC(pd  =  ^logRi  +  ^^^-nxp{^)  +  gin)  (6) 
Where  g(n)^nHog(n/2),  ^  -  digamma  function. 

The  probability  based  fusion  algorithm  given  by 
[12,  13]  is  applied  to  the  nonlinear  models  obtained 
by  using  an  SI  technique  with  the  following  steps: 
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1:  The  WH  models  are  obtained  by  considering  the 
sEMG  data  u(t)  as  input  and  joint  angle  Y  as 
output, 

2;  Calculate  the  residual  square  norm  i.e., 
R  =Y-c^.a  =||f-f|| 

where  ={0/  O,  }  ‘  ,and 


3:  Compute  the  model  criteria  coefficients  using  (6). 

4:  The  model  probability  can  be  computed  using 
p(M,{t)\Z)  =  ^- 

7=1 

5:  The  fused  model  output  can  be  calculated  using 

Yf  =  YpiMiiOlZWi. 


Fig. 2:  Block  diagram  representation  of  Model 
Reference  Adaptive  Controller  (MRAC) 


A  simple  MRAC  based  scheme  (Fig.  2)  is  utilized 
for  compensating  the  dynamics  of  the  prosthetic 
hand.  During  the  development  of  the  artificial  hand, 
changes  were  being  undertaken  to  the  mechanical 
design  and  drive  trains  of  the  hand  that  affect  the 
dynamics  of  the  finger  motion  of  the  prosthesis.  In 
addition,  the  uncertain  characteristics  of  the 
kinematic  and  actuator  interaction  could  have  led  to 
a  different  performance  than  expected.  Therefore,  a 
simple  MRAC  controller  was  developed  in  order  to 
maintain  some  performance  stability.  For  updating 
the  controller  parameter  0,  the  MIT  rule  was  used. 

f  .  (7) 

According  to  the  MIT  rule  [15],  the  gain 
parameter  y  was  selected  to  achieve  the  desired 
performance.  In  this  work  y  was  taken  as  3.0  and 


the  error  e  =  Y  —  Y-^  was  calculated  by  the 
difference  of  the  model  reference  output  F^  and  the 
actual  output  (joint  angle  generated  by  the  prosthetic 
hand).  Different  MRAC  stability  issues  were 
addressed  in  [14,  15]. 

Reference  Model  Derivation 

The  dynamic  equations  of  motion  for  the  hand  are 
obtained  from  the  Fagrangian  approach  as  [16] 

x(t)  =  [q  J]  x(t)  +  [ j]  u(t).  (8) 

The  control  input  vector  u{f)  was  given  by 

u(t)  =  -  T(t)].  (9) 

As  the  prosthetic  hand  is  required  to  track  the 
desired  angle  profile  described  under  the 

reference  angle  model,  the  tracking  error  e(t)  is 
defined  as 

e(t)  =  c?d(t)  -  qit).  (10) 

Here,  is  the  desired  angle  vector  of  the 

joints  and  can  be  obtained  by  the  reference  angle 
model  [17];  q(t)  is  the  actual  angle  vector  of  the 
joints.  Differentiating  (10)  twice,  we  get, 

e(t)  =  qa(t)  -  q(t)  ,  e(t)  =  qa(t)  -  q(t).  (11) 

Substituting  q(t)into  (11)  gives 

e(t)  =  qaCO  +  M-^(q(t))lN(q(t),q(t))  -  t(12) 

From  (12)  the  control  function  u(t) can  be  defined 
as 

U(t)  =  qa(t)  +  M-^(q(t))[N(q(t),  q(t))  - 
T(t)].  (13) 

This  is  often  called  the  feedback  linearization 
control  law,  rewriting  (13)  as, 

T(t)  = 

M(q(t))[qa(t)  -  u(t)  +  N(q(t),q(t))]  (14) 

Using  (11)  and  (13),  the  state  vector  %(t)  = 
the  state-space  model  can  be 

represented  as 
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^  [o  ol  111 

Now,  (15)  is  in  the  form  of  a  linear  system  such 
as 

x(t)  =  Ax(t)  +  Bu(t)  .  (16) 

Implementation: 

The  proposed  control  design  was  implemented  on 
a  PIC  32MX360F512L  microcontroller  in  two 
stages:  “Signal  Processing”  and  “Motor  Actuation”. 
The  Signal  Processing  stage  enables  the  execution 
and  implementation  of  real-time  control  strategies. 
A  dsPIC  block  set  was  used  to  generate  the  C  code 
for  the  PIC  32  from  Simulink®.  The  dsPIC  block  set 
generates  a  .hex  file,  and  this  file  was  imported  in 
MPLAB®  to  program  the  PIC  32. 

Signal  Processing  Stage: 

From  the  many  modules  available  on  PIC  32,  the 
following  four  modules  were  utilized  for  the 
implementation  of  the  signal  processing  stage: 
Analog  Input  Module,  Digital  Output  module. 
Output  Compare  module,  and  URAT  module. 

The  sensory  feedback  joint  angle  data  from  the 
wheel  potentiometer  was  acquired  through  the 
Analog  Input  module.  Based  on  the  selected  control 
strategy  for  the  motor  actuation  stage,  the  digital 
control  signals  were  generated  by  the  Digital  Output 
module  of  the  PIC  32.  The  changes  in  the 
reference/command  signal  were  detected  by  this 
module.  A  pulse  width  modulated  (PWM)  wave 
with  a  specific  duty  cycle  was  generated  by  the 
Output  Compare  module  based  on  the  error.  The 
angle  data  from  the  microcontroller  to  the  PC  was 
transmitted  by  the  UART  module  via  serial 
communication.  In  this  particular  design,  the  data 
was  fed  to  the  computer  by  a  virtual  com  port  via 
USB  cable.  The  signals  from  the  ports  were  read  by 
MATLAB®. 

Motor  Actuation  Stage: 

In  this  stage,  the  motor  was  actuated  with  a 
SN754410  quadruple  half-H  driver  [18]  with  the 
corresponding  control  signal.  This  proposed  design 
was  tested  on  the  index  finger  of  a  prosthetic  hand 
prototype.  Fig.  3  shows  the  test  bed  for  the  proposed 
design. 


Fig.  3.  Embedded  Test  bed  for  the  proposed  design 
Mechanical  structure  of  the  robotic  hand  prototype: 

The  prosthetic  hand  prototype  finger  has  three 
degrees  of  freedom  stimulated  by  two  Pololu  35:1 
mini  metal  gear  motors.  Biologically  inspired 
parallel  actuation  is  the  main  characteristic  of  this 
robotic  hand  prototype.  It  is  based  on  the 
behaviour/strength  space  of  the  Flexor  Digitorum 
Profundus  (FDP)  and  the  Flexor  Digitorum 
Superficialis  (FDS)  muscles  [19].  Using  a  belt 
transmission  system,  the  DC  motor  in  the 
metacarpal  phalange  of  the  finger  triggers  the 
Proximal  Inter  Phalangeal  (PIP)  joint.  It  also  drives 
the  DIP  (Distal  Inter  Phalangeal)  joint.  The  Meta 
Carpo  Phalangeal  (MCP)  joint  is  actuated  by  the  DC 
motor  located  at  the  base  of  the  finger  as  shown  in 
Fig.  4. 


Fig.  4.  Finger  Actuation  Scheme 


4  Results  and  Discussion 

Data  was  acquired  from  the  microcontroller  through 
UART  channel2  of  the  PIC  32  micro  controller  by  a 
virtual  com  port  via  USB  at  a  57600  baud  rate.  The 
data  from  the  microcontroller  was  converted  into 
unit  16  data  type  before  it  is  transmitted  through  the 
UART.  It  ran  at  an  external  clock  frequency  of 
8MHz  with  internal  scaling  enabled.  Fig.  5  depicts 
the  experimental  results  of  the  proposed  design.  The 
actual  angle  output  from  the  position  sensor  (i.e.T) 
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closely  follows  the  fusion  algorithm  estimated  angle 
Y.  Fig.  6  shows  the  fusion  estimated  angle 
profile  Y  and  actual  angle  from  the  position  sensor 
(F)  plotted  for  a  separate  experiment.  Fig.  7  shows 
the  repeated  experimental  results.  The  proposed 
control  strategy  was  tracking  angle  profile  and 
matching  the  actual  angle  profile  with  the  model 
estimated  angle  ( Y). 


not  yet  been  implemented  because  of  the  slow 
response  of  the  SMA’s,  and  also  because  SMA’s 
have  a  long  relaxation  time.  Therefore  it  is  difficult 
to  track  a  randomly  changing  angle  profile  with  a 
slowly  responding  actuation  system.  However,  as 
the  prosthetic  hand  prototype  is  designed  to  use  the 
parallel  actuation  of  these  DC  motors  and  SMA’s, 
the  DC  motors  alone  cannot  produce  a  fusion 
algorithm  estimated  angle  profile. 


Fusion  Algorithm  Estimated  Position  Profile 
M  Actual  Position  from  the  Position  Sensor 
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Fig.  5.  Fusion  based  angle  estimate  and  actual  angle 
from  angle  sensor  during  the  grasp  action. 


Fig.  6.  Fusion  based  angle  estimate  and  actual  angle 
from  angle  sensor  during  the  grasp  action  (for 
experiment-2). 


Fig.  7.  Fusion  based  angle  estimate  and  actual  angle 
from  angle  sensor  during  the  grasp  action  (for 
experiment-3). 


Fig.  8.  Validation  Plot. 


While  conducting  the  experiments,  the  following 
observations  were  made.  The  DC  motors  currently 
employed  have  the  primary  task  of  moving  the 
prosthetic  fingers.  As  the  project  is  on-going  ,  the 
Shape  Memory  Alloy  (SMA)  actuation  scheme  has 


In  this  work,  the  DC  motors  are  solely  responsible 
for  motion  actuation.  Since  the  DC  motors  have 
small  gear  heads,  the  usual  characteristic  of  gear 
driver  actuation  cores  occurs:  gear  backlash.  In 
addition,  the  DC  motors  employed  were  slow  in 
responding  to  the  changes  in  the  force  profile. 
Hence  some  gaps  and  delay  were  observed  in  the 
measured  angle  signal.  However,  the  profile  of  the 
measured  angle  from  the  angle  sensor  has  a  similar 
pattern  as  the  fusion  algorithm  estimated  angle  (  Y). 
Thus  we  can  conclude  that  apart  from  those 
mechanical  transmission  problems,  the  implemented 
control  scheme  produced  promising  results.  These 
problems  will  be  considered  in  a  new  prototype 
design  that  we  are  currently  developing. 

From  the  results,  it  is  also  evident  from  Figs.  5,  6 
and  7  that  the  controller  is  tracking  the  slow  changes 
in  the  angle  profile  very  well,  where  as  a  small 
delay  was  observed  while  tracking  the  angle  profile. 
In  order  to  test  the  precision  of  the  proposed  control 
strategy,  15  different  experiments  were  conducted. 
The  mean  of  the  Pearson's  correlation  coefficient  for 
the  fusion  algorithm  estimated  angle  ( Y)  and  the 
actual  angle  from  the  angle  sensor  (F)  in  all  the  15 
experiments  is  0.86.  Because  of  the  above 
mentioned  transmission  problems  and  the  slow 
response  of  the  gears,  slight  variability  is  observed 
in  the  correlation  coefficients  for  the  15 
experiments.  Hence  the  difference  in  tracking  the 
angle  profile  is  observed  in  Figs.  6  and  7.  Fig.  8 
depicts  the  validation  plot  with  a  different  fusion 
algorithm  angle  estimate  F  obtained  by  feeding  a 
different  sEMG. 

5.  Conclusion  and  Future  Work 

In  this  paper,  based  on  sEMG  signals,  we 
proposed  a  two-stage  real-time  embedded 
MRAC  strategy  for  a  prosthetic  hand  prototype. 
The  proposed  design  was  based  on  tracking  a 
reference  angle  profile  and  it  gives  good 
performance  when  tested  on  a  prosthetic  hand 
prototype.  This  design  enables  the  transmission 
of  the  data  from  the  microcontroller  to  the 
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computer.  This  design  allows  the  control 
engineer  to  increase  the  accuracy  and 
performance  of  the  design  by  implementing 
various  novel  control  strategies  and  also  enables 
fast  trouble  shooting. 

For  future  work,  we  are  planning  to  use  the 
above  mentioned  embedded  platform  to 
implement  online  model-based  skeletal  muscle 
angle  estimation  along  with  controller  designs 
that  address  the  above  listed  mechanical 
shortcomings.  It  will  be  valuable  to  acquire  the 
sEMG  signal  directly  from  the  arm  of  a  healthy 
subject  and  transmit  to  our  embedded  system 
rather  than  using  pre-recorded  sEMG  signals, 
which  will  be  investigated  as  well  in  the  future. 
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Abstract:  This  paper  presents  a  surface  electromyographic 
(sEMG) -based,  optimal  control  strategy  for  a  prosthetic 
hand.  System  Identification  (SI)  is  used  to  obtain  the 
dynamic  relation  between  the  sEMG  and  the  force.  The  input 
sEMG  signal  is  preprocessed  using  a  Half-Gaussian  filter  and 
fed  to  a  fusion-based  Multiple  Input  Single  Output  (MISO) 
skeletal  muscle  force  model.  This  MISO  system  model 
provides  the  estimated  finger  forces  to  be  produced  as  input 
to  the  prosthetic  hand.  Optimal  tracking  method  has  been 
applied  to  track  the  estimated  force  profile  of  the  Fusion 
based  sEMG-force  model.  The  simulation  results  show  good 
agreement  between  reference  force  profile  and  the  actual 
force. 

I.  Introduction 

Currently  there  are  more  than  2  million  Americans  that 
have  a  missing  limb.  The  number  of  Americans  with 
missing  limbs  increases  185,000  people  a  year  [1].  As  a 
result  of  this  rising  number  of  people  that  need  prostheses, 
research  is  being  focused  on  creating  more  intuitive 
prosthetics.  There  has  been  active  research  to  design  a 
prosthetic  hand.  But  even  today  there  is  no  prosthetic  hand 
at  an  affordable  cost  with  position  and  tactile  force  control 
[2].  It  is  evident  from  the  past  research  that  the  human- 
centered  robotics  should  be  autonomous  with  a  high  level 
of  functionality,  comfort  and  ease  of  use  [3].  A  natural 
means  of  communication  is  required  for  human-centered 
robotics  [4],  and  in  the  case  of  electromyographic  (EMG) 
based  prostheses,  one  natural  means  of  interface  between 
the  human  arm  and  prosthesis  is  the  surface  EMG  (sEMG) 
itself.  The  EMG  signal  is  present  because  of  the 
neuromuscular  activity  in  the  body.  The  sEMG  signals  are 
captured  noninvasively  and  give  access  to  physiological 
processes  responsible  for  the  contraction  of  muscles.  Since 
the  sEMG  signal  is  amplitude  modulated  and  time 
dependent,  and  dynamic  in  nature,  spatially  and 
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temporally  frequency  encoded  [5].  Usually  sEMG 
measurements  are  based  on  single  sensor  data.  Eor  this 
work  we  used  an  array  of  three  sEMG  sensors  and  a  force 
sensing  resistor  (ESR)  to  acquire  the  EMG  signal  and  the 
corresponding  skeletal  muscle  force.  The  data  from  the 
three  sEMG  sensors  is  fused  using  a  fusion  algorithm  to 
have  a  better  estimation  of  skeletal  muscle  force  from  the 
corresponding  sEMG  signal  when  compared  to  single 
sensor  data  [6]. 

This  paper  uses  the  sEMG-force  fusion  model  as 
reference  profile.  A  Linear  Quadratic  Tracking  (LQT) 
technique  is  employed  to  the  prosthetic  hand  to  track  the 
force  profile.  This  paper  is  structured  as  follows.  The 
experimental  set  up  is  given  in  Section  II,  Section  III 
provides  reference  force  model  and  Section  V  provides 
dynamics  of  the  hand.  Section  VI  details  the  results  and 
discussion  and  in  the  last  section  some  conclusions  are 
provided. 

II.  Experimental  Set-Up 

Experiments  were  conducted  on  a  right-handed  healthy 
male  subject.  Using  a  muscle  simulator  (Rich-Mar 
Corporation  HV  1100),  motor  units  were  marked  and 
sEMG  sensors  were  placed  accordingly  [6].  One  sEMG 
sensor  was  placed  on  the  motor  point  of  the  subject’s  ring 
finger  and  two  sensors  were  placed  at  points  adjacent  to  it. 
Prior  to  placing  the  sEMG  sensors,  the  skin  surface  of  the 
subject  was  prepared  according  to  International  Society  of 
Electrophysiology  and  Kinesiology  (ISEK)  protocols  [7]. 
Both  sEMG  and  muscle  force  signals  were  acquired 
simultaneously  using  Lab  VIEW™  8.2  at  a  sampling  rate 
of  2000  Hz.  The  sEMG  data  was  captured  by  a 
DELSYS®  Bagnoli-16  EMG  system  with  DE-2.1 
differential  EMG  sensors.  The  force  information  was 
collected  by  a  NI  ELVIS  with  an  Interlink  Electronics  ESR 
0.5”  circular  force  sensor. 

III.  Reeerence  Eorce  Model 

In  this  present  work  the  force  signal  is  extracted  from 
the  sEMG  signals  obtained  from  the  array  of  the  three 
sEMG  sensors  located  on  the  arm.  The  data  from  the  three 
sensors  is  collected  around  the  corresponding  individual 
motor  unit  location  at  the  transradial  arm  location  (flexor 
digitorum  superficialis)  and  is  rectified  and  filtered  using  a 
Half-Gaussian  filter  given  by 

/  EMG^\ 

p(EMG\x)  =  2  X  (1) 


where  p(EMG\x)  is  a  conditional  probability  density 
function,  x  is  a  latent  driving  signal. 

The  preprocessed  sEMG  data  from  the  three  sensors  is 
fused  using  a  sensor  fusion  algorithm  to  facilitate  the 
extraction  of  the  best  finger  force  estimates.  Sensor  fusion 
is  accomplished  in  the  frequency  domain  using  a  simple 
elitism  based  Genetic  Algorithm  (GA).  The  SI  method  is 
used  to  identify  the  dynamical  relationship  between  the 
sEMG  data  from  the  three  sensors  and  the  corresponding 
finger  force.  In  this  fusion  algorithm,  Output  Error  (OE) 
models  are  used  to  achieve  the  SI.  The  OE  models  are 
constructed  for  each  individual  data  set.  The  OE  model 
structure  is  given  as  follows. 


where  Z'5  and  P's  are  the  zeros  and  poles  respectively  of 
the  individual  transfer  function  and  n  is  the  order  of  the 
system. 

Eeeding  the  new  data  sets  to  the  MISO  transfer  function 
(//(s))  (See  Appendix)  results  in  an  estimated  fusion 
based  force  Y. 

IV.  DYNAMICS  OE  PROSTHETIC  HAND 

The  dynamic  equations  of  motion  for  the  hand  are 
obtained  from  the  Lagrangian  approach  as  [8,9,10,11,12, 
13] 


y(t)  =  +  e(t)-  (2) 

Where  B,  and  Fare  the  polynomials,  q  is  shift  operator, 
e(t)  is  output  error,  y(t)  is  system  output,  u  is  input,  nk  is 
the  system  delay  and  t  is  time  index. 

Using  the  three  resulting  OE  models  and  the  fusion 
algorithm  given  by  [6],  a  corresponding  continuous -time 
model  is  constructed  as  given  by  the  transfer  function  as 


Where  q  and  q  represent  the  angular  velocity  and  angle 
vectors  of  joints  respectively;  L  is  the  Lagrangian;  r  is  the 
given  torque  vector  at  joints.  The  Lagrangian  L  is  given  as 

L  =  T  -V,  (6) 

Where  T  and  V  are  denoted  as  kinetic  and  potential 
energies  respectively.  Substituting  (6)  into  (5),  we  get  the 
following  dynamic  equations 


^  ^  F(s) 


(3) 


Similar  to  the  discrete-time  case ,  nb  and  nf  determine 
the  orders  of  the  numerator  and  denominator.  Eor  multi¬ 
input  systems,  nb  and  nf  row  vectors.  b,f3.YQ  the 
coefficients  of  the  numerator  and  denominator 
polynomials  respectively. 


A  MISO  transfer  function  is  constructed  based  on  the 
poles  of  three  individual  OE  models  corresponding  to  each 
sensor.  GA  is  used  to  find  the  corresponding  zeros.  The 
search  area  is  limited  to  the  unit  circle,  because  a  discrete 
time  model  is  used  (and  the  resulting  MISO  model  is 
decreased  to  minimum  phase).  The  number  of  zeros  is  at 
most  the  number  of  poles.  The  number  of  potential  zeros  is 
set  to  the  order  of  the  corresponding  denominator.  The 
error  squared  of  the  resulting  MISO  system  H(s)  (see 
Appendix)  and  the  recorded  force  signal  is  set  as  an 
objective  function.  The  objective  function  /  is  constructed 
as  follows. 


M(q)q  -h  C{q,q)  +  G{q)  =  r,  (7) 

Where  M{q)  describes  the  inertia  matrix;  G(q,q)  is  the 
coriolis/centripetal  vector  and  G(q)  is  the  gravity  vector. 
(7)  can  be  written  as 

M(q)q  +  N(q,q)  =  T  ,  (8) 

where  N(q,q)  =  C(q,q)  +  G(q)  represents  nonlinear 
terms. 

Eeedback  linearization  technique  is  used  to  convert  the 
nonlinear  dynamics  represented  by  (8)  into  a  linear  state- 
variable  system  [8].  In  order  to  obtain  the  alternative  state- 
space  equations  of  the  dynamics,  the  position/velocity 
state  x(t)  of  the  joint  is  defined  as 

xit)  =  [q  (t)  ij' (t)]'  ,  (9) 

and  rewriting  (8)  as 


/  =  (Y(t)  -  Y{tfdt  =  (p^(t)dt,  (3)  ^q(t)  =  -M  i(q(t))[N(q(t),q(t))  -  T(t)]  (10) 


where  to  and  ty.  are  the  initial  and  final  time  values,  ?(t)  Therefore,  from  (9)  and  (10),  a  linear  system  in 
is  the  fusion  model  estimated  force  and  T(t)  is  the  actual  Brunovsky  canonical  form  is  obtained  and  represented  as 
force  from  the  ESR. 

^  [n  nl  [il 

The  MISO  system  7/(5)  is  constructed  as  follows,  lu  uj  lij 


The  control  input  vector  zr(t)  given  by 

(4)  u(t)  = -M-^(q(t))[N(q(t),q(t)) (12) 

As  the  prosthetic  hand  is  required  to  track  the  desired 
force  profile  q^i(t)  described  under  the  reference  force 
model,  the  tracking  error  e(t)  is  defined  as 


e(0  = 


(13) 

Here,  qd(t)  is  the  desired  angle  vector  of  the  joints  and 
can  be  obtained  by  the  reference  force  model  [6] ;  q  (t)  is 
the  actual  angle  vector  of  the  joints.  Differentiating  (13) 
twice,  we  get, 

e(t)  =  Qdit)  -  q(t)  ,  e{t)  =  qa(t)  -  q(t).  (14) 

Substituting  (10)  into  (14)  gives 

e(t)  =  (jdit)  +  M-'^(q(t))[N{q(t),q(t))  -  T(t)]  (15) 

From  (15)  the  control  function  zr(t)can  be  defined  as 

u(t)=  qd(t)+  M-'^(q(t))[N(q(t),q(t))-T(t)].  (16) 

This  is  often  called  the  feedback  linearization  control 
law,  rewriting  (16)  as, 

T(t)  =  M(q(t))[qd(t)  -  u(t)  +  N{q(t),q(t))].  (17) 

Using  (14)  and  (16),  the  state  vector  x(t)  = 
[e  (t)e  (t)]  ,  the  state-space  model  can  be  represented  as 

x(t)  =  0  o]  ''' 

Now,  (18)  is  in  the  form  of  a  linear  system  such  as 
i(t)  =  Ax(t)  +  Bu(t)  .  (19) 


Fig.  1.  Block  Diagram  of  Optimal  Controller  for 
Prosthetic  Hand. 


OPTIMAL  TRACKING 

Figure  1  shows  the  block  diagram  representation  of  the 
finite-time  linear  quadratic  optimal  controller  for  the 
prosthetic  hand.  The  objective  of  the  controller  is  for  the 
prosthetic  hand  finger  to  track  optimally  the  force  model. 

For  the  linear  system  (19),  the  finite-time  linear 
quadratic  optimal  control  problem  can  be  formulated  by 
defining  the  performance  index  ]  [14]  as 

]  =  +  u\t)R(t)u{t)]  dt  (20) 

where  Q{t)  is  the  error  weighted  matrix;  and  R{t)  is 
the  control  weighted  matrix.  The  optimal  control  u*(t)  is 


described  by 

u*{t)  =  -R-^{t)B  P{t)x\t)  =  -K{t)x\t).  (21) 

where  K{t)  =  —R~^{t)B  P{t)  is  called  Kalman  gain 
andP(t),  is  the  solution  of  the  matrix  differential  Riccati 
equation  (DRE) 

P{t)  = 

-P{t)A  -  AP{t)  -  Q{t)  +  Pit)BR-^(it)B'Pit)  (22) 

Satisfying  the  final  condition 

p(t  =  tf)  =  0.  (23) 

Hence  the  optimal  state  x*  is  the  solution  of 

i*(t)  =  [A-  BR-^(t)B'P(t)]x*(it).  (24) 

Therefore,  with  the  optimal  control  the  required 

torque  T*(t)  can  be  calculated  by 

t’(0  =  M{q(t)){qa(t)  -  +  N(q(t),q(t)).  (25) 

The  torque  T*(t)  is  converted  into  force  by 

fo(0  =T‘(t)/L,  (26) 

Where  (t)is  the  force  and  L  is  the  length  of  the  finger. 

VI.  RESULTS  AND  DISCUSSION 

Figure  2  shows  the  fusion  model  force  Y(t)  and  the 
force  output  from  the  controller  (t) .  It  is  evident  that  the 
optimal  controller  can  track  the  changes  in  the  force 
profile  and  follow  the  trends  in  reference  force  profile. 


Fig.  2.  Fusion  Reference  Model  Force  and  Actual  Force 


Figure  3  shows  the  error  between  the  model  force  Y  (t) 
and  the  force  output  from  the  controller  F^Cf)  two 
different  sets  of  results  shown  in  Figs.  2  and  4.  This  figure 
shows  that  the  error  converged  to  zero  in  a  very  short  time 
and  the  error  is  hovering  between  zero  throughout  the  time 
interval.  In  some  instances  the  force  output  of  the 
controller  F^  (t)  cannot  track  the  rapidly  changing 
reference  force  profile  during  short  intervals.  The  Pearson 
correlation  coefficient  (see  Appendix)  for  the  reference 


Y(t)  and  controller  output  force  F^^t)  profile  is  0.8714. 
Figure  4  shows  the  validation  with  a  different  reference 
force  f(t)  profile  and  it  yields  0.8707  correlation,  thus 
showing  good  agreement  between  the  reference  model 
force  and  the  actual  force. 


Fig.  3.  Error  Between  the  Model  Force  and  the  Actual 
Force 


VII.  Conclusion  and  future  work 

A  fusion-based  sEMG-force  model  was  utilized  to 
estimate  the  force  profile  that  a  prosthetic  hand  should 
track.  This  fusion  enables  to  get  better  force  estimates  than 
the  single  sensor  data.  The  dynamics  of  the  hand  was 
obtained  and  the  controller  for  optimal  tracking  between 
the  reference  model  and  the  hand  was  designed.  The 
proposed  design  gives  good  performance  when  tested  on  a 
prosthetic  hand,  based  on  tracking  a  reference  force 
profile.  In  future,  we  plan  to  implement  this  proposed 
control  strategy  on  a  micro  controller  for  real  time  control. 
It  would  be  interesting  to  implement  both  the  force  and 
position  control  using  this  control  strategy.  Finally,  we 
plan  to  use  the  hand  prototype  with  five  fingers. 

Appendix 

The  resulting  MISO  transfer  function  H(s)  is  constructed 
as. 

From  Ui  to  output, 

-  3.843s^  +  7.729s^  -  10.78s^  +  10.6s^  -  7.417s^  +  3.6035^  -  0.9795s  +  0.1192 
s^  -  4.028s7  +  6.325s6  -  4.1215^  -  1.5455^  +  5.875^  -  5.4335^  +  2.28s  -  0.3496 

From  U2  to  output, 

s^-  4.339s^ +  9.005s^  -  12.42s^  +  12.22s^  -  8.117s^  +  3.427s2  -  0.9134  s  +  0.1424 
s^-  4.028  s^  +  6.325  s^-  4.121  s^-  1.545  s^  +  5.87  s^-  5.433  s^  +  2.28  s  -  0.3496 

From  to  output. 


Pearson  correlation  coefficient  is  given  by, 

Y)  _  F[(X  -  -  Mr)] 

Px,Y  —  corri^A,  Y )  —  — 

axCTy  OxGy 

Where  X,Y  are  Random  Variables,  pLx  and  are 
expected  values,  ay  are  standard  deviations 
respectively.  E  is  expected  value  operator. 
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Abstract  —  This  paper  presents  a  real-time  force  control 
strategy  for  a  prosthetic  hand.  The  proposed  design  is 
capable  of  decoding  the  prerecorded  surface 
electromyographic  (sEMG)  signal  as  well  as  the  sensory 
force  feedback  from  the  sensors  to  control  the  force  of 
the  prosthetic  hand  prototype.  The  input  sEMG  signal  is 
preprocessed  using  a  Half-Gaussian  filter  with  optimized 
parameters  and  Chebyshev  type  II  filter.  Entropy  of  the 
sEMG  signal  is  used  as  a  threshold  value  to  establish  the 
correlation  between  the  sEMG  signal  and  the  skeletal 
muscle  force.  A  simple  proportional  integral  controller 
along  with  a  two-stage  embedded  design  is  used  for  the 
force  control  of  the  prosthetic  hand.  The  results  are 
transmitted  to  the  computer  through  the  universal 
asynchronous  receiver/  transmitter  (UART)  interface  of 
the  proposed  embedded  design.  The  results  demonstrate 
good  performance  in  controlling  the  force  of  the 
prosthetic  hand. 

1.  Introduction 

In  the  field  of  rehabilitation,  one  of  the  most  interesting 
topics  of  research  is  human-machine  interface.  In  case  of 
prosthesis  design,  development  and  control,  the  sEMG 
signals  play  a  vital  role  which  is  a  natural  means  of  interface 
between  the  human  arm  and  prosthesis.  The  sEMG  signals 
are  electrical  voltages  ranging  from  -5  to  -f5  (mV)  which  can 
be  recorded  on  the  human  arm  using  suitable  sensing 
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elements.  The  base  sEMG  signal  is  always  available  and  this 
signal  changes  with  the  movements  of  different  fingers  and 
applied  force  for  different  tasks.  This  is  the  reason  that 
sEMG  signals  are  very  useful  and  can  be  input  signals  for 
the  controller  of  hand  prosthesis  to  control  the  movements 
and  force  applied  by  the  fingers.  There  has  been  active 
research  work  to  design  a  prosthetic  hand,  but  even  today  we 
do  not  have  a  prosthetic  hand  with  tactile  or  proprioceptive 
feedback  for  grasping  [1].  Most  of  these  prostheses  only  use 
the  direct  vision  of  the  user  as  a  sensory  feedback  for  the 
position  control.  This  is  why  30-50%  of  upper  extremity 
amputees  choose  not  to  use  their  prosthetic  hands  on  a 
regular  basis  [2-3].  Thus  far,  several  EMG-based  algorithms 
have  been  developed  and  used  to  enhance  the  functionality 
and  usability  of  prosthetic  hands  [4].  Since  the  human  hand 
is  a  highly  complex  and  nonlinear  system  with  a  large 
number  of  degrees  of  freedom,  the  control  of  a  multi¬ 
fingered  prosthetic  hand  is  complicated  [5].  Previously  there 
has  been  active  research  in  the  area  of  position  and  force 
control  of  a  prosthetic  hand,  and  the  typical  approach  is  to 
use  hybrid  position  and  force  control  [6].  By  contrast,  this 
proposed  research  work  focuses  on  the  design  of  an 
embedded  control  system  that  can  control  the  movements 
and  force  of  a  smart  prosthetic  hand  with  sensory  feedback. 
The  input  to  this  embedded  control  system  is  the  entropy  of 
the  input  sEMG  signal.  Steady  state  sEMG  signals  have  little 
temporal  structure  and  actively  modify  the  recruitment  and 
firing  patterns  needed  to  sustained  contraction  [7].  The 
sEMG  signal  amplitude  can  be  quantified  using  variance, 
mean  absolute  value,  Eourier  spectrum  and  median 
frequency.  But  these  techniques  are  not  usually  sufficient  to 
distinguish  between  more  than  two  classes  of  movements. 

Embedded  systems  have  become  pervasive  and  as 
research  advances,  more  and  more  functions  of  analog 
circuits  are  being  realized  by  microcontrollers.  Analog  to 
Digital  Converters  (ADCs)  and  Digital  to  Analog  Converters 
(DACs).  In  a  modern  control  system,  embedded  control 
addresses  most  control  functions.  A  well  designed  embedded 
control  system  can  give  excellent  system  performance  under 
widely  varying  operating  conditions.  Eor  robust  and 
consistent  high  performance,  the  embedded  system  should 
be  designed  carefully  and  in  balance.  In  this  particular  case 
we  need  to  have  a  real-time  embedded  control  system  that 
performs  the  desired  tasks. 


In  this  present  work  we  are  using  the  Shannon  entropy 
values  of  sEMG  signals  as  inputs  to  design  a  proportional 
integral  (PI)  controller  to  control  the  force  of  a  prosthetic 
hand  prototype.  Force  feedback  is  acquired  using  a  Force 
Sensing  Resistor  (FSR)  which  is  compared  with  stored  force 
signals.  The  sEMG  signal  is  filtered  through  a  Half-Gaussian 
filter  with  optimized  parameters;  the  force  signal  is  filtered 
using  a  Chebyshev  type-II  filter. 

In  physics,  entropy  is  related  to  the  amount  of  disorder  in 
a  system,  and  is  proportional  to  the  logarithm  of  the  number 
of  microstates  available  to  a  thermodynamic  system.  The 
concept  of  entropy  for  information  theory  is  given  by 
Shannon  and  Weaver  [8],  and  Johnson  and  Shore  [9],  who 
used  entropy  for  the  power  spectrum  of  a  signal.  For 
instance,  a  signal  has  an  entropy  value  of  zero  if  its 
sequential  values  alternate  between  one  fixed  magnitude  and 
another  fixed  magnitude.  A  signal  with  zero  entropy  value  is 
completely  regular  and  very  predictable.  In  contrast,  a  signal 
has  higher  entropy  if  a  random  number  generates  its 
sequential  values.  Thus,  using  entropy,  we  can  visually 
distinguish  a  regular  signal  from  an  irregular  one.  Since 
entropy  is  independent  of  the  absolute  scales,  it  can  be 
computed  by  methods  such  as  approximate  entropy  [10,  11] 
or  Shannon  entropy  [8,  12,  13]  in  the  time  domain,  and 
spectral  entropy  [8,  9,  14,  15]  in  the  frequency  domain.  The 
non-normalized  Shannon  entropy  is  given  by  Equation  (1). 

Eis)  =  -'Zisf  *  logisf),  (1) 

where  s  is  the  signal  and  5^  are  the  coefficients  of  5  in  an 
orthonormal  basis. 

The  threshold  values  of  the  entropy  are  used  to  initiate  the 
movement  of  the  DC  motors,  which  is  the  reference  for  the 
controller.  The  details  are  specified  in  the  Proposed  Design 
section.  Our  results  demonstrate  good  performance  by  the 
proposed  design.  This  paper  is  organized  as  follows.  Section 
II  addresses  Experimental  Set-Up,  Section  III  gives 
Proposed  Design,  Section  IV  has  Mechanical  Structure  of 
the  Robotic  Hand  Prototype,  Results  and  Discussion  are 
given  in  Section  V.  and  finally  some  conclusion  and  future 
work  are  given  in  Section  VI. 

II.  Experimental  Set-Up 

Ten  healthy  subjects  volunteered  for  our  experiments.  A 
muscle  stimulator  was  used  to  detect  the  motor  points  for 
index,  middle  and  ring  fingers.  The  sEMG  and  skeletal 
muscle  force  signals  were  acquired  using  the  16-channel 
DELSYS®  BagnolisEMG  and  NI  ELVIS™  respectively.  DE 
2.1  sEMG  sensors  and  a  stress  ball  with  a  0.5  inches  circular 
as  force  sensing  resistor  (FSR)  from  Interlink™  Electronics 
was  used  to  acquire  the  force  signals.  Prior  to  placing  the 
sEMG  sensors,  the  skin  surface  of  the  subject  was  prepared 
according  to  the  International  Society  of  Electrophysiology 
and  Kinesiology  (ISEK)  protocols.  Both  the  signals  were 
acquired  in  LabVIEW™  at  a  rate  of  2000  Hz.  The 
experimental  set-up  is  shown  in  Fig.  1,  where  a  healthy 


subject  is  hooked-up  with  sEMG  sensors  and  is  squeezing 
the  stress  ball  to  generate  the  skeletal  muscle  force,  which  in 
turn  affects  the  sEMG  signals.  Several  experiments  with 
different  durations  were  conducted  for  each  subject. 


Fig.  1.  Experimental  set-up. 


III.  Proposed  Design 

For  our  proposed  design,  entropy  values  of  the  sEMG 
signals  were  calculated  and  taken  as  threshold  values  to 
initiate  the  motion.  Entropy  values  were  extracted  from 
sEMG  of  the  index,  middle  and  ring  fingers  respectively  for 
a  power  grasping  action.  The  entropy  values  of  the  sEMG 
data  for  10  different  subjects  are  tabulated  in  Table  1,  where 
Ringi  and  Middle i  correspond  to  the  Shannon  entropy  of  the 
respective  finger  right  next  to  its  motor  unit  location. 


Table  i 

Entropy  Values  of  sEMG  Signals  for  Three  Fingers 


Index 

Ring 

Middle 

Ringi 

Middlei 

2.9792 

2.9271 

2.1554 

2.3994 

1.6711 

2.6783 

3.0008 

1.9376 

2.3947 

1.5346 

3.4943 

2.9556 

3.0277 

2.9568 

2.6673 

3.679 

3.1714 

2.9268 

3.1175 

3.0581 

3.2110 

2.7015 

1.9228 

2.7997 

1.2993 

2.8451 

2.9429 

1.9555 

3.0541 

1.1095 

1.4653 

1.5559 

3.7151 

2.4827 

1.6919 

1.9371 

1.4639 

3.6648 

3.2785 

1.7955 

2.7399 

3.7132 

3.0820 

3.0425 

2.3929 

2.5421 

3.5961 

2.8593 

2.6782 

2.2040 

Threshold  values  are  tabulated  in  Table  2.  The  threshold 
values  are  calculated  as  the  difference  between  the  mean  and 
twice  the  standard  deviation. 


TABLE  2 

Shannon  Entropy  Threshold  Values  eor  Index,  Ring, 
AND  Middle  Finger  sEMG  Signals. 


Index 

Ring 

Middle 

1.3724 

1.5176 

1.522 

In  this  design,  the  threshold  values  establish  a  correlation 
between  the  sEMG  and  the  corresponding  force  required  for 
the  power  grasp  of  an  object.  C.Potluri  et.  al  [16]  explained 
about  the  correlation  between  sEMG  entropy  threshold 
values  and  skeletal  muscle  forces.  These  threshold  values  are 
fed  as  the  reference  or  a  set  point  to  the  controller.  The 
signal  flow  representation  of  the  proposed  design  is  depicted 
as  a  block  diagram  in  Fig.  2. 


Microcontroller 


Fig.  2.  Block  diagram  of  the  proposed  design. 

The  force  feedback  signal  is  acquired  by  a  force  sensitive 
resistor  (FSR).  The  FSR  is  mounted  on  the  fingertip  of  the 
prosthetic  hand  prototype  as  shown  in  Fig.  4.  The  error  e{t) 
is  computed  as  the  difference  between  the  reference  value 
and  the  actual  force  from  the  FSR.  A  proportion-integral  (PI) 
controller  is  employed  to  generate  the  actual  force  from  the 
FSR,  and  make  it  equal  to  the  reference  force  in  order  to 
reduce  the  error  e{t)  to  zero.  The  PI  control  action  is  given 
below  in  Equation  (2). 

u{t)  =  Kp  ^  e(t)  +  Ki  e(T)dT,  (2) 

Where  u(t)  is  the  control  signal,  is  the  proportional  gain, 
and  Ki  is  the  integral  gain.  e(t)  is  the  error  and  r  is  the 
dummy  integration  variable.  Gain  parameters  and  are 
tuned  using  the  Ziegler-Nichols  method  in  MATLAB®. 

Our  proposed  design  was  implemented  on  a  PIC32 
microcontroller  in  two  stages:  “Signal  Processing”  and 
’’Motor  Actuation”.  The  Signal  Processing  stage  facilitates 
the  implementation  of  real-time  control  strategies.  A  dsPIC 
blockset  was  used  to  generate  the  C  code  for  the  PIC32  from 
Simulink®.  The  dsPIC  blockset  generates  a  .hex  file,  and  this 
file  is  imported  by  MPLAB®  to  program  the  PIC32. 


Signal  Processing  Stage 

We  used  the  following  modules  of  the  PIC32  as  a  part  of 
implementing  our  control  strategies: 

a.  The  Analog  Input  module 

b.  The  Digital  Output  module 

c.  The  Output  Compare  module 

d.  The  UART  module 

The  Analog  Input  module  was  used  for  reading  the  sEMG 
and  sensory  feedback  data.  The  PIC32  has  an  internal  analog 
to  digital  converter  (ADC)  which  has  a  10-bit  resolution  so 
that  it  can  distinguish  up  to  1024  different  voltages,  usually 
in  the  range  of  0  to  3.3  volts,  and  it  yields  3mV  resolution.  A 
real-time  control  strategy  was  developed  using  the  threshold 
value  of  the  entropy  of  sEMG  data  as  a  reference  or  set 
point.  The  difference  between  the  threshold  of  the  sEMG 
entropy  and  the  ESR  feedback  was  fed  in  to  the  PI  control 
loop  to  reduce  the  error  to  zero.  The  Digital  Output  module 
of  the  PIC32  was  used  to  generate  digital  control  signals. 
Depending  on  the  error,  a  pulse  width  modulated  (PWM) 
wave  with  a  specific  duty  cycle  was  generated  in  the  Output 
Compare  module.  The  UART  module  in  the  PIC32  was  used 
to  transmit  the  signals  from  the  microcontroller  to  the  PC  via 
serial  communication.  In  this  design,  a  virtual  com  port  was 
created  to  feed  the  data  via  USB  cable  to  the  computer. 
MATLAB®  was  used  to  read  the  signals  from  the  ports.  This 
enables  the  user  to  troubleshoot  and  see  the  performance  of 
the  designed  control  strategy. 

Motor  Actuation  Stage 

In  this  stage,  a  SN754410  quadruple  half-H  driver  is  used 
to  actuate  the  motor  with  the  corresponding  control  signal. 
Pig.  3  shows  the  schematic  of  the  pin  configuration  of  the 
half-H  driver. 
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Pig.  3.  Pin  configuration  of  quadruple  half-H  driver  [17]. 


The  PWM  signal  from  the  Output  Compare  module  was 
connected  to  pint  (1,  2EN)  of  the  H  driver.  The  PWM  wave 
enables  this  H  driver.  The  speed  of  the  motor  depends  on  the 
duty  cycle  of  the  PWM  wave  from  the  Output  Compare 
module,  which  is  a  function  of  e(t).  The  digital  outputs  of 
the  PICS 2  microcontroller  are  connected  to  the  direction 
pins  of  the  H  driver  (pins  2  and  7).  Switching  the  digital 
outputs  to  0  and  1  between  the  pins  will  makes  the  motor 
rotate  in  clockwise  and  counter-clockwise  directions.  Vcd 
and  Vcc2  are  connected  to  the  5V  supply  of  the  PIC32  I/O 
board.  This  proposed  design  was  tested  on  an  index  finger  of 
a  prosthetic  hand  prototype.  Fig.  4  shows  the  test  bed  for  the 
proposed  design.  Mechanical  design  of  the  robotic  hand 
prototype  is  explained  in  the  following  section. 


Fig.  4.  Test  bed  for  the  proposed  design. 

IV.  Mechanical  Structure  of  The  Robotic  Hand 
Prototype 

The  robotic  hand  prototype  finger  has  three  degrees  of 
freedom,  and  is  actuated  by  two  Pololu  35:1  mini  metal  gear 
motors  and  a  bevel  gear  transmission  system.  The  main 
characteristic  of  this  prototype  is  its  biologically-inspired 
parallel  actuation  system  based  on  the  behavior/strength 
space  of  the  ’’Flexor  Digitorum  Profundus  (FDP)”  and  the 
’’Flexor  Digitorum  Superficialis  (FDS)”  muscles  as 
explained  in  Fig.  5.  However  this  research  work  focuses  on 
the  “Region  1”  actuation  system  and  it  is  interfacing  with  a 
microcontroller.  Region  1  is  populated  by  the  more  frequent 
dexterous  tasks,  whereas  “Region  2”  is  populated  by  the  less 
frequent  and  more  strength-based  tasks  for  which  an 
additional  parallel  actuation  system  is  provided  as  discussed 
in  [18]. 


Fig.  5.  Strength  space  of  FDS  and  FDP  muscles  [19]. 

In  our  design,  the  movements  associated  with  Region  1 
are  achieved  by  2  DC  motors.  The  motor  in  the  metacarpal 
phalange  of  the  finger  actuates  the  PIP  (Proximal  Inter 
Phalangeal)  joint  and  the  motor  at  the  base  of  the  finger 
actuates  the  MCP  (Meta  Carpo  Phalangeal)  joint,  as  shown 
in  Fig.  6.  As  the  main  objective  of  this  work  is  to  interface 
and  control  the  two  motors  with  a  microcontroller,  we  have 
not  considered  the  belt  transmission  system  shown  in  Fig.  6, 
which  is  designed  to  drive  the  DIP  (Distal  Inter  Phalangeal) 
joint  as  well. 


Fig. 6.  Region  1  Actuation  scheme  for  the  finger. 

V.  Results  And  Discussion 

Results  are  acquired  from  the  microcontroller  through 
UART  channel  2  of  the  PIC32  by  a  virtual  com  port  via 
USB  at  57600  baud  rate.  The  data  from  the  microcontroller 
is  converted  into  unit  16  data  before  it  is  transmitted  through 
the  UART.  The  PIC32  microcontroller  is  running  80  million 
instructions  per  second  (MIPS)  with  its  phase  lock  loop 
(PLL)  activated.  It  is  running  at  an  external  clock  frequency 
of  8MHz  with  internal  scaling  enabled. 
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Fig.  7.  Feedback  force  and  error  before  grasp. 
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This  result  suggests  an  extensible  design  for  increased 
load  on  the  processing  by  the  embedded  system. 
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Fig.  7.  Depicts  the  feedback  force  from  the  FSR,  and  the 
error  e(t)  before  the  grasp.  As  there  is  no  contact  between 
the  object  and  the  hand,  the  force  is  low  and  ideally  it  should 
be  zero.  However,  because  the  PIC32’s  analog  to  digital 
conversion  provides  a  high  resolution,  it  shows  some  value 
even  when  the  object  is  not  in  contact. 
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Fig. 9.  Computational  load  on  the  PIC32  during  the  grasp 

VI.  Conclusion  And  Future  Work 

A  two- stage  real-time  control  strategy  was  designed  for  a 
robotic  hand  prototype.  The  proposed  design  gives  good 
performance  when  tested  on  a  prosthetic  hand  prototype,  and 
at  the  same  time  the  error  between  the  reference  force  and 
the  actual  force  from  the  sensors  is  very  small  and 
approaches  zero.  This  design  facilitates  the  transmission  of 
the  data  from  the  microcontroller  to  the  computer.  This 
enables  the  user  to  increase  the  accuracy  and  performance  of 
the  design  by  implementing  various  novel  control  strategies 
and  also  enables  quick  trouble  shooting. 

For  future  work  we  are  planning  to  implement  model- 
based  force  estimation  and  along  with  controller  design  for 
position  and  force  control,  based  on  this  embedded  platform. 
It  will  be  interesting  to  acquire  the  sEMG  signal  directly 
from  the  arm  of  a  healthy  subject  to  our  embedded  system 
instead  of  using  prerecorded  sEMG  signals,  which  will  be 
investigated.  Finally,  we  plan  to  use  the  prototype  with  five 
fingers. 


Fig.  8.  Feedback  force  and  error  after  grasp. 
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Abstract:  This  paper  presents  a  surface  electromyographic 
(sEMG) -based,  optimal  control  strategy  for  a  prosthetic 
hand.  System  Identification  (SI)  is  used  to  obtain  the 
dynamic  relation  between  the  sEMG  and  the  force.  The  input 
sEMG  signal  is  preprocessed  using  a  Half-Gaussian  filter  and 
fed  to  a  fusion-based  Multiple  Input  Single  Output  (MISO) 
skeletal  muscle  force  model.  This  MISO  system  model 
provides  the  estimated  finger  forces  to  be  produced  as  input 
to  the  prosthetic  hand.  Optimal  tracking  method  has  been 
applied  to  track  the  estimated  force  profile  of  the  Fusion 
based  sEMG-force  model.  The  simulation  results  show  good 
agreement  between  reference  force  profile  and  the  actual 
force. 

I.  Introduction 

Currently  there  are  more  than  2  million  Americans  that 
have  a  missing  limb.  The  number  of  Americans  with 
missing  limbs  increases  185,000  people  a  year  [1].  As  a 
result  of  this  rising  number  of  people  that  need  prostheses, 
research  is  being  focused  on  creating  more  intuitive 
prosthetics.  There  has  been  active  research  to  design  a 
prosthetic  hand.  But  even  today  there  is  no  prosthetic  hand 
at  an  affordable  cost  with  position  and  tactile  force  control 
[2].  It  is  evident  from  the  past  research  that  the  human- 
centered  robotics  should  be  autonomous  with  a  high  level 
of  functionality,  comfort  and  ease  of  use  [3].  A  natural 
means  of  communication  is  required  for  human-centered 
robotics  [4],  and  in  the  case  of  electromyographic  (EMG) 
based  prostheses,  one  natural  means  of  interface  between 
the  human  arm  and  prosthesis  is  the  surface  EMG  (sEMG) 
itself.  The  EMG  signal  is  present  because  of  the 
neuromuscular  activity  in  the  body.  The  sEMG  signals  are 
captured  noninvasively  and  give  access  to  physiological 
processes  responsible  for  the  contraction  of  muscles.  Since 
the  sEMG  signal  is  amplitude  modulated  and  time 
dependent,  and  dynamic  in  nature,  spatially  and 
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temporally  frequency  encoded  [5].  Usually  sEMG 
measurements  are  based  on  single  sensor  data.  Eor  this 
work  we  used  an  array  of  three  sEMG  sensors  and  a  force 
sensing  resistor  (ESR)  to  acquire  the  EMG  signal  and  the 
corresponding  skeletal  muscle  force.  The  data  from  the 
three  sEMG  sensors  is  fused  using  a  fusion  algorithm  to 
have  a  better  estimation  of  skeletal  muscle  force  from  the 
corresponding  sEMG  signal  when  compared  to  single 
sensor  data  [6]. 

This  paper  uses  the  sEMG-force  fusion  model  as 
reference  profile.  A  Linear  Quadratic  Tracking  (LQT) 
technique  is  employed  to  the  prosthetic  hand  to  track  the 
force  profile.  This  paper  is  structured  as  follows.  The 
experimental  set  up  is  given  in  Section  II,  Section  III 
provides  reference  force  model  and  Section  V  provides 
dynamics  of  the  hand.  Section  VI  details  the  results  and 
discussion  and  in  the  last  section  some  conclusions  are 
provided. 

II.  Experimental  Set-Up 

Experiments  were  conducted  on  a  right-handed  healthy 
male  subject.  Using  a  muscle  simulator  (Rich-Mar 
Corporation  HV  1100),  motor  units  were  marked  and 
sEMG  sensors  were  placed  accordingly  [6].  One  sEMG 
sensor  was  placed  on  the  motor  point  of  the  subject’s  ring 
finger  and  two  sensors  were  placed  at  points  adjacent  to  it. 
Prior  to  placing  the  sEMG  sensors,  the  skin  surface  of  the 
subject  was  prepared  according  to  International  Society  of 
Electrophysiology  and  Kinesiology  (ISEK)  protocols  [7]. 
Both  sEMG  and  muscle  force  signals  were  acquired 
simultaneously  using  Lab  VIEW™  8.2  at  a  sampling  rate 
of  2000  Hz.  The  sEMG  data  was  captured  by  a 
DELSYS®  Bagnoli-16  EMG  system  with  DE-2.1 
differential  EMG  sensors.  The  force  information  was 
collected  by  a  NI  ELVIS  with  an  Interlink  Electronics  ESR 
0.5”  circular  force  sensor. 

III.  Reeerence  Eorce  Model 

In  this  present  work  the  force  signal  is  extracted  from 
the  sEMG  signals  obtained  from  the  array  of  the  three 
sEMG  sensors  located  on  the  arm.  The  data  from  the  three 
sensors  is  collected  around  the  corresponding  individual 
motor  unit  location  at  the  transradial  arm  location  (flexor 
digitorum  superficialis)  and  is  rectified  and  filtered  using  a 
Half-Gaussian  filter  given  by 

(  EMG  2 
exp  — ^ 

p(EMG\x)  =  2x  ,  (1) 

y/2nx^ 


where  p(EMG\x)  is  a  conditional  probability  density 
function,  x  is  a  latent  driving  signal. 

The  preprocessed  sEMG  data  from  the  three  sensors  is 
fused  using  a  sensor  fusion  algorithm  to  facilitate  the 
extraction  of  the  best  finger  force  estimates.  Sensor  fusion 
is  accomplished  in  the  frequency  domain  using  a  simple 
elitism  based  Genetic  Algorithm  (GA).  The  SI  method  is 
used  to  identify  the  dynamical  relationship  between  the 
sEMG  data  from  the  three  sensors  and  the  corresponding 
finger  force.  In  this  fusion  algorithm,  Output  Error  (OE) 
models  are  used  to  achieve  the  SI.  The  OE  models  are 
constructed  for  each  individual  data  set.  The  OE  model 
structure  is  given  as  follows. 


where  Z'5  and  P's  are  the  zeros  and  poles  respectively  of 
the  individual  transfer  function  and  n  is  the  order  of  the 
system. 

Eeeding  the  new  data  sets  to  the  MISO  transfer  function 
(//(s))  (See  Appendix)  results  in  an  estimated  fusion 
based  force  Y. 

IV.  DYNAMICS  OE  PROSTHETIC  HAND 

The  dynamic  equations  of  motion  for  the  hand  are 
obtained  from  the  Lagrangian  approach  as  [8,9,10,11,12, 
13] 


y(t)  =  +  e(t)-  (2) 

Where  B,  and  Fare  the  polynomials,  q  is  shift  operator, 
e(t)  is  output  error,  y(t)  is  system  output,  u  is  input,  nk  is 
the  system  delay  and  t  is  time  index. 

Using  the  three  resulting  OE  models  and  the  fusion 
algorithm  given  by  [6],  a  corresponding  continuous -time 
model  is  constructed  as  given  by  the  transfer  function  as 


Where  q  and  q  represent  the  angular  velocity  and  angle 
vectors  of  joints  respectively;  L  is  the  Lagrangian;  r  is  the 
given  torque  vector  at  joints.  The  Lagrangian  L  is  given  as 

L  =  T  -V,  (6) 

Where  T  and  V  are  denoted  as  kinetic  and  potential 
energies  respectively.  Substituting  (6)  into  (5),  we  get  the 
following  dynamic  equations 


^  ^  F(s) 


(3) 


Similar  to  the  discrete-time  case ,  nb  and  nf  determine 
the  orders  of  the  numerator  and  denominator.  Eor  multi¬ 
input  systems,  nb  and  nf  row  vectors.  b,f3.YQ  the 
coefficients  of  the  numerator  and  denominator 
polynomials  respectively. 


A  MISO  transfer  function  is  constructed  based  on  the 
poles  of  three  individual  OE  models  corresponding  to  each 
sensor.  GA  is  used  to  find  the  corresponding  zeros.  The 
search  area  is  limited  to  the  unit  circle,  because  a  discrete 
time  model  is  used  (and  the  resulting  MISO  model  is 
decreased  to  minimum  phase).  The  number  of  zeros  is  at 
most  the  number  of  poles.  The  number  of  potential  zeros  is 
set  to  the  order  of  the  corresponding  denominator.  The 
error  squared  of  the  resulting  MISO  system  H(s)  (see 
Appendix)  and  the  recorded  force  signal  is  set  as  an 
objective  function.  The  objective  function  /  is  constructed 
as  follows. 


M(q)q  -h  C{q,q)  +  G{q)  =  r,  (7) 

Where  M{q)  describes  the  inertia  matrix;  G(q,q)  is  the 
coriolis/centripetal  vector  and  G(q)  is  the  gravity  vector. 
(7)  can  be  written  as 

M(q)q  +  N(q,q)  =  T  ,  (8) 

where  N(q,q)  =  C(q,q)  +  G(q)  represents  nonlinear 
terms. 

Eeedback  linearization  technique  is  used  to  convert  the 
nonlinear  dynamics  represented  by  (8)  into  a  linear  state- 
variable  system  [8].  In  order  to  obtain  the  alternative  state- 
space  equations  of  the  dynamics,  the  position/velocity 
state  x(t)  of  the  joint  is  defined  as 

xit)  =  [q  (t)  ij' (t)]'  ,  (9) 

and  rewriting  (8)  as 


/  =  (Y(t)  -  Y{tfdt  =  (p^(t)dt,  (3)  ^q(t)  =  -M  i(q(t))[N(q(t),q(t))  -  T(t)]  (10) 


where  to  and  ty.  are  the  initial  and  final  time  values,  ?(t)  Therefore,  from  (9)  and  (10),  a  linear  system  in 
is  the  fusion  model  estimated  force  and  T(t)  is  the  actual  Brunovsky  canonical  form  is  obtained  and  represented  as 
force  from  the  ESR. 

^  [n  nl  [il 

The  MISO  system  7/(5)  is  constructed  as  follows,  lu  uj  lij 


The  control  input  vector  zr(t)  given  by 

(4)  u(t)  = -M-^(q(t))[N(q(t),q(t)) (12) 

As  the  prosthetic  hand  is  required  to  track  the  desired 
force  profile  q^i(t)  described  under  the  reference  force 
model,  the  tracking  error  e(t)  is  defined  as 


e(0  = 


(13) 

Here,  qd(t)  is  the  desired  angle  vector  of  the  joints  and 
can  be  obtained  by  the  reference  force  model  [6] ;  q  (t)  is 
the  actual  angle  vector  of  the  joints.  Differentiating  (13) 
twice,  we  get, 

e(0  =  Qdit)  -  q(t)  ,  e{t)  =  qa(t)  -  q(t).  (14) 

Substituting  (10)  into  (14)  gives 

e(0  =  qd(t)  +  M-'^(q(t))[N{q(t),q(t))  -  T(t)]  (15) 

From  (15)  the  control  function  zr(t)can  be  defined  as 

u(t)=  qd(t)+  M-'^(q(t))[N(q(t),q(t))-T(t)].  (16) 

This  is  often  called  the  feedback  linearization  control 
law,  rewriting  (16)  as, 

r(t)  =  M(q(t))[qd(t)  -  u(t)  +  N{q(t),q(t))].  (17) 

Using  (14)  and  (16),  the  state  vector  x(t)  = 
[e  (t)e  (t)]  ,  the  state-space  model  can  be  represented  as 

^  [q  q]  '''  [l] 

Now,  (18)  is  in  the  form  of  a  linear  system  such  as 
i(t)  =  Ax(t)  +  Bu(t)  .  (19) 


Fig.  1.  Block  Diagram  of  Optimal  Controller  for 
Prosthetic  Hand. 


OPTIMAL  TRACKING 

Figure  1  shows  the  block  diagram  representation  of  the 
finite-time  linear  quadratic  optimal  controller  for  the 
prosthetic  hand.  The  objective  of  the  controller  is  for  the 
prosthetic  hand  finger  to  track  optimally  the  force  model. 

For  the  linear  system  (19),  the  finite-time  linear 
quadratic  optimal  control  problem  can  be  formulated  by 
defining  the  performance  index  ]  [14]  as 

]  =  +  u\t)R(t)u{t)]  dt  (20) 

where  Q{t)  is  the  error  weighted  matrix;  and  R{t)  is 
the  control  weighted  matrix.  The  optimal  control  u*(t)  is 


described  by 

u*{t)  =  -R-^{t)B  P{t)x\t)  =  -K{t)x\t).  (21) 

where  K{t)  =  —R~^{t)B  P{t)  is  called  Kalman  gain 
andP(t),  is  the  solution  of  the  matrix  differential  Riccati 
equation  (DRE) 

P{t)  = 

-P{t)A  -  AP{t)  -  Q{t)  +  Pit)BR-^(it)B'Pit)  (22) 

Satisfying  the  final  condition 

p(t  =  tf)  =  0.  (23) 

Hence  the  optimal  state  x*  is  the  solution  of 

i*(t)  =  [A-  BR-^(t)B'P(t)]x*(it).  (24) 

Therefore,  with  the  optimal  control  the  required 

torque  T*(t)  can  be  calculated  by 

t’(0  =  M{q(t)){qa(t)  -  +  N(q(t),q(t)).  (25) 

The  torque  T*(t)  is  converted  into  force  by 

fo(0  =T‘(t)/L,  (26) 

Where  (t)is  the  force  and  L  is  the  length  of  the  finger. 

VI.  RESULTS  AND  DISCUSSION 

Figure  2  shows  the  fusion  model  force  Y(t)  and  the 
force  output  from  the  controller  (t) .  It  is  evident  that  the 
optimal  controller  can  track  the  changes  in  the  force 
profile  and  follow  the  trends  in  reference  force  profile. 


Fig.  2.  Fusion  Reference  Model  Force  and  Actual  Force 


Figure  3  shows  the  error  between  the  model  force  Y  (t) 
and  the  force  output  from  the  controller  F^Cf)  two 
different  sets  of  results  shown  in  Figs.  2  and  4.  This  figure 
shows  that  the  error  converged  to  zero  in  a  very  short  time 
and  the  error  is  hovering  between  zero  throughout  the  time 
interval.  In  some  instances  the  force  output  of  the 
controller  F^  (t)  cannot  track  the  rapidly  changing 
reference  force  profile  during  short  intervals.  The  Pearson 
correlation  coefficient  (see  Appendix)  for  the  reference 


Y(t)  and  controller  output  force  F^^t)  profile  is  0.8714. 
Figure  4  shows  the  validation  with  a  different  reference 
force  f(t)  profile  and  it  yields  0.8707  correlation,  thus 
showing  good  agreement  between  the  reference  model 
force  and  the  actual  force. 


Fig.  3.  Error  Between  the  Model  Force  and  the  Actual 
Force 


VII.  Conclusion  and  future  work 

A  fusion-based  sEMG-force  model  was  utilized  to 
estimate  the  force  profile  that  a  prosthetic  hand  should 
track.  This  fusion  enables  to  get  better  force  estimates  than 
the  single  sensor  data.  The  dynamics  of  the  hand  was 
obtained  and  the  controller  for  optimal  tracking  between 
the  reference  model  and  the  hand  was  designed.  The 
proposed  design  gives  good  performance  when  tested  on  a 
prosthetic  hand,  based  on  tracking  a  reference  force 
profile.  In  future,  we  plan  to  implement  this  proposed 
control  strategy  on  a  micro  controller  for  real  time  control. 
It  would  be  interesting  to  implement  both  the  force  and 
position  control  using  this  control  strategy.  Finally,  we 
plan  to  use  the  hand  prototype  with  five  fingers. 

Appendix 

The  resulting  MISO  transfer  function  H(s)  is  constructed 
as. 

From  Ui  to  output, 

-  3.843s^  +  7.729s^  -  10.78s^  +  10.6s^  -  7.417s^  +  3.6035^  -  0.9795s  +  0.1192 
s^  -  4.028s7  +  6.325s6  -  4.1215^  -  1.5455^  +  5.875^  -  5.4335^  +  2.28s  -  0.3496 

From  U2  to  output, 

s^-  4.339s^ +  9.005s^  -  12.42s^  +  12.22s^  -  8.117s^  +  3.427s2  -  0.9134  s  +  0.1424 
s^-  4.028  s^  +  6.325  s^-  4.121  s^-  1.545  s^  +  5.87  s^-  5.433  s^  +  2.28  s  -  0.3496 

From  to  output. 


Pearson  correlation  coefficient  is  given  by, 

Y)  _  F[(X  -  -  Mr)] 

Px,Y  —  corri^A,  Y )  —  — 

axCTy  OxGy 

Where  X,Y  are  Random  Variables,  pLx  and  are 
expected  values,  ay  are  standard  deviations 
respectively.  E  is  expected  value  operator. 
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Abstract:  -  This  paper  presents  a  novel  approach  of  a  surface  electromyographic  (sEMG)-based,  real-time 
Model  Reference  Adaptive  Control  (MRAC)  strategy  for  joint  angle  estimation  and  control  of  a  prosthetic  hand 
prototype.  The  proposed  design  is  capable  of  decoding  the  pre-recorded  sEMG  signal  as  well  as  the  sensory 
force  feedback  from  the  sensors  to  control  the  joint  angle  of  the  prosthetic  hand  prototype  using  a  PIC 
32MX360F512L  microcontroller.  The  input  sEMG  signal  is  rectified,  filtered  using  a  Half-Gaussian  filter  and 
fed  to  a  Kullback  Information  Criterion  (KIC)  based  fusion  algorithm,  which  give  the  overall  estimated  joint 
angle  (position).  This  estimated  angle  is  given  as  input  to  the  prosthetic  hand  prototype.  Then  the  MRAC  along 
with  a  two  stage  proposed  embedded  design  is  used  for  the  position  control  of  the  prosthetic  hand.  For  the  real¬ 
time  operation,  the  measured  angle  data  at  the  joint  is  fed  back  to  the  controller.  The  data  is  transmitted  to  the 
computer  through  a  universal  asynchronous  receiver/transmitter  (UART)  interface  of  the  proposed  embedded 
design.  The  experimental  results  in  real  time  show  good  performance  in  controlling  the  angle  of  the  prosthetic 
hand  prototype. 


Key -Words:  -  Prosthetic  Hand,  sEMG,  Data  fusion,  Kullback  Information  Criterion,  MRAC,  Angle  control 


1  Introduction 

For  60  years,  there  has  been  active  research  going 
on  in  the  area  of  Prostheses.  Due  to  the 
unavailability  of  prosthetic  devices  with  full  human 
hand  functionality  at  an  affordable  price,  more  than 
30%  of  upper  extremity  amputees  chose  not  to  use 
a  prosthetic  device  on  regular  basis  [1,  2].  Besides 
that,  most  of  the  available  prosthetic  devices  do  not 
have  tactile  or  proprioceptive  feedback  [3].  Previous 
researchers  insisted  that  human-centered  robots 
must  be  independent  with  a  great  functionality, 
comfort  and  ease  of  use  [4].  In  rehabilitation 
robotics,  human-machine  interface,  which  requires  a 
natural  means  of  communication,  is  an  interesting 
domain  [5].  The  electromyographic  (EMG)  signal  is 
the  electric  potential  generated  by  muscles.  There 
are  two  kinds  of  EMG  signals:  Intramuscular 
(needle)  EMG  and  the  Surface  EMG  (sEMG). 
Under  the  assumption  that  amputation  is  transradial 
and  which  does  not  require  surgery,  we  relied  on 
sEMG  signals  in  this  work  whose  amplitude  ranges 
from  -5  to  -i-5  (mV).  sEMG  signals  are  acquired 
from  the  surface  of  the  skin,  as  they  penetrate 
through  various  tissue  layers  [6].  Thus,  they  tend  to 
create  cross-talk,  interference  and  noise.  The  sEMG 
is  a  temporally  and  spatially  composed  signal  [7]. 


Due  to  the  complexity  and  nonlinearity  of  the 
human  hand,  the  control  of  a  multi-fingered 
prosthetic  hand  is  a  challenging  task  [8].  From  the 
past  research,  it  is  clear  that  the  most  widespread 
approach  for  controlling  the  prosthetic  hand  is  by 
using  a  position  or  force  control  [9].  The 
challenging  task  involved  in  this  work  is  the 
prediction  of  the  Proximal  Inter  Phalangeal  (PIP) 
joint  angle  corresponding  to  the  sEMG  signal. 

In  this  paper,  we  used  a  three-by-three  array  of 
sEMG  sensors  and  a  wheel  potentiometer  device  to 
acquire  the  EMG  signal  and  the  corresponding  PIP 
joint  angle.  The  data  from  the  array  of  sEMG 
sensors  were  fused  using  a  probability  based  fusion 
algorithm  in  order  to  have  a  better  estimate  [10].  A 
real-time  embedded  MRAC  control  system  with 
sensory  feedback  was  implemented  to  accomplish 
the  goal  of  this  design.  Considering  the  probability 
based  fused  joint  angle  estimate  as  input  to  the  real¬ 
time  control  system,  a  two  stage  embedded  platform 
with  a  simple  MRAC  strategy  was  chosen  for  the 
PIP  joint  angle  control  of  the  prosthetic  hand 
prototype. 
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Fig.l:  Experimental  set-up. 


Fig.l.  illustrates  the  experimental  design  used  in  this 
work  for  capturing  the  sEMG  signal  and  the 
corresponding  joint  angle  of  the  PIP  joint  of  the 
index  finger.  Prior  to  placing  the  sEMG  sensors  on 
the  skin  surface,  the  test  subject  was  prepared 
according  to  ISEK  standards  [11].  The  motor  point 
was  identified  by  using  a  wet  probe  muscle  point 
stimulator  (Richmar  HV-1000).  Nine  DE-3.1  sEMG 
sensors  of  the  DELSYS  Bagnoli-16  EMG  system 
were  arranged  on  the  skin  surface  in  a  three -by-three 
array.  The  middle  row  of  sensors  was  placed  on  the 
motor  point  of  the  index  finger.  An  angle 
measurement  device  was  designed  using  a  10k- 
Ohm  wheel  potentiometer  shown  in  Fig.l.  It  was 
used  to  measure  the  PIP  joint  angle.  Force  Sensitive 
Resistor  (FSR)  was  mounted  on  the  stress  ball  and 
was  used  to  measure  the  force.  All  the  data  was 
acquired  at  a  sampling  rate  of  2000  samples/sec. 

3  Proposed  Design 

The  objective  of  the  proposed  design  is  to  track  a 
joint  angle  of  the  prosthetic  hand  as  closely  as 
possible.  Here,  the  joint  angle  signal  is  inferred  from 
the  sEMG  signals  obtained  from  the  array  of  the 
sEMG  sensors  located  at  the  arm. 

Sensor  fusion  is  done  in  the  time  domain  for  the 
sEMG  data  using  a  probability  based  Kullback 
information  criterion  (KIC)  fusion  algorithm.  The 
data  from  the  nine  sensors  were  collected  around  the 
corresponding  individual  motor  unit  at  the 
transradial  arm  location  (flexor  digitorum 
superficial! s)  and  before  fusing  the  sEMG  signals 
are  rectified  and  filtered  using  a  Half  -Gaussian 
filter,  as  given  by  (1). 

f  EMG^\ 
exp - ^-2- 

p(EMC\x)  =  2  X  (1) 


where  p(EMG\x)  is  a  conditional  probability 
density  function,  x  is  a  latent  driving  signal. 

A  System  Identification  (SI)  tool  was  used  to 
determine  the  dynamic  relationship  between  the 
input-output  data.  The  sEMG  signal  was  used  as 
input  and  the  corresponding  PIP  joint  angle  as 
output.  In  particular,  nonlinear  Wiener  Hammerstein 
one-dimensional  polynomial  models  were  obtained 
for  the  sEMG/joint  angle  data. 


The  mathematical  representation 
modeling  is  given  by, 

of  the 

w(t)  =  /(u(t)) 

(2) 

x(t)  =  w{t  nk)  +  e(t) 

(3) 

y(t)  =  h(x(t)) 

(4) 

where  u(t)  is  the  sEMG  signal  and  y(t)  is  the  PIP 
joint  angle.  /  and  h  are  nonlinear  functions,  w(t) 
and  x(t)  are  internal  variables,  Bj  i(q)  and  Fj  i(q) 
are  polynomials,  q  is  the  back  shift  operator,  and 
e(t)  is  the  output  error.  From  (3),  the  WH  model 
structure  utilizes  a  linear  OE  model,  which  is  given 

by, 

where  nk  is  the  system  delay  and  t  is  time  index 

The  resulting  nine  WH  models  were  fused  together 
by  using  a  probabilistic  KIC  algorithm  [12].  It 
assigns  a  particular  probability  to  each  model  [13]. 
The  overall  estimated  model  output  and  the 
individual  models  outputs  were  compared  by  using 
the  Pearson’s  correlation  coefficient. 

From  the  previous  research,  it  was  shown  that  the 
KIC  algorithm  performs  better  than  the  other  criteria 
[10,  12].  KIC  is  an  asymmetric  measure  of  the 
models’  dissimilarity  which  can  be  obtained  by  the 
sum  of  the  two  directed  divergences  known  as  J- 
divergence  or  Kullback’ s  symmetric  [14].  It  is  given 
by 

KIC(pd  =  ^logRi  +  ^^^-nxp{^)  +  gin)  (6) 
Where  g(n)^nHog(n/2),  ^  -  digamma  function. 

The  probability  based  fusion  algorithm  given  by 
[12,  13]  is  applied  to  the  nonlinear  models  obtained 
by  using  an  SI  technique  with  the  following  steps: 
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1:  The  WH  models  are  obtained  by  considering  the 
sEMG  data  u(t)  as  input  and  joint  angle  Y  as 
output, 

2;  Calculate  the  residual  square  norm  i.e., 
R  =Y-c^.a  =||f-f|| 

where  ={0/  O,  }  ‘  ,and 


3:  Compute  the  model  criteria  coefficients  using  (6). 

4:  The  model  probability  can  be  computed  using 
p(M,{t)\Z)  =  ^- 

7=1 

5:  The  fused  model  output  can  be  calculated  using 

Yf  =  YpiMiiOlZWi. 


Fig. 2:  Block  diagram  representation  of  Model 
Reference  Adaptive  Controller  (MRAC) 


A  simple  MRAC  based  scheme  (Fig.  2)  is  utilized 
for  compensating  the  dynamics  of  the  prosthetic 
hand.  During  the  development  of  the  artificial  hand, 
changes  were  being  undertaken  to  the  mechanical 
design  and  drive  trains  of  the  hand  that  affect  the 
dynamics  of  the  finger  motion  of  the  prosthesis.  In 
addition,  the  uncertain  characteristics  of  the 
kinematic  and  actuator  interaction  could  have  led  to 
a  different  performance  than  expected.  Therefore,  a 
simple  MRAC  controller  was  developed  in  order  to 
maintain  some  performance  stability.  For  updating 
the  controller  parameter  0,  the  MIT  rule  was  used. 

f  .  (7) 

According  to  the  MIT  rule  [15],  the  gain 
parameter  y  was  selected  to  achieve  the  desired 
performance.  In  this  work  y  was  taken  as  3.0  and 


the  error  e  =  Y  —  Y-^  was  calculated  by  the 
difference  of  the  model  reference  output  F^  and  the 
actual  output  (joint  angle  generated  by  the  prosthetic 
hand).  Different  MRAC  stability  issues  were 
addressed  in  [14,  15]. 

Reference  Model  Derivation 

The  dynamic  equations  of  motion  for  the  hand  are 
obtained  from  the  Fagrangian  approach  as  [16] 

x(t)  =  [q  J]  x(t)  +  [ j]  u(t).  (8) 

The  control  input  vector  u{f)  was  given  by 

u(t)  =  -  T(t)].  (9) 

As  the  prosthetic  hand  is  required  to  track  the 
desired  angle  profile  described  under  the 

reference  angle  model,  the  tracking  error  e(t)  is 
defined  as 

e(t)  =  c?d(t)  -  qit).  (10) 

Here,  is  the  desired  angle  vector  of  the 

joints  and  can  be  obtained  by  the  reference  angle 
model  [17];  q(t)  is  the  actual  angle  vector  of  the 
joints.  Differentiating  (10)  twice,  we  get, 

e(t)  =  qa(t)  -  q(t)  ,  e(t)  =  qa(t)  -  q(t).  (11) 

Substituting  q(t)into  (11)  gives 

e(t)  =  qaCO  +  M-^(q(t))lN(q(t),q(t))  -  t(12) 

From  (12)  the  control  function  u(t) can  be  defined 
as 

U(t)  =  qa(t)  +  M-^(q(t))[N(q(t),  q(t))  - 
T(t)].  (13) 

This  is  often  called  the  feedback  linearization 
control  law,  rewriting  (13)  as, 

T(t)  = 

M(q(t))[qa(t)  -  u(t)  +  N(q(t),q(t))]  (14) 

Using  (11)  and  (13),  the  state  vector  %(t)  = 
the  state-space  model  can  be 

represented  as 
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^  [o  ol  111 

Now,  (15)  is  in  the  form  of  a  linear  system  such 
as 

x(t)  =  Ax(t)  +  Bu(t)  .  (16) 

Implementation: 

The  proposed  control  design  was  implemented  on 
a  PIC  32MX360F512L  microcontroller  in  two 
stages:  “Signal  Processing”  and  “Motor  Actuation”. 
The  Signal  Processing  stage  enables  the  execution 
and  implementation  of  real-time  control  strategies. 
A  dsPIC  block  set  was  used  to  generate  the  C  code 
for  the  PIC  32  from  Simulink®.  The  dsPIC  block  set 
generates  a  .hex  file,  and  this  file  was  imported  in 
MPLAB®  to  program  the  PIC  32. 

Signal  Processing  Stage: 

From  the  many  modules  available  on  PIC  32,  the 
following  four  modules  were  utilized  for  the 
implementation  of  the  signal  processing  stage: 
Analog  Input  Module,  Digital  Output  module. 
Output  Compare  module,  and  URAT  module. 

The  sensory  feedback  joint  angle  data  from  the 
wheel  potentiometer  was  acquired  through  the 
Analog  Input  module.  Based  on  the  selected  control 
strategy  for  the  motor  actuation  stage,  the  digital 
control  signals  were  generated  by  the  Digital  Output 
module  of  the  PIC  32.  The  changes  in  the 
reference/command  signal  were  detected  by  this 
module.  A  pulse  width  modulated  (PWM)  wave 
with  a  specific  duty  cycle  was  generated  by  the 
Output  Compare  module  based  on  the  error.  The 
angle  data  from  the  microcontroller  to  the  PC  was 
transmitted  by  the  UART  module  via  serial 
communication.  In  this  particular  design,  the  data 
was  fed  to  the  computer  by  a  virtual  com  port  via 
USB  cable.  The  signals  from  the  ports  were  read  by 
MATLAB®. 

Motor  Actuation  Stage: 

In  this  stage,  the  motor  was  actuated  with  a 
SN754410  quadruple  half-H  driver  [18]  with  the 
corresponding  control  signal.  This  proposed  design 
was  tested  on  the  index  finger  of  a  prosthetic  hand 
prototype.  Fig.  3  shows  the  test  bed  for  the  proposed 
design. 


Fig.  3.  Embedded  Test  bed  for  the  proposed  design 
Mechanical  structure  of  the  robotic  hand  prototype: 

The  prosthetic  hand  prototype  finger  has  three 
degrees  of  freedom  stimulated  by  two  Pololu  35:1 
mini  metal  gear  motors.  Biologically  inspired 
parallel  actuation  is  the  main  characteristic  of  this 
robotic  hand  prototype.  It  is  based  on  the 
behaviour/strength  space  of  the  Flexor  Digitorum 
Profundus  (FDP)  and  the  Flexor  Digitorum 
Superficialis  (FDS)  muscles  [19].  Using  a  belt 
transmission  system,  the  DC  motor  in  the 
metacarpal  phalange  of  the  finger  triggers  the 
Proximal  Inter  Phalangeal  (PIP)  joint.  It  also  drives 
the  DIP  (Distal  Inter  Phalangeal)  joint.  The  Meta 
Carpo  Phalangeal  (MCP)  joint  is  actuated  by  the  DC 
motor  located  at  the  base  of  the  finger  as  shown  in 
Fig.  4. 


Fig.  4.  Finger  Actuation  Scheme 


4  Results  and  Discussion 

Data  was  acquired  from  the  microcontroller  through 
UART  channel2  of  the  PIC  32  micro  controller  by  a 
virtual  com  port  via  USB  at  a  57600  baud  rate.  The 
data  from  the  microcontroller  was  converted  into 
unit  16  data  type  before  it  is  transmitted  through  the 
UART.  It  ran  at  an  external  clock  frequency  of 
8MHz  with  internal  scaling  enabled.  Fig.  5  depicts 
the  experimental  results  of  the  proposed  design.  The 
actual  angle  output  from  the  position  sensor  (i.e.T) 


ISBN:  978-1-61804-115-9 


127 


Advances  in  Systems  Theory,  Signal  Processing  and  Computational  Science 


closely  follows  the  fusion  algorithm  estimated  angle 
Y.  Fig.  6  shows  the  fusion  estimated  angle 
profile  Y  and  actual  angle  from  the  position  sensor 
(F)  plotted  for  a  separate  experiment.  Fig.  7  shows 
the  repeated  experimental  results.  The  proposed 
control  strategy  was  tracking  angle  profile  and 
matching  the  actual  angle  profile  with  the  model 
estimated  angle  ( Y). 


not  yet  been  implemented  because  of  the  slow 
response  of  the  SMA’s,  and  also  because  SMA’s 
have  a  long  relaxation  time.  Therefore  it  is  difficult 
to  track  a  randomly  changing  angle  profile  with  a 
slowly  responding  actuation  system.  However,  as 
the  prosthetic  hand  prototype  is  designed  to  use  the 
parallel  actuation  of  these  DC  motors  and  SMA’s, 
the  DC  motors  alone  cannot  produce  a  fusion 
algorithm  estimated  angle  profile. 


Fusion  Algorithm  Estimated  Position  Profile 
M  Actual  Position  from  the  Position  Sensor 
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Fig.  5.  Fusion  based  angle  estimate  and  actual  angle 
from  angle  sensor  during  the  grasp  action. 


Fig.  6.  Fusion  based  angle  estimate  and  actual  angle 
from  angle  sensor  during  the  grasp  action  (for 
experiment-2). 


Fig.  7.  Fusion  based  angle  estimate  and  actual  angle 
from  angle  sensor  during  the  grasp  action  (for 
experiment-3). 


Fig.  8.  Validation  Plot. 


While  conducting  the  experiments,  the  following 
observations  were  made.  The  DC  motors  currently 
employed  have  the  primary  task  of  moving  the 
prosthetic  fingers.  As  the  project  is  on-going  ,  the 
Shape  Memory  Alloy  (SMA)  actuation  scheme  has 


In  this  work,  the  DC  motors  are  solely  responsible 
for  motion  actuation.  Since  the  DC  motors  have 
small  gear  heads,  the  usual  characteristic  of  gear 
driver  actuation  cores  occurs:  gear  backlash.  In 
addition,  the  DC  motors  employed  were  slow  in 
responding  to  the  changes  in  the  force  profile. 
Hence  some  gaps  and  delay  were  observed  in  the 
measured  angle  signal.  However,  the  profile  of  the 
measured  angle  from  the  angle  sensor  has  a  similar 
pattern  as  the  fusion  algorithm  estimated  angle  (  Y). 
Thus  we  can  conclude  that  apart  from  those 
mechanical  transmission  problems,  the  implemented 
control  scheme  produced  promising  results.  These 
problems  will  be  considered  in  a  new  prototype 
design  that  we  are  currently  developing. 

From  the  results,  it  is  also  evident  from  Figs.  5,  6 
and  7  that  the  controller  is  tracking  the  slow  changes 
in  the  angle  profile  very  well,  where  as  a  small 
delay  was  observed  while  tracking  the  angle  profile. 
In  order  to  test  the  precision  of  the  proposed  control 
strategy,  15  different  experiments  were  conducted. 
The  mean  of  the  Pearson's  correlation  coefficient  for 
the  fusion  algorithm  estimated  angle  ( Y)  and  the 
actual  angle  from  the  angle  sensor  (F)  in  all  the  15 
experiments  is  0.86.  Because  of  the  above 
mentioned  transmission  problems  and  the  slow 
response  of  the  gears,  slight  variability  is  observed 
in  the  correlation  coefficients  for  the  15 
experiments.  Hence  the  difference  in  tracking  the 
angle  profile  is  observed  in  Figs.  6  and  7.  Fig.  8 
depicts  the  validation  plot  with  a  different  fusion 
algorithm  angle  estimate  F  obtained  by  feeding  a 
different  sEMG. 

5.  Conclusion  and  Future  Work 

In  this  paper,  based  on  sEMG  signals,  we 
proposed  a  two-stage  real-time  embedded 
MRAC  strategy  for  a  prosthetic  hand  prototype. 
The  proposed  design  was  based  on  tracking  a 
reference  angle  profile  and  it  gives  good 
performance  when  tested  on  a  prosthetic  hand 
prototype.  This  design  enables  the  transmission 
of  the  data  from  the  microcontroller  to  the 
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computer.  This  design  allows  the  control 
engineer  to  increase  the  accuracy  and 
performance  of  the  design  by  implementing 
various  novel  control  strategies  and  also  enables 
fast  trouble  shooting. 

For  future  work,  we  are  planning  to  use  the 
above  mentioned  embedded  platform  to 
implement  online  model-based  skeletal  muscle 
angle  estimation  along  with  controller  designs 
that  address  the  above  listed  mechanical 
shortcomings.  It  will  be  valuable  to  acquire  the 
sEMG  signal  directly  from  the  arm  of  a  healthy 
subject  and  transmit  to  our  embedded  system 
rather  than  using  pre-recorded  sEMG  signals, 
which  will  be  investigated  as  well  in  the  future. 
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Abstract  In  this  paper  we  present  a  novel  method  of  designing  multi-fingered 
robotic  hands  using  tasks  composed  of  both  finite  and  infinitesimal  motion.  The 
method  is  based  on  representing  the  robotic  hands  as  a  kinematic  chain  with  a  tree 
topology.  We  represent  finite  motion  using  Clifford  algebra  and  infinitesimal  motion 
using  Lie  algebra  to  perform  finite  dimensional  kinematic  synthesis  of  the  multi¬ 
fingered  mechanism.  This  allows  tasks  to  be  defined  not  only  by  displacements,  but 
also  by  the  velocity  and  acceleration  at  different  positions  for  the  design  of  robotic 
hands.  The  additional  information  enables  an  increased  local  approximation  of  the 
task  at  critical  positions,  as  well  as  contact  and  curvature  specifications.  An  example 
task  is  provided  using  an  experimental  motion  capture  system  and  we  present  the 
design  of  a  robotic  hand  for  the  task  using  a  hybrid  Genetic  Algorithm/Levenberg- 
Marquadt  solver. 

Key  words:  kinematic  synthesis,  multi-fingered  grippers,  Clifford  and  Lie  algebra. 


1  Introduction 

The  design  of  end-effector  robotic  tools  has  traditionally  taken  place  in  an  application- 
oriented  fashion  within  the  framework  of  the  mechanical  design  theory  [7].  Among 
the  rich  variety  of  robotic  end-effectors,  those  generally  defined  as  robotic  hands  are 
considered  suited  not  only  for  grasping,  but  also  for  dexterous  manipulation.  We  can 
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define  a  multi-fingered  robotic  hand  as  an  end-effector  in  which  the  base,  or  palm, 
spans  several  serial  chains  in  a  tree-like  structure. 

There  are  a  great  variety  of  designs  for  robotic  hands.  Some  designs  mimic  the 
human  hand  and  exhibit  a  high  number  of  degrees  of  freedom,  [1]  and  [15];  others 
are  designed  for  specific  applications  [4]  and  may  or  not  be  anthropomorphic  [5]. 

Most  of  the  designs  have  been  oriented  either  towards  maximum  anthropomor¬ 
phism  or  towards  optimizing  grasping,  manipulability  or  workspace  size.  A  good 
review  on  the  efforts  toward  kinematic  hand  design  can  be  found  in  [6] .  As  robotic 
hands  become  more  common  in  industrial  applications  and  human  environments,  it 
makes  sense  to  think  that  their  design  will  become  more  task-oriented.  Soto  Martell 
and  Gini  [14]  expose  the  need  for  a  task-based  design  process  for  robotic  hands. 

The  use  of  kinematic  synthesis  for  the  design  of  the  multi-fingered  robotic  hand 
has  been  applied  to  individual  fingers,  see  [2].  We  believe  that  the  reason  why  di¬ 
mensional  synthesis  has  been  scarcely  applied  to  robotic  hand  design  is  because 
of  the  lack  of  a  method  that  takes  a  multi-fingered  task  as  the  input  and  outputs  a 
multi-fingered  design. 

In  this  paper,  we  extend  the  work  presented  in  [13]  by  combining  it  with  the 
results  on  kinematic  synthesis  for  infinitesimal  positions  [8,  9]  and  expressing  the 
kinematics  using  the  Clifford  algebra  of  dual  quaternions  [10].  Note  that  mechanical 
linkages  are  traditionally  synthesized  by  specifying  a  task,  consisting  of  a  number 
of  positions  that  the  end-effector  has  to  move  through,  with  the  goal  of  determining 
the  design  parameters,  i.e.  fixed  and  moving  pivot  locations,  as  well  as  the  size  of 
the  linkage.  The  difference  between  the  traditional  design  of  mechanical  linkages 
and  the  current  design  with  contact  direction,  used  in  this  research,  is  basically  in 
the  task,  which  consists  not  only  of  positions,  but  velocities  and  accelerations  com¬ 
patible  with  contact  and  curvature  specifications  between  the  end-effector/fingers 
and  the  object  to  be  grasped.  In  comparison  to  the  traditional  synthesis  techniques, 
these  velocities  and  accelerations  yield  to  a  more  complicated  system  of  position, 
velocity  and  acceleration  design  equations,  as  well  as  more  complicated  trajectory 
planning  techniques. 

As  an  example,  we  apply  this  methodology  to  the  design  of  a  multi-fingered 
hand  for  operating  a  door  knob.  The  motivation  for  this  design  arose  from  an  indi¬ 
vidual,  who  is  confined  to  a  wheel  chair  after  an  accident.  He  has  limited  movement 
and  weakness  in  his  hands,  making  it  difficult  for  him  to  grasp  doorknobs  at  his 
workspace.  The  synthesis  presented  here  is  the  first  step  towards  developing  assis¬ 
tive  manipulation  devices. 


2  Infinitesimal  Kinematics 

The  generic  screw  S  for  a  twist  can  be  represented  as  an  element  of  the  Lie  algebra 

^^(3)  [12], 


S  =  A(s;r  xs-\-hs)  =  A(s;s^  -]-/zs)  =  (to;v)  G  se{3) 


(1) 
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where  s,r,  (0,y  G  with  s-s=l,s^  =  rxs  and  X,h  G  M. 

The  relative  velocities  between  a  pair  of  rigid  bodies  form  one-dimensional  sub¬ 
algebras  of  the  Lie  algebra  se{3)  [11].  The  most  generic  subalgebra  is  generated  by 
the  screw  or  helical  joint  S  which  becomes  a  re  volute  joint  Sr  =  {s\s^)  with  h  =  Q 
or  a  prismatic  joint  Sp  =  (0;s)  with  the  screw  axis  at  infinity.  The  binary  operation 
of  the  Lie  algebra  is  the  Lie  bracket,  which  can  be  expanded  for  screws  as, 

[Si,S2]  =  [(coi;vi),((02;v2)]  =  {coi  x  co2;coi  x  v2  +  vi  x  CO2)  (2) 


The  velocity  of  the  end-effector  for  a  serial  articulated  chain  with  n  joints  in  a 
given  configuration  can  be  written  as  [12], 


dP 

dt 


i=l 


(3) 


where  P  =  {co;y)  with  CO  being  the  angular  velocities  and  v  being  the  Cartesian 
velocities.  The  screws  S/  represent  the  infinitesimal  screws  of  each  joint. 

The  infinitesimal  screws  can  be  transformed  to  an  instantaneous  position  from  a 
reference  position  using  the  Clifford  algebra  conjugation  action. 


Sf 


n 


Si 


(4) 


where  A  Gf-  =  G^  —  G[  with  G[  is  the  joint  parameter  in  the  reference  configuration 
and  Sf  is  the  i-th  screw  in  a  serial  chain  at  position  k. 

The  velocity  of  a  joint  j  in  a  chain  is  written  as  the  derivative  of  a  finite  screw 
[3], 

dS  ■ 

-^=Sj  =  '£Gt[Si,Sj]  (5) 

Cross  terms  and  the  non-commutation  of  the  derivation  operator  must  be  taken 
into  account  as  seen  by  differentiating  each  velocity  component  of  (3)  using  the 
chain  rule.  This  can  be  expanded  to  obtain  the  acceleration  of  the  end-effector. 


n—l 


dt 


P  =  £  {GiSi  +  GiSi)  =  £  GiSi  +  £  4  £  Gj  [S,-,  S,] 


i=l 


i=l 


i=l  7=i+l 


(6) 


where  P  =  (a;a)  with  a  being  the  angular  accelerations  and  a  being  the  Cartesian 
accelerations. 

The  approach  is  general  in  the  sense  that  the  chain  rule  can  be  successively  ap¬ 
plied  to  obtain  higher  derivatives  if  necessary. 
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3  Design  Equations  for  Tree  Topologies 


Tree  topologies  can  be  seen  as  many  different  serial  chains  that  share  a  number  of 
common  joints.  The  equations  can  be  written  as  for  serial  chains,  but  the  task  defini¬ 
tion  will  vary  with  the  topology.  The  finite  motion  of  a  joint  can  be  expressed  using 
the  exponential  map  of  a  screw  S.  This  can  be  expressed  using  the  unit  element  of 
the  Clifford  even  subalgebra  of  the  projective  space  C/+  (0, 3, 1)  or  dual  quaternion, 


/  6  d  .  6  6  d  0  ..  6  .  0^ 

=  (cos  -  -  -  sm  -e)  +  (sm  -  +  -  cos  -e)S  =  cos  -  +  sm  -S. 


(7) 


where  £  is  the  dual  unit  such  that  =  0. 

For  a  serial  chain  with  n  joints,  the  forward  kinematics  of  a  serial  chain  can  be 
written  relative  to  a  reference  configuration  of  the  serial  chain. 


Q{Ae)=Y[e 

i=\ 


"  Adi  Adi 

ll(cos-— +sm-— SO 

i=\  ^  ^ 


(8) 


where  AQi  =  Qi  —  Oq  with  Oq  being  the  joint  parameters  of  the  reference  configura¬ 
tion. 

For  a  task  composed  of  finite  positions,  the  relative  forward  kinematics  can  be 
compared  to  the  relative  motion  from  the  reference  configuration  to  each  position 
Pik  =  PkPi~'  [10], 

n  Adf  Q 

=  k  =  2,...,mp  (9) 

i=l 

where  ntp  is  the  number  of  positions  considered  and  A  Qf  =  —  6^ ,  with  k  =  1 

being  the  reference  configuration. 

For  a  task  with  velocities,  we  can  use  (3)  to  write, 

Pk  =  j^el^sl  k  =  (10) 

1=1 


where  P^:  is  the  absolute  velocity  information  for  a  given  position  k  in  the  form 
(co;v).  The  instantaneous  joint  screw  axis  Sf  can  be  calculated  from  (4). 

The  same  procedure  can  be  applied  to  acceleration  to  obtain  from  (6), 

Pk  =  fefsf+”fef  £  e|[sf,s5],  k  =  i,...,ma  (ii) 

1=1  1=1  J=i+1 

where  Pj^  is  the  absolute  acceleration  for  a  given  position  k  in  the  form  (a; a). 

The  velocity  and  acceleration  equations  can  be  seen  as  additional  pose  informa¬ 
tion  that  reduce  the  number  of  poses  needed.  Counting  the  number  of  independent 
unknowns  %  and  independent  equations  n/  we  obtain. 
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nx  =  ns  +  nj{mp-{-my^ma- 1)  (12) 

rif  =  nc^nd{mp  +  my-^ma  -  1)  (13) 

where  ris  is  the  number  of  independent  structural  parameters,  nj  the  number  of  joint 
degrees  of  freedom,  ric  the  number  of  independent  constraints  and  the  degrees  of 
freedom  of  the  end-effector  motion.  The  number  of  positions,  velocities  and  accel¬ 
erations  are  given  by  ntp,  nty  and  nta  respectively.  If  we  consider  m  =  mp^my^Ma 
we  obtain  the  familiar  formula  [10], 

He  —  fir 

m=— - 2  +  1  (14) 

Ud-Uj 


4  Experimental  Set  up  and  Task  Specification 

Since  the  first  step  in  our  synthesis  technique  is  related  to  choosing  a  specific  task, 
the  kinematic  task  selected  for  the  design  is  the  operation  of  a  standard  door  knob. 
In  order  to  define  this  kinematic  task,  the  door  knob  grasping  and  turning  movement 
was  performed,  from  a  start  to  end  spatial  locations.  During  the  movement,  the  sub¬ 
ject  emulates  the  opening  of  the  door  motion  with  an  apparatus  shown  in  Fig.  la. 
The  upper  limb  kinematics  at  specific  points  of  interest  are  captured  by  a  3D  Mo¬ 
tion  Capture  System  (Vicon,  OMG  Pic.,  UK),  available  in  our  Human  Interactive 
Robotics  Lab  at  Texas  A&M  University. 

Three  infrared  cameras  track  the  position  of  each  marker  relative  to  a  predefined 
global  coordinate  frame,  with  a  sampling  rate  of  100  Hz.  Five  moving  frames  are 
defined  at  the:  elbow,  wrist,  and  tip  of  thumb,  tip  of  index  and  tip  of  middle  fingers, 
respectively.  Fig.  lb  shows  the  marker  attachment.  To  only  synthesize  the  motion 
of  the  forearm,  the  positions  chosen  were  transformed  from  absolute  positions  Pi  to 
positions  local  to  the  elbow  Pij  =  Pj^Pi  with  Pj  is  the  position  of  the  elbow.  For 
velocities  this  can  be  written  as  Ptj  =  Pi  —  Pj. 

The  obtained  positions  and  velocities  were  then  used  as  a  task  for  the  kinematic 
synthesis  of  the  multi-fingered  robotic  hand.  The  kinematic  specification  consists 


Fig.  1  la  The  experimental 
apparatus  for  emulating  the 
door  knob  task  and  lb  the 
kinematic  model  configured 
in  the  3D  Motion  Capture 
System. 
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of  set  of  three  spatial  displacements  defined  by  =  1,2,3,  and  the 

associated  angular  and  linear  velocities  =  (cOy^;  Vy^) ,  ^  =  1 , 2  in  two  of  the  positions 
for  each  fingertip. 


5  Solving  Numerically 


The  solver  used  is  an  updated  version  of  the  kinematic  synthesis  solver  for  tree 
structures  [13]  updated  to  support  the  design  equations  (10)  and  (11).  The  solver  is 
composed  of  a  Genetic  Algorithm  (GA)  paired  with  a  Levenberg-Marquadt  (LM) 
local  optimizer.  For  more  details  on  the  solving  approach  see  [13]. 

The  full  equation  system  for  a  multi-fingered  robot  with  h  fingers  formed  by  n 
revolute  joints  can  be  defined  directly  by  manipulation  of  the  design  equations, 


/ 


¥{s,Ad,e,e)  = 


Ad^ 


S,,c 


i=\ 

nc 


i=\ 


k  =  2,...,mp 

c  1 , . . . , 

k=  1 , . . . ,  mv 

c=  1,...,/? 


\ 


j 

(15) 

where  h  is  the  number  of  branches  or  fingers,  ric  is  the  number  of  joints  for  a  branch 
c,  n  is  the  total  number  of  joints  in  the  structure  and  are  the  instantaneous  axis 
of  the  joint  i  in  the  branch  c  for  the  frame  k  calculated  by  (4).  A  valid  mechanism  is 
said  to  be  found  when  F(S,  A0, 0, 0)  =  0. 


6  Results 

The  kinematic  structure  of  the  hand  consists  of  a  three  degree  of  freedom  palm-F  wrist 
complex  (RRR),  and  three  fingers,  each  of  which  is  modeled  as  a  two  degree  of 
freedom  RR  kinematic  chain  as  seen  in  Fig.  2a.  This  structure  was  chosen  for  the 
kinematic  synthesis  of  the  task  as  it  has  fewer  degrees  of  freedom  than  the  human 
hand  while  having  an  non-fractional  number  of  required  samples.  As  this  paper  does 
not  deal  with  structural  synthesis,  a  pre-determined  topology  is  used.  No  additional 
constraints  were  placed  on  the  structure.  For  this  kinematic  structure  with  9  re  volute 
joints,  a  total  of  m  =  5  samples  are  needed  as  obtained  from  (14). 

The  experimental  task  consists  of  many  hundreds  of  frames  of  which  rup  =  3 
were  selected.  For  two  of  them  velocity  information  was  also  used  providing  = 
2.  Due  to  the  nature  of  the  door-knob  opening  task,  the  accelerations,  related  to 
curvature  constraints  (i.e.  sliding  motion  of  the  fingers  along  the  door-knob)  are 
fairly  small  in  comparison  to  the  other  task  specifications  and  were  not  taken  into 
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(a)  Topology  (b)  Full  System  (c)  Index  Finger  (d)  Middle  Finger  (e)  Thumb 
Fig.  2:  The  topology  used  and  overview  of  a  solution  mechanism  found. 


account.  Therefore,  our  task  consists  of  positions,  prescribed  at  the  point  where  the 
fingers  need  to  grasp  the  door  knob,  and  velocities,  describing  the  contact  of  the 
fingers  with  the  door  knob.  The  resulting  equation  system  has  90  unknowns  and 
102  equations  of  which  only  72  are  independent.  A  set  of  50  solutions  was  obtained 
taking  an  average  of  18.06  minutes  per  solution  and  needing  an  average  of  13.76 
generations  per  solution  with  a  population  of  100  entities. 

A  selected  solution  mechanism  of  the  doorknob  task  can  be  seen  in  Fig.  2.  The 
thick  joint  axes  are  connected  by  thinner  lines  at  the  intersections  of  the  common 
normals  of  the  joints  and  the  joint  axes.  The  origin  is  represented  by  using  a  square 
and  the  end-effectors  are  represented  by  using  spheres.  This  solution  shown  is  more 
compact  than  the  human  hand  as  all  the  joints  except  one  are  grouped  together  and 
is  able  to  perform  the  same  task  as  the  human  hand.  It  was  observed  that  generally 
the  solutions  have  a  similarity  between  the  index  and  middle  finger,  while  the  thumb 
has  a  different  shape,  which  is  similar  to  how  the  human  hand  is  designed. 


7  Conclusions 

This  paper  presents  a  novel  dimensional  synthesis  methodology  for  articulated  sys¬ 
tems  with  a  tree  structure  using  additional  constraints  such  as  velocity  and  accelera¬ 
tion.  It  also  presents  a  new  design  for  numerically  solving  kinematic  systems  using 
these  new  constraints,  adding  upon  the  previous  work  of  numerically  solving  tree 
structures  with  kinematic  synthesis.  The  addition  of  velocity,  acceleration  and  other 
derivatives  at  the  positions  allows  a  better  local  approximation  of  the  task  motion, 
as  well  tasks  with  contact  and  curvature  specifications. 

For  the  selected  knob-operating  task,  a  tree-like  robot  with  three  two-jointed  fin¬ 
gers  has  been  designed.  Kinematic  synthesis  is  just  one  step  in  the  design  process, 
one  that  allows  you  to  create  innovative  candidates  fitted  for  the  kinematic  tasks 
under  consideration.  Enough  solutions  have  been  found  to  suggest  that  a  method  to 
analyze  and  rank  those  needs  to  be  a  part  of  the  design  process.  These  results  show 
that  the  dimensional  synthesis  of  robotic  multi-fingered  hands  is  possible.  In  addi¬ 
tion,  multi-fingered  hands  appear  not  to  be  redundant  when  a  task  involving  several 
fingers  is  to  be  performed. 
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Abstract 

This  paper  presents  a  methodology  for  describing  and  synthesizing  articulated 
systems  with  multiple  end- effectors,  such  as  those  occurring  in  multi- fingered 
hands.  The  articulated  system  is  represented  as  a  rooted  tree  graph.  Graph 
and  synthesis  theories  are  applied  to  determine  when  exact  synthesis  can  he 
performed  on  the  tree  structures  by  considering  all  the  possible  subgraphs  and 
the  subgroup  of  motion  of  each  subgraph.  Two  examples  of  tree  topologies  are 
presented  and  studied  in  detail. 

Keywords:  kinematic  synthesis,  graph  theory,  tree  articulated  systems 


1.  Introduction 


Kinematic  synthesis  theory,  in  which  an  articulated  system  is  designed 
to  meet  certain  motion  specihcations,  has  been  applied  to  planar  open  and 
closed  linkages  and  spatial  serial  chains.  For  dimensional  synthesis  of  planar 


linkages  see  0,31,8.  Dimensional  ^nthesis  of  spatial  articulated  systems 


has  targeted  mostly  serial  chains 


lai  synrnesis  < 

0,0330 


due  to  the  complexity  of  the 


problem  ,  and  has  been  applied,  to  some  extent,  to  parallel  robots  (ill. fl^ 


Recent  developments  in  type  or  structural  synthesis  p^,  UJ]  highlight  the 


importance  of  a  systematic  classification  for  the  linkage  type  in  the  synthesis 
process,  which  is  based  on  graph  theory.  Graph  theory  has  for  long  been  used 
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for  the  analysis  of  linkages,  see  early  research  by  Huang  and  Soni  Q  ,  and 


Freudenstein  and  Maki  [1( 
1^.  Chuang  and  Lee  [l9 


],  and  more  recently  Tsai  m  and  Mruthyunjaya 
use  structural  synthesis  for  the  design  of  finger 

mechanisms. 

This  paper  focuses  on  the  dimensional  synthesis  problem,  in  particular 
exact  dimensional  synthesis,  applied  to  articulated  systems  with  a  tree  struc¬ 
ture.  A  tree-structured  articulated  system  has  a  base  (a  grounded  link),  some 
common  joints,  and  multiple  end-effectors,  each  one  of  them  corresponding 
to  a  separate  branch. 

There  has  been  some  work  done  mainly  in  the  analysis  of  tree  structures. 
Selig  cites  tree-structured  mechanisms  and  models  them  as  rooted  trees 
following  j^.  His  work  includes  basic  definitions  and  its  application  for  the 
kinematic  and  dynamic  analysis.  Chen  et  al.  [2^  perform  the  analysis  of 
tree- type  geometries  for  applications  in  modular  robots;  Song  and  Amato 
apply  the  analysis  of  tree- like  articulated  systems  to  folding.  Jain  uses 
tree  graphs  for  the  dynamic  analysis  of  multi-body  systems;  tree-systems  also 
appear  describing  dynamic  systems  in  Garcia  de  Jalon  |2f^.  Tree  articulated 
systems  and  their  graph  representation  are  also  studied  in  (26|  for  the  analysis 
and  control,  where  they  are  named  forking  linkages.  Tischler  et  al.  |27l.  l28 


apply  graph  theory  for  the  structural  synthesis  of  kinematic  chains  with 
applications  to  robot  hands. 

Even  though  very  few  literature  is  devoted  to  them  when  compared  to 
their  serial  or  parallel  counterparts,  tree  articulated  systems  are  widely  used 
in  robotic  multi-fingered  hands;  locomotive  structures  for  mobile  robots  could 
also  be  modeled  as  tree-like  systems. 

In  this  case,  the  design  of  multi-fingered  robotic  grippers  is  the  primary 
application  for  the  kinematic  synthesis  of  tree  topologies.  The  advantage  of 
having  a  methodology  for  the  kinematic  synthesis  of  a  set  of  fingers  is  the 
possibility  of  defining  manipulation  and  graspiiig  actions  for  the  whole  hand. 
Aside  from  underactuated  robotic  hands  (see  for  a  review  and  ji^  for 
recent  results),  which  present  little  dexterity,  the  design  of  robotic  hands 
has  been  performed  from  an  anthropomorphic  point  of  view.  See  recent 
reviews  for  different  applications  in  (^,  [3^.  In  addition  to  this,  there  is 
some  development  in  the  design  of  modular  fingers  able  to  perform  certain 
grasping  actions,  which  are  later  integrated  in  the  hand.  See  for  instance  the 
work  by  Dai  and  Wang  ji^ .  With  the  development  of  a  theory  for  the  use  of 
kinematic  synthesis  in  tree  topologies,  we  aim  to  create  a  tool  for  new  designs 
that  can  be  applied,  for  instance,  in  many  areas  of  human-robot  interaction. 
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In  this  paper,  we  present  a  theory  and  methodology  for  the  dimensional 
synthesis  of  articulated  systems  with  a  tree  topology.  Taking  as  input  data 
a  hnite  set  of  rigid-body  positions  for  each  of  the  multiple  end-effectors,  we 
perform  dimensional  synthesis  for  the  tree-structured  kinematic  chain.  This 
is  modeled  using  rooted  tree  graphs.  A  hrst  step  to  be  performed  is  the 
substitution  of  kinematic  chains  in  order  to  obtain  a  compact  rooted  graph. 
This  graph  must  be  checked  to  see  if  it  is  solvable.  If  not,  an  equivalent  graph 
must  be  found. 

For  the  resulting  solvable  rooted  tree  graph,  the  forward  kinematics  equa¬ 
tions  of  relative  displacements  for  each  serial  chain  are  computed  using  dual 
quaternions.  The  synthesis  of  spatial  serial  chains  for  up  to  five  degrees  of 
freedom  using  this  technique  was  developed  in  (^.  In  this  case,  each  serial 
chain  corresponds  to  one  branch,  including  the  common  joints.  The  depen¬ 
dency  among  the  different  serial  chains  allows  to  extend  the  exact  synthesis 
to  articulated  systems  with  a  high  number  of  degrees  of  freedom  and  to  tasks 
defined  by  a  high  number  of  positions. 

The  set  of  design  equations  for  all  serial  chains  are  solved  simultaneously. 
We  must  point  out  the  high  dimension  and  degree  of  the  obtained  system 
of  equations,  which  normally  require  a  numerical  solver.  As  a  last  step,  the 
solution  is  used  to  dimension  the  substituted  kinematic  chains. 

This  method  has  been  applied  to  two  examples.  The  first  one  is  a  possible 
application  to  a  multi- fingered  robotic  hand,  for  which  numerical  solutions 


have  been  found  |35|.  The  second  example  is  a  simple  PR-(R,P)  tree  struc¬ 


ture,  which  can  be  solved  analytically  and  is  used  to  illustrate  the  process. 


2.  Rooted  Tree  Graph  Representation 

Articulated  systems  with  a  tree  topology  can  be  modeled  using  graph 
theory.  This  allows  for  a  compact  representation  of  the  structure,  the  iden¬ 
tification  of  key  paths  in  the  system  and  the  realization  of  some  operations 
that  help  simplify  the  synthesis  process. 

Tsai  H  established  a  methodology  to  represent  mechanisms  with  graphs. 
It  consists  of  representing  the  joints  as  edges  and  the  links  as  the  vertices. 
For  the  kinematic  synthesis,  the  mechanisms  is  to  be  represented  always  as 
a  rooted  graph.  The  root  vertex  will  be  considered  to  be  fixed  with  respect 
to  the  reference  system. 

We  shall  denote  a  rooted  connected  graph  representing  a  kinematic  struc¬ 
ture  as  G(V,E),  with  a  set  of  v  vertices  V  and  a  set  of  e  edges  E  connecting 
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Figure  1:  Graph  representation  of  a  4R  manipulator  where  the  circle  repre¬ 
sents  the  root  and  the  square  represents  the  end-effector. 


the  vertices.  The  vertices  represent  the  rigid  bodies  and  the  edges  represent 
the  joints  connecting  adjacent  bodies.  Besides  the  root  vertex,  a  number 
of  vertices  will  be  given  the  special  characteristic  of  being  considered  end- 
effectors. 

A  graph  representing  a  4R  manipulator  can  be  seen  in  Fig.  [H  There  are 
four  edges  representing  the  four  revolute  joints.  The  root  vertex  is  marked 
with  a  circle  around  the  point  and  the  end-effector  is  represented  by  a  square 
around  the  point. 

In  tree  topologies,  a  vertex  will  be  connected  to  several  edges  for  spanning 
branches.  The  degree  of  a  vertex  is  the  number  of  edges  that  are  connected  to 
it,  which  in  this  case  would  be  equivalent  to  the  number  of  joints  connected 
to  it. 

2.1.  Contraction 

After  constructing  the  initial  graph  representing  a  linkage  we  shall  proceed 
to  contract  the  graph.  The  graph  is  contracted  so  that  each  edge  represents 
the  set  of  joints  of  a  kinematic  serial  chain  instead  of  an  individnal  kinematic 
joint. 

The  4R  manipnlator  seen  in  Fig.  [H  wonld  be  contracted  to  a  single  edge 
representing  the  serial  chain  of  four  revolute  joints  connecting  the  root  vertex 
and  the  end-effector  vertex.  Contraction  removes  all  vertices  with  a  degree 
of  2;  notice  that  all  vertices  with  a  degree  of  1  that  are  not  the  root  vertex 
are  end-effectors. 

2.2.  Setting  the  Root  Node 

The  special  characteristic  of  the  root  node  is  that  it  indicates  that  the 
rigid  body  associated  with  it  is  immobile  in  the  reference  system.  Essentially 
it  marks  the  fixed  reference  system.  However,  the  root  node  can  be  set  at 
any  other  end-effector  by  performing  a  transformation.  If  we  consider  the 
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positions  P*  associated  to  the  end-effector  i  where  z  =  1  is  the  root  node, 
then  the  transformation  of  the  root  from  i  =  1  to  i  j  is, 


p-  =  p-‘Pi  (1) 

where  P*  would  be  the  new  end-effector  positions  relative  to  the  new  root. 

Changing  the  root  node  can  be  useful  for  solving  particular  systems  as  it 
will  be  seen  in  the  examples. 

2. 3.  Rooted  Graphs  for  Tree  Topologies 

Let  T{V,E)  be  a  contracted  rooted  tree  graph,  with  a  set  of  v  vertices 
V  and  a  set  of  e  edges  E,  obtained  from  a  rooted  connected  graph  G{Vr,  Er) 
that  represents  a  kinematic  structure.  We  assume  that  there  are  no  loops 
in  the  contracted  rooted  tree  graph.  For  synthesis  purposes,  loops  can  be 
substituted  with  equivalent  serial  chains  in  a  process  called  reduction^  which 
is  explained  in  Section  [5l  Then  the  following  relations  exist: 

1.  e  =  V  —  1 

2.  Between  any  two  vertices  i  and  j  where  i  ^  j  there  exists  only  one 
path. 

3.  The  only  vertices  with  a  degree  of  1  will  be  either  the  graph  root  or  an 
end-effector. 

4.  There  are  no  vertices  with  a  degree  of  2. 


3.  Forward  Kinematics  for  Tree  Topologies 


The  forward  kinematics  for  a  serial  kinematic  chain  can  be  written  using 
the  representation-agnostic  exponential  map  |36l|. 


where  6  =  6  +  ed  and  g  is  the  transformation  from  the  reference  system  to 
the  end-effector  at  the  zero  or  reference  configuration,  and  the  S,  are  the 
positions  of  the  joint  axes  at  the  zero  configuration. 


Qm 
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The  term  g  can  be  eliminated  by  considering  the  forward  kinematics  of 
relative  displacements  with  respect  to  this  reference  configuration,  measured 
from  the  fixed  frame, 


(3(A«)  =  (3) 

1  =  1 

where  A0  =  0  —  6q  ^  e(d  —  do)  with  6q  and  do  being  the  values  of  the  joint 
parameters  at  the  reference  configuration. 

For  a  linkage  with  a  tree  topology,  a  set  of  forward  kinematics  equations 
can  be  written  for  each  of  the  branches,  considering  the  common  joints  in  all 
of  them. 


4(Ae)=neT^"-  n 


j=ki-\-l 


common 


branch 


(4) 


where  the  number  of  common  joints  for  a  given  branch  i  is  indicated  by  ki, 
and  the  number  of  end-effectors,  or  branches,  is  indicated  by  b.  Each  branch 
or  serial  chain  has  a  total  of  n*  joints,  counting  the  common  ones. 


4.  Linkage  Locus  Space 

For  the  most  general  case  in  Eqn.  (jlj),  where  the  joint  axes  can  be  arbi¬ 
trarily  positioned  in  space,  it  is  important  to  define  the  minimum  subgroup 
of  SE{3)  able  to  contain  the  full  motion  of  each  end-effector  as  generated  by 
the  motion  of  the  joints  defining  its  serial  chains. 

For  a  given  serial  chain  with  n  joint  axes  Sj,  the  workspace  of  relative 
motion  can  be  defined  as. 


W 


n^Oj  C 

e  2  ’  —  w  =  0, 

i=l 


(5) 


However,  for  performing  synthesis  we  have  to  consider  an  extended  version 
of  the  workspace,  the  potential  workspace  of  a  generic  mechanism  topology. 
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as  opposed  to  the  particular  workspace  of  a  specific  mechanism.  In  order 
to  define  where  the  generic  mechanism  topology  lies,  we  define  the  Linkage 
Locus  Space. 

Let  $}  be  the  smallest  subalgebra  of  se(3)  containing  all  the  possible 


infinitesimal  mechanical  liaison  (37j  between  two  rigid  bodies  of  serial  chain. 


In  general,  this  is  calculated  for  consecutive  rigid  bodies  separated  by  a  joint. 
However,  in  the  case  of  having  constraints  defined  by  relationships  between 
joint  parameters  for  two  or  more  consecutive  rigid  bodies  in  a  serial  chain, 
this  cannot  be  calculated  as  the  mechanical  liaison  of  individual  joints. 

For  example  $p  would  be  the  smallest  subalgebra  that  contains  all  possible 
infinitesimal  mechanical  liaisons  of  the  form 


Sp  =  A(0;s) 


(6) 


which  in  this  case  would  be 


(7) 


We  can  consider  the  most  general  form  of  joint  as  the  helicoidal  joint 
which  has  the  form  of 


Sir  =  A  (s;  r  X  s  +  hs) 


(8) 


which  in  this  case  would  have,  as  smallest  subalgebra  containing  its  generic 
version. 


«(3) 


(9) 


Special  relationships  can  also  be  considered  using  explicit  calculation.  As 
an  example,  the  case  of  a  revolute  joint  followed  by  a  cylindric  joint  forming 
an  RC  chain,  where  both  joints  have  the  same  rotation  axis  with  opposite 
angles,  such  that  if  the  revolute  joint  rotates  6*,  the  cylindric  joint  rotates 
—9.  In  this  case  individually  each  joint  would  be. 


Sr  =  9  (s;  Tr  X  s) 

Sc  =  -0  (s;  rc  xs)  +  d  (0;  s) 
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(10) 

(11) 


with  6  and  d  being  the  joint  parameters. 

When  we  consider  all  the  elements  generated  by  the  RC  subchain  we 
obtain, 

f  I  ff  Q  Q  /s'! 

Wrc  =  <  w  I  —  w  =  0,  >  (12) 

which  when  expanded  is  found  to  have  the  form 


Src  =  (0;  0{rR  x  s  -  x  s)  +  ds)  (13) 

The  smallest  subalgebra  of  se(3)  containing  all  possible  joints  of  the  form 
Src  in  this  case  would  be  the  same  as  for  $p  or 

Now  we  can  consider  the  entire  chain  and  define  the  Linkage  Locus  Space 
£  as  the  smallest  subalgebra  of  se(3)  corresponding  to  the  smallest  subgroup 
containing  the  generic  workspace  for  the  given  topology  as 


S 


i=l 


V0,VSi 


(14) 


This  can  be  calculated  directly  by  finding  the  smallest  subalgebra  that 
contains  S  or,  given  all  the  subalgebras  of  all  the  joints  of  the  serial  chain, 
by  using  the  closure  of  subalgebras 


£  =  $*©$*©...©$; 


(15) 


Proof.  We  can  begin  by  expanding  w  by  using  the  well-known  Campbell- 
Baker-Hausdorf  series 


log(w)  =  log(JJ 


e  2  ■^*) 


1=1 


+ 


+  ^S„+ 


:(AeiA«2[Si,S2]A«,A4[S„S3 


)+ 


96 


(A02a^;[Si,[Si,S2]]+ 
A0iA^2[Si,  [Si,  S3]]  +  •••)  + 


(16) 


The  closure  of  subalgebras  from  Eqn.  ina  can  be  seen  to  be  the  vector 
subspace  containing  all  the  finite  Lie  products  of  the  form 


£  — <  Si  S2  •  •  •  S„  [Si,  S2]  •  •  •  [Si,  [Si,  S2]]  •  •  •  > 


(17) 


It  is  straight  forward  to  see  that  we  can  find  a  linear  combination  of 
Eqn.  (fT7j)  for  each  element  of  log(w)  in  the  form  of 


( 


A6'i  A02  A^n  AdiA^s  A0iA03 


2  2  2 
Erom  this  we  can  deduce  that 
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•) 


(18) 


log(w)  e  £,  Vw  e  S 


(19) 


and  thus 


log(S)  <  £ 


(20) 


log(S)  is  closed  under  the  Lie  bracket  and  is  thus  a  subalgebra  of  5e(3). 
Eor  simplicity  let  us  take  two  arbitrary  elements  of  log(S)  in  the  form  of 


X 


Xi  +  X2  + 


+  X„  +  -[Xi,X2]  + 


(21) 
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The  Lie  bracket  of  two  elements,  which  we  shall  denote  as  X  and  X* 
respectively,  can  be  expanded  as 


(22) 


where  each  element  in  the  summation  belongs  to  £. 

It  is  straight  forward  to  see  that  the  subalgebras  $*  are  also  contained  in 
log(S).  As  £  is  the  smallest  subalgebra  containing  all  $*,  log(S)  contains  all 
$*  and  log(5')  <  £  we  can  establish  that 


(23) 


log 


□ 


Therefore,  in  order  to  calculate  dim(S)  it  is  possible  to  instead  calculate 
dim(£)  by  means  of  iteratively  adding  successive  higher  order  Lie  bracket 
of  each  subalgebra  $*  until  all  the  Lie  brackets  are  linear  products  of  the 
previously  found  Lie  brackets. 

As  shown  in  the  next  section,  we  can  use  the  expressions  developed  here 
in  order  to  define  the  dimension  of  the  space  in  which  all  possible  mechanisms 
of  a  given  topology  can  be  found.  This  is  important  for  both  being  able  to 
define  a  task  that  is  feasible  for  a  given  topology  and  also  in  order  to  be  able 
to  determine  when  exact  synthesis  can  be  performed. 

5.  Reduced  Tree  Topology  for  Exact  Synthesis 

The  main  objective  of  the  reduction  is  to  find  a  tree  graph  equivalent 
to  the  graph  of  the  mechanism  for  performing  exact  kinematic  synthesis. 
At  the  end  of  the  process,  the  remaining  serial  chains  or  edges  must  have 
a  finite  number  of  solutions  for  dimensional  synthesis,  while  keeping  the 
motion  constraints  of  the  original  mechanism.  An  example  of  a  complex 
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Figure  2:  Reduction  of  a  complex  kinematic  structure  with  a  Sarrus  linkage 
to  a  tree  graph. 


graph  representing  a  kinematic  structure  being  contracted  and  reduced  to  a 
rooted  tree  graph  can  be  seen  in  Fig.  El 

In  the  case  of  open-loop  chains  the  process  is  simple.  The  mobility  of  the 
loops  can  be  calculated  by  the  CKG  equation 


F  =  \(n-j-l)  +  j2fi 


(24) 


i=l 


where  F  is  the  number  of  degrees  of  freedom  of  the  mechanism,  A  =  dim(kF) 


ll|  is  the  number  of  allowed  degrees-of-freedom  of  the  space  in  which  the 


end-effector  moves,  n  is  the  number  of  links,  j  is  the  number  of  joints  and  /j 
is  the  degrees  of  freedom  of  the  joint  i. 

However,  this  mobility  does  not  take  into  account  the  actual  structure 
of  the  workspace.  With  a  mobility  of  4  the  workspace  could  be  redundantly 
defined  as  would  be  the  case  of  four  prismatic  joints.  Therefore  the  dimension 
of  the  linkage  locus  space  must  be  studied. 

The  number  of  redundant  degrees-of-freedom  r  of  a  serial  mechanism  be 
calculated  by, 


j 

r  =  '^fk-  dim(£)  (25) 

k=i 

where  fk  denotes  the  number  of  degrees  of  freedom  of  joint  k. 
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If  r  >  0  the  mechanism  is  considered  to  have  redundant  degrees-of- 
freedom.  For  a  given  relative  transformation  there  will  be  an  entire  subspace 
of  joint  parameters  that  will  perform  the  transformation.  These  mechanisms 
are  not  suitable  for  exact  kinematic  synthesis  as  there  will  be  a  subspace  of 
solutions  and  not  a  hnite  number  of  solutions. 

Chains  without  redundant  degrees-of-freedom  that  can  move  anywhere 
in  the  Linkage  Locus  space  £  may  also  have  subspaces  of  solutions.  The 
degrees-of-freedom  can  be  represented  as  the  ordered  screw  surface  $  of  a 
mechanism  topology  as 


In  order  for  the  kinematic  synthesis  to  have  a  hnite  number  of  solutions 
the  kinematic  chain  must  comply  with, 


dim($)  <  dim(£)  (27) 

Combining  the  two  conditions  we  obtain  the  combined  condition  that 
the  serial  chains  must  comply  with  to  be  able  to  perform  exact  kinematic 
synthesis, 


j 

fk  =  dim($)  <  dim(£)  (28) 

k=i 

Additionally,  the  special  euclidean  group  SE(3)  is  formed  by  SO  (3)  xi 
with  being  a  normal  subgroup.  The  Lie  bracket  of  any  vector  from  the 
subspace  of  5e(3)  with  any  vector  of  belongs  to  E^.  In  order  to  perform 
exact  kinematic  synthesis,  E^  must  not  be  a  subspace  of  the  ordered  screw 
surface, 


E^  ^  $  (29) 

The  special  orthogonal  group  SO  (3)  is  not  a  normal  subgroup  of  SE{3) 
and  does  not  have  this  issue.  The  only  case  in  which  so  (3)  G  $  would  be 
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a  spherical  joint  S  centered  on  the  origin  would  be  represented  by  (si;0)  + 
(s2;0)  +  (s3;0).  This  mechanism  would  not  be  suitable  for  exact  synthesis 
of  the  joint  orientations.  However,  spherical  joints  are  only  defined  by  the 
center  point  of  the  joint.  Thus,  a  spherical  joint  centered  on  the  origin  would 
have  no  structural  parameters  and  would  be  suitable  for  exact  synthesis. 

Kinematic  serial  chains  that  either  fully  determine  the  Linkage  Locus 
space  £  or  have  redundant  degrees-of-freedom  must  be  substituted  by  other 
chains  that  preserve  £  while  having  a  finite  number  of  kinematic  synthesis 
solutions.  This  can  be  seen  as  solving  for  a  more  constrained  problem  in  order 
to  obtain  intermediate  positions,  which  are  then  used  to  solve  the  original 
problem,  albeit  it  will  not  have  a  finite  number  of  solutions. 

The  process  of  substituting  serial  chains  not  suitable  for  exact  kinematic 
synthesis  is  not  straightforward  when  there  are  many  constraints  applied  to 
the  kinematic  chain.  For  simple  cases  such  as  the  4P  serial  chain  it  is  simple 
to  see  that  it  must  be  substituted  for  the  2P  serial  chain,  which  shares  the 
£  =  Linkage  Locus  space  with  no  redundant  degrees  of  freedom. 

5.1.  Parallel  Mechanism  Equivalence 

To  be  able  to  convert  the  graph  to  a  tree  graph  the  loops  must  be  sub¬ 
stituted  for  non- loop  equivalent.  We  must  refer  to  the  study  of  the  mobility 
of  single-loop  kinematic  chains  done  by  Rico  and  Ravani  (371]  for  a  more  in 
depth  study  of  types  of  kinematic  loops. 

Kinematic  loops  can  be  split  into  two  paths  corresponding  to  the  clockwise 
and  counterclockwise  path  between  the  two  rigid  bodies.  In  order  to  study 
the  mobility,  the  intersection  of  the  subalgebras  corresponding  to  both  paths 
must  be  analyzed.  Depending  on  the  class  of  the  loops,  different  steps  must 
be  taken  to  substitute  the  loop  for  a  non- loop  equivalent. 

Trivial  kinematic  loops  are  the  simplest  to  handle.  In  this  case  the  inter¬ 
section  is  either  the  clockwise  or  counterclockwise  path  of  the  loop.  We  shall 
call  the  path  that  is  the  intersection  the  dominant  path  and  remove  the  other 
path,  as  the  restrictions  imposed  by  the  dominant  path  are  in  fact  what  are 
determining  the  workspace  of  the  mechanism. 

Exceptional  kinematic  loops  have  an  intersection  of  subalgebras  that  is 
not  trivial  and  is  not  equal  to  neither  path.  The  exceptional  kinematic  chain 
loop  can  be  substituted  for  this  subalgebra  corresponding  to  the  intersection 
which  may  not  always  have  a  simple  equivalence.  Fanghella  and  Galletti 
were  the  first  to  find  many  equivalences  of  intersections  using  group  theory. 
Some  of  these  have  been  converted  to  use  Lie  algebra  by  Rico  and  Ravani 
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(i^.  However,  finding  the  equivalent  open  kinematic  chain  is  not  always  a 
simple  task  depending  on  the  mobility  class  of  the  loop. 

Kinematic  chains  with  partitioned  mobility  can  be  removed  from  the 
graph,  that  is  the  edge  representing  the  chain  can  be  removed  and  both 
vertices  merged  into  a  single  one,  as  they  do  not  have  relative  motion. 

The  remaining  cases  which  correspond  to  the  paradoxical  of  class  1  and 
2  kinematic  chains  must  be  handled  on  a  case-to-case  basis  as  there  is  no 
general  solution. 

This  process  is  to  be  repeated  until  there  are  no  loops  in  the  graph  and  it 
becomes  a  tree  graph.  The  equivalent  serial  chains  also  need  to  comply  with 
the  serial  chain  requirements  from  Eqn.  (I2HD. 

The  reduction  of  a  Sarrus  linkage  to  an  equivalent  prismatic  joint 
can  be  seen  in  Fig.  [2l  The  Sarrus  linkage  is  formed  by  two  3R  branches  with 
a  set  of  constraints  that  give  it  the  same  workspace  as  a  single  prismatic 
joint.  The  problem  can  then  be  solved  considering  the  Sarrus  linkage  to  be 
a  prismatic  joint.  Afterwards  the  motion  of  the  prismatic  joint  can  be  used 
to  generate  a  Sarrus  joint. 

6.  Kinematic  Synthesis 

In  this  paper  the  focus  is  on  the  exact  dimensional  kinematic  synthesis 
for  a  finite  set  of  positions.  Dimensional  kinematic  synthesis  seeks  to  find  the 
location  and  orientation  of  all  joint  axes  in  order  for  each  of  the  end-effectors 
to  perform  a  given  set  of  displacements.  In  this  section  an  overview  of  the 
process  for  serial  chains  will  be  reviewed  and  in  the  next  chapter  it  shall  be 
extended  to  tree  topologies. 

6.1.  Design  Equations 

Using  the  relative  forward  kinematics  from  Eqn.  (Ej),  we  can  then  write 
the  design  equations  for  a  serial  kinematic  chain  to  reach  m  finite  positions 
as. 


i  =  2,  ...,m  (30) 

i=l 

where  j  =  1  is  considered  the  reference  configuration  and  Pi,  = 

This  creates  a  set  of  design  equations  that  can  be  solved  for  the  unknown 
joint  axes  (denoted  here  as  structural  parameters)  and  joint  variables  in  order 
to  reach  the  set  of  relative  displacements  Py 
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Besides  the  design  equations,  additional  equations  can  be  added.  For 
example,  relationships  between  joint  axes  would  be  represented  as  additional 
constraints  c.  These  functions  can  either  be  considered  as  a  decrease  in  the 
number  of  structural  parameters  or  separately  as  additional  functions  when 
analyzing  the  number  of  positions  needed  for  kinematic  synthesis. 

Furthermore,  the  design  equations  can  be  modified  to  handle  velocities 
and  accelerations  as  done  in  |40(]. 

6.2.  The  Synthesis  Task 

To  be  able  to  create  the  synthesis  design  equations  from  Eqn.  (jHUl)  we 
must  be  able  to  define  the  number  of  variables  and  equations  in  the  system. 
We  shall  distinguish  two  types  of  variables:  structural  and  joint  parameters. 
Joint  parameters  are  those  variables  parameterizing  the  motion  about  the 
joints,  and  depend  on  the  number  of  end-effector  poses.  The  total  number 
of  variables  will  be. 


Hx  =  {m  —  l)nj  +  Hg 


(31) 


where  m  is  the  number  of  task  positions,  Uj  =  dim($)  is  the  number  of  joint 
variables  and  is  the  number  of  structural  parameters. 

We  shall  also  distinguish  two  types  of  equations:  design  equations  and 
constraints.  The  design  equations  come  from  Eqn.  dlKll)  and  depend  on  the 
number  of  end-effector  positions,  while  here  we  assume  that  the  constraints 
do  not.  The  total  number  of  independent  equations  n/  will  be. 


Uf  =  (m  —  l)d  +  c 


(32) 


where  d  =  dim(£)  and  c  is  the  number  of  constraints. 

For  the  system  to  have  a  finite  number  of  solutions  Ux  =  Uf  must  be 
imposed  for  the  task.  From  there  we  can  obtain  the  number  of  absolute 
positions  needed. 


d  —  Uj 


(33) 


where  we  assume  all  the  equations  are  independent. 
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Table  1:  Design  parameters  for  different  serial  chains 


Linkage 

Hj 

ris 

d 

m 

mR 

T 

m 

£ 

p 

1 

2 

3 

2 

1 

2 

R 

1 

4 

6 

2 

3 

SE{3) 

H 

1 

5 

6 

2 

2 

3- 

SE(3) 

C 

2 

4 

6 

2 

2 

5 

SE{3) 

T 

2 

5 

6 

2- 

5 

6 

SE(3) 

E 

3 

2 

6 

1^ 

3 

2 

oc 

SE{3) 

S 

3 

3 

6 

2 

00 

00 

SE(3) 

PP 

2 

2 

3 

3 

1 

3 

E^ 

RP 

2 

6 

6 

2- 

2 

7 

SE{3) 

RR 

2 

8 

6 

3 

5 

9 

SE{3) 

PPR 

3 

6 

6 

3 

2 

00 

SE{3) 

PRP 

3 

8 

6 

32 

'^3 

2 

00 

SE{3) 

PRR 

3 

10 

6 

4i 

3 

5 

00 

SE{3) 

RRR 

3 

12 

6 

5 

00 

00 

SE{3) 

This  leaves  us  with  the  calculation  of  the  number  of  structural  parameters 
ng.  While  this  may  seem  like  a  simple  task,  it  is  not  always  straight  forward. 
Generally  any  unconstrained  screw  joint  as  the  one  in  Eqn.(ISD  will  have  7 
parameters:  h  G  M,  s  G  and  s°  G  with  two  constraints  s  •  s  =  1  and  s  • 
s°  =  0,  which  we  consider  to  be  5  independent  parameters.  An  unconstrained 
general  revolute  joint  has  4  parameters  as  h  =  0.  An  unconstrained  general 
prismatic  joint  has  2  parameters  as  they  can  be  represented  by  lines  at  infinity 
with  the  form  (0;  s)  with  s  •  s  =  0. 

Table  [H  shows  various  sets  of  kinematic  chains.  The  constraints  are  con¬ 
sidered  implicitly  as  part  of  the  structural  parameters  Ug.  Different  combi¬ 
nations  of  joints  and  constraints  can  modify  the  number  of  parameters.  A 
striking  example  would  be  that  two  general  prismatic  joints  PP  have  a  total 
of  2  parameters  and  not  4  as  expected.  This  happens  whenever  two  prismatic 
joints  are  consecutive  in  a  kinematic  serial  chain,  as  their  joint  axes  do  not 
appear  individually  in  the  design  equations,  but  always  as  a  cross  product. 
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There  is  no  general  rule  for  calculating  the  number  of  structural  param¬ 
eters  Hg.  However,  the  design  equations  Eqn.  (HinD  can  always  be  expanded 
and  checked  for  variable  dependencies. 

6.3.  Task  Degeneration 

The  m  design  equations  obtained  using  Eqn.  flHHl)  are  not  necessarily 
independent.  In  fact  it  is  possible  for  the  system  of  equations  to  degenerate 
into  two  subsystems  where  one  is  overdetermined  and  the  other  has  an  infinite 
number  of  solutions. 

We  can  split  the  special  euclidean  group  SE{3)  into  its  two  subgroups  us¬ 
ing  the  semi-direct  product,  SE{3)  =  SO{3)  xi  The  same  technique  used 
to  obtain  Eqn.  flHHl)  can  be  used  to  determine  the  number  of  rotations  needed 
for  the  change  of  orientation  of  the  system.  The  equations  corresponding  to 
motion  in  SO  {3)  as  treated  separately.  Thus,  the  number  of  variables 
will  be. 


nf  =  (m^  -  l)nf  +  nf  (34) 

where  is  the  number  of  orientations,  nf  the  number  of  joints  with  a 
revolute  component  and  nf  the  number  of  structural  parameters  for  the 
rotations. 

The  number  of  independent  equations  corresponding  to  rotations,  nf,  can 
be  defined  by. 


nf  =  (m^  -  l)d^  +  (35) 

where  =  dim(£n5o(3))  and  is  the  number  of  constraints  affecting  the 
rotational  parameters  in  the  design  equations. 

We  can  now  define  the  number  of  independent  orientations  needed  to 
fully  define  the  rotational  component  of  design  equations  by  making  nf  =  nf, 


nf  — 

— - h  1 

d^  -  nf 


(36) 


If  G  Q"*"  there  will  be  a  limit  on  the  number  of  independent  orienta¬ 
tions  in  the  screw  system  that  can  be  defined.  If  <  m,  the  orientation  of 
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the  positions  in  the  task  can  no  longer  be  fully  arbitrary,  and  m  —  orien¬ 
tations  will  be  dependent  on  the  arbitrary  rotations.  It  is  important  to 
remark  that  this  only  can  happen  when  nf  <  d^. 

A  similar  counting  can  be  done  for  the  translational  component  of  S' £1(3). 
However,  is  a  normal  subgroup  of  SE{3)  and  thus  the  equations  can  not 
be  decoupled.  Following  the  same  process  as  Eqn.  (j331)  and  Eqn.  we 
obtain. 


m 


T 


(F  —  Uj 


+  1 


(37) 


where  F  =  dim(£  fl  E^). 

As  can  be  seen  from  Eqn.  (E7j),  the  translational  part  depends  on  all  the 
parameters  and  variables  while  only  providing  independent  equations. 
A  serial  mechanism  will  be  solvable  using  only  translational  information  if 
rF  G  Q"*",  which  can  only  happen  in  systems  with  one  or  two  single  degree- 
of- freedom  joints. 

The  important  result  is  that  for  systems  where  <  m  and  rF  ^  Q"*", 
they  will  not  be  solvable  for  arbitrary  positions.  The  positions  need  to  be 
generated  taking  into  account  the  limitations  of  the  mechanism  in  SO  (3)  to 
have  a  finite  number  of  solutions.  This  can  be  problematic  when  designing 
for  certain  topologies. 


6.4-  Defining  Tasks 

When  defining  a  task  we  can  identify  three  different  scenarios  with  m  G 
Q+  depending  on  the  topology  of  the  mechanism  to  be  synthesized. 


1.  When  >  m  and  m  G  Q"*"  the  kinematic  chain  is  fully  solvable  for 
m  arbitrary  spatial  positions.  Additionally  if  G  Q"*",  the  kinematic 
chain  can  be  solved  for  only  locations  and  space  without  considering 
orientations. 

2.  When  <  m  and  m,m^,nF  G  Q"*"  the  kinematic  chain  can  still  be 

solved  for  arbitrary  spatial  positions.  However,  only  positions  may 
contain  arbitrary  rotations.  An  additional  positions 

with  only  arbitrary  translational  component  will  have  to  be  defined. 

3.  When  <  m,  m,  G  Q"*"  and  rF  ^  Q’*'  the  rotational  component 
will  be  solvable  for  the  mechanism.  However,  the  translational  part  will 
not  have  a  finite  number  of  solutions.  This  type  of  topology  can  not  be 
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used  to  perform  exact  kinematic  synthesis  for  arbitrary  positions.  It  is 
still  possible  to  solve  for  finite  solutions  if  the  task  is  generated  within 
£  in  such  a  way  that  the  rotational  part  is  not  over  deter  mined,  yet  still 
possible  to  obtain  the  joint  parameters  for  each  position. 

In  all  other  situations  the  single  kinematic  chain  will  not  have  a  finite 
number  of  solutions. 

7.  Tree  Kinematic  Synthesis 

Once  we  have  obtained  a  contracted  tree  graph  representing  a  kinematic 
structure  we  can  proceed  to  perform  exact  rigid  body  synthesis  for  a  finite 
number  of  task  positions.  For  this,  it  is  necessary  to  calculate  the  number 
of  positions  needed  for  all  the  end-effectors  to  fully  determine  the  kinematic 
structure  and  thus  to  have  a  finite  number  of  solutions. 

Following  similar  methodology  as  with  serial  kinematic  chains  we  shall  as¬ 
sign  constraints  to  all  vertices,  degrees-of-freedom  to  all  end-effector  vertices, 
joint  variables  to  all  edges,  and  structural  parameters  to  all  edges.  In  the  case 
of  the  degrees-of-freedom  and  joint  variables,  which  depend  on  the  number  of 
relative  positions  (m  —  1),  we  shall  only  represent  the  coefficient  multiplying 
(m  —  1).  This  will  allow  us  to  use  matrices  to  simplify  the  equations.  The 
constraints  are  a  design  parameter  and  thus  are  known. 

7.1.  Design  Equations 

The  design  equations  for  tree  systems  are  the  same  design  equations  for 
serial  chains  from  Eqn.  (jHHl)  applied  to  all  branches  at  the  same  time.  This 
can  be  written  as. 


i  =  l,...,b 
k  =  2, . . .  ,m 


(38) 


V 

common 


branch 


where  the  number  of  common  joints  is  indicated  by  ki  and  the  number  of 
end-effectors  is  indicated  by  b. 

The  definition  of  the  task  for  the  design  equations  is  similar  to  what  is 
done  in  the  previous  section.  Due  to  having  multiple  end-effectors,  tasks 
become  sets  of  displacements  for  all  end-effectors.  However,  in  the  case  of 
tree  topologies  more  care  must  be  taken  to  avoid  task  degeneration.  This  is 
explained  in  detail  in  the  next  section. 
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1.2.  Solving  Substitutions 

If  the  tree  structure  has  had  substitutions  of  parallel  or  serial  kinematic 
chains,  once  the  reduced  rooted  tree  graph  has  been  solved,  the  substitu¬ 
tions  can  be  undone  and  the  solution  used  to  create  constraints  allowing  the 
substituted  chain  to  be  solved. 

The  substituted  serial  chains  will  have  both  rigid  bodies  on  either  side 
determined.  It  is  then  possible  to  consider  one  of  the  rigid  bodies  a  reference 
and  consider  the  other  rigid  body  as  the  end-effector  of  the  chain  with  a 
motion  equivalent  to  the  relative  motion  between  both  rigid  bodies.  However, 
as  the  substitution  was  done  to  obtain  a  finite  number  of  solutions,  there  will 
be  subspaces  of  solutions.  Equation  flHHl)  can  be  applied  to  perform  the 
synthesis  of  the  subspace. 

In  the  case  of  substituted  parallel  chains,  each  branch  can  be  treated  as  a 
separate  individual  serial  chain  and  can  be  solved  using  the  same  procedure 
used  for  the  substituted  serial  chains. 

8.  Matrix  Representation 

In  this  section  we  will  outline  how  to  use  matrix  notation  for  tree  topolo¬ 
gies  in  order  to  perform  exact  kinematic  synthesis.  The  main  advantage  to 
this  approach  is  it  is  an  exhaustive  approach  when  testing  for  degeneration 
within  the  tree  structure  which  makes  it  inadequate  for  exact  synthesis.  As 
a  reminder,  we  are  considering  the  mechanism  to  be  in  the  rooted  tree  graph 
representation  with  v  vertices,  e  edges  and  b  branches. 

We  can  construct  the  e  x  b  reduced  end-effector  path  matrix  [T]  by  con¬ 
structing  a  e  X  (n  —  1)  path  matrix  [T]  and  eliminating  all  columns  that  do 
not  correspond  to  an  end-effector.  The  path  matrix  is  defined  as. 


where, 


[r| 


vertex  j 


^1,1 

H,2  •  ■ 

^2,1 

^2,2  •  ■ 

'  •  h.v-i 

edge  i 

(39) 

^e,l 

te,2  •  ■ 

^e^v—l 
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(40) 


!1  if  edge  i  lies  on  the  path  originating  at  the  root, 
and  terminating  at  the  vertex  j 
0  otherwise. 

We  can  also  construct  the  ex  (n  —  1)  reduced  incidence  matrix  [B]  as, 


where, 


[B] 


edge  j 


hi,i 

6l  2 

^l,e 

^2,1 

^2,2 

^2,e 

vertex  i 

(41) 

^4;— 1,1 

bv-l,2  ■  ■ 

1 

1 — 1 

1 

if  vertex  i  is  connected  to  edge  j 
otherwise. 


(42) 


We  can  use  the  matrix  representation  of  the  graph  to  work  with  and 
define  the  conditions  for  exact  kinematic  synthesis.  For  this  purpose  we 
will  define  vectors  to  represent  the  number  of  joint  degrees-of-freedom  and 
structural  parameters  for  the  edges  and  the  number  of  degrees-of-freedom 
and  constraints  of  the  nodes. 


8.1.  Task  Sizing  using  Matrices 

In  order  to  be  able  to  perform  exact  kinematic  synthesis,  the  global  system 
must  be  solvable.  This  is  analogous  to  what  is  done  with  simple  serial  chains. 
However,  in  this  case,  the  criteria  is  only  necessary  but  not  sufficient  for  exact 
synthesis  due  to  the  appearance  of  subgraphs,  which  will  be  discussed  in  the 
next  subsection. 

The  number  edge  unknowns  will  be  represented  using  e  x  1  vectors  and 
will  be  denoted  as  D®  for  joint  degrees-of-freedom  and  D®  for  structural 
parameters, 


n,=  ((m-l)D^^  +  D:)''E 


(43) 
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where  E  are  the  edges  in  the  graph  considered. 

The  number  node  equations  will  be  represented  using  6x1  vectors  and 
will  be  denoted  as  D^g  for  the  end-effector  degrees-of-freedom  and  D”  for  the 
constraints  of  the  end-effectors, 


n,  =  ((m-l)D“  +D;)^B  (44) 

where  B  are  the  vertices  in  the  graph  considered. 

In  order  for  the  system  to  have  a  finite  number  of  solutions  rif  =  must 
be  imposed,  from  which  we  can  obtain  the  number  positions  m  needed  for 
exact  synthesis, 


(d:)^e  -  (d;)^b 
(D“  )te  -  (D')tb 

where  if  m  0  Q+  the  system  will  be  unsolvable.  However,  this  criteria  is 
necessary,  but  not  sufficient  for  the  system  to  be  solvable. 

Additionally,  as  seen  in  Section  lb. 31  for  serial  chains,  care  must  be  taken 
with  the  subgroups  SO (3)  and  of  SE{3).  This  can  be  done  by  defining 
the  number  of  positions  needed  for  the  rotational  part  of  the  mechanism 
as 


(Df  )^E  -  (Df  )^B 
(Dnfl)TE  _  (Df  )TB 


(46) 

(47) 


where  the  supraindex  ^  denotes  that  we  only  consider  the  number  of  equa¬ 
tions  or  variables  that  affect  the  SO  (3)  component  of  the  design  equations 

(EDD. 

The  criteria  is  then  exactly  the  same  as  defined  for  serial  chains  in  Sec¬ 
tion  16.41  although  translation-only  tasks  have  not  been  covered  as  they  are 
of  little  or  no  interest  for  tree  topologies  due  to  the  limitation  of  only  one  or 
two  joint  per  serial  chain. 


8.2.  Subgraphs 

It  is  sometimes  possible  to  find  subgraphs  within  the  tree  graph  repre¬ 
senting  a  kinematic  structure  that  are  solvable  individually.  These  subgraphs 
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will  generally  need  a  different  amount  of  end-elfector  positions  to  solve  and 
will  always  end  in  a  smaller  equation  system  size  when  performing  exact 
kinematic  synthesis.  However,  if  subgraphs  exist  within  the  system,  not  all 
end-effectors  will  necessarily  need  the  same  number  of  positions.  This  is 
because  for  a  given  number  of  positions  calculated  by  Eqn.  fHHl).  it  may  so 
happen  that  a  subgraph  becomes  over  deter  mined. 

An  interesting  effect  of  this  is  that  it  only  allows  for  tree  kinematic  struc¬ 
tures  where  all  chains  from  the  root  to  end-effector  have  more  or  equal  mo¬ 
bility  than  needed  to  reach  the  entire  subalgebra  of  the  end-effector.  If  any 
kinematic  chain  has  less  mobility  than  needed  to  reach  the  subalgebra  of  the 
end-effector  it  will  always  form  a  subgraph  that  is  solvable  separately.  Figure 
E]  presents  an  example  of  a  graph  with  solvable  subgraphs. 

For  this  subsection  we  shall  consider  a  system  to  be  solvable  for  a  given 
task  with  m  positions,  if  there  is  a  hnite  number  of  mechanisms,  given  a 
specific  topology,  that  can  comply  exactly  with  the  task  positions. 

A  sufficient,  but  not  necessary  condition  for  the  system  to  be  solvable 
is  that  it  must  have  no  proper  solvable  subgraphs  that  is,  subgraphs  that 
comply  with  m  G  Q"*"  using  Fqn.  fH^.  In  order  to  check  for  this  condition, 
all  possible  proper  subgraphs  must  be  tested.  This  can  be  expressed  using 
the  reduced  path  matrix. 


Ei 


(48) 


^  66 

where  Bj  is  a  6  x  1  vector  representing  the  end-effectors  considered  for  a 
given  subgraph  i.  The  Iverson  bracket  [>  0]  is  used  to  denote  that  elements 
of  the  E  vector  should  be  either  be  1  if  >  0  or  0  otherwise.  There  are  2^  —  2 
possible  subgraphs  for  any  given  tree  graph  representing  a  reduced  kinematic 
structure,  excluding  both  the  full  graph  and  the  null  graph. 

Given  the  Ej  corresponding  to  the  edges  in  a  subgraph  we  can  calculate 
the  Bj  nodes  in  the  subgraphs  by, 


Bi  =  [B]Ei  (49) 

This  criteria  is  sufficient,  but  not  necessary.  While  it  does  always  generate 
the  smallest  system  size  for  performing  exact  synthesis,  it  increases  the  num¬ 
ber  of  end-effector  positions  needed.  A  more  lax  criteria  can  be  used  instead, 
where  we  consider  cases  where  the  subgraphs  are  separately  solvable. 
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Figure  3:  Both  branches  with  fewer  than  dim(£)  =  6  joints  form  subgraphs 
G1  and  G2  that  are  solvable  separately. 

For  each  subgraph  i,  Eqn.  (Il5l)  can  be  used  to  calculate  the  number  of 
positions  needed  for  exact  synthesis  of  the  subgraph, 

(Pa^-E,  - 

■  (D^y’-E.  -  (D')tb, 

A  necessary  and  sufficient  criteria  for  determining  the  solvability  of  a 
graph  is,  given  the  number  of  positions  m  needed  for  exact  synthesis  of  the 
subgraph,  for  all  proper  subgraphs  i  in  the  graph 


m  <  nii,  if  ruj  G  Q"*"  (51) 

Additionally,  as  in  the  general  case,  we  must  consider  SO  (3)  and 
separately.  Given  a  number  of  rotational  components  of  the  m  positions, 
denoted  as  m^,  we  obtain  the  additional  criteria 

<  mf,  if  mf  G  Q"*"  (52) 

where  mf  are  the  number  of  frames  needed  to  solve  only  the  rotation  part 
of  the  mechanism. 

If  this  criteria  isn’t  met,  then  the  subgraph  i  where  either  m  >  m*  or 
>  mf  becomes  overdetermined  while  other  kinematic  chains  become 
underdetermined.  The  system  of  equations  for  exact  kinematic  synthesis  is 
no  longer  is  guaranteed  to  have  any  solutions  when  same  number  of  task 
positions  is  defined  for  each  end-effector.  In  this  case,  the  system  will  not  be 
solvable. 
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8.3.  Solvable  Rooted  Tree  Graph 

Definition  Let  T  be  a  contracted  rooted  tree  graph  representing  a  kinematic 
structure  and  S  be  the  set  of  subgraphs  of  T.  T  will  be  called  solvable  for  a 
finite  number  of  independent  positions  if, 

1.  m  e  Q+ 

2.  m  <  G  Q"*",*  G  S 

3.  <  mf,  ymf  G  Q"*",  i  G  S 

The  advantage  of  solving  a  tree  with  subgraphs  is  that  the  workspace 
can  be  defined  by  lesser  number  of  positions  of  all  end-effectors  at  the  same 
time.  However,  the  dimension  of  the  equation  system  will  always  be  larger 
than  solving  the  smallest  subgraph  first  and  using  the  results  to  solve  other 
subgraphs  and  eventually  the  entire  graph. 

9.  Examples 

For  the  notation  of  contracted  rooted  kinematic  trees  we  shall  use  hyphens 
to  indicate  serial  links  and  parenthesis  to  indicate  parallel  links. 

9.1.  Anthropomorphic  Hand  Model  Subgraphs 

Previous  presented  work  performed  kinematic  synthesis  on  an  anthropo¬ 
morphic  hand  model  with  5  fingers  and  a  total  of  26  revolute  joints  and 
the  first  mention  of  kinematic  tree  topologies.  However,  the  lack  of  the  formal 
methods  for  exact  kinematic  synthesis  of  tree  topologies  led  to  this  work  on 
synthesis  of  tree  topologies.  We  can  now  revisit  the  anthropomorphic  hand 
model  using  the  new  tools  for  synthesis. 

The  anthropomorphic  hand  model  is  organized  as  a  3R-(4R,4R,5R,5R,5R) 
tree,  where  the  wrist  is  considered  to  have  3  revolute  joints  which  are  common 
to  the  five  fingers.  The  index  and  middle  fingers  have  4  revolute  joints,  while 
the  third  finger,  fourth  finger  and  thumb  have  5  revolute  joints.  This  gives  a 
total  of  26  revolute  joints.  There  are  not  any  constraints  besides  the  implicit 
constraints  of  the  joints. 

The  contraction  of  the  individual  joints  in  this  case  is  trivial  as  there 
are  no  closed  loops  and  all  serial  chains  are  formed  by  revolute  joints.  The 
contracted  graph  can  be  seen  in  Fig.  0  and  has  had  all  the  edges  and  vertices 
labelled.  It  is  also  easy  to  see  that  in  this  case  there  is  no  edge  with  6  or 
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Figure  4:  Rooted  tree  graph  of  an  anthropomorphic  hand  model. 


more  revolute  joints,  which  is  a  necessary,  but  not  sufficient  condition  for  the 
structure  to  be  solvable  if  there  are  no  additional  constraints. 

As  the  system  is  formed  entirely  by  revolute  joints  it  is  straightforward 
to  assign  the  6x1  vectors  associated  with  the  joint  degrees-of- freedom  D® 
and  the  structural  parameters  D®, 


D^"=[3  4  4  5  5  5]^  (53) 

D^=[12  16  16  20  20  20]^,  (54) 

as  revolute  joints  have  4  structural  parameters  associated  to  them. 

The  same  can  be  done  with  the  vertices,  which  are  5x1  vectors  associated 
to  the  end-effector  degrees-of- freedom  and  constraints  D”, 

D”  =  [6  6  6  6  6]^  (55) 

D”=[0  0  0  0  0]^  (56) 

Notice  that  in  this  case  all  end-effectors  have  a  Synthesis  Locus  space  £  = 
se(3)  and  no  additional  constraints. 

We  can  now  check  the  number  of  positions  needed  for  the  entire  system 
for  performing  exact  kinematic  synthesis.  This  is  done  by  using  Eqn.  fj45l) 
with  all  the  edges  and  branches, 


26 


E  =  [1  1  1  1  1  1] 

B  =  [1  1  1  1  1] 

26-4-0 


m  = 


6-5-26 


+  1  =  27 


(57) 


Additionally  we  must  check  the  rotational  components  by  first  calculating 
the  system  that  interacts  with  the  AO  (3), 


Df  = 

[3 

4 

4 

5 

5  5]^ 

(58) 

Df  = 

[6 

8 

8 

10 

10  10]^ 

(59) 

T~\nR  _ 

[3 

3 

3 

3 

3]" 

(60) 

d 

II 

[0 

0 

0 

0 

0]" 

(61) 

Now  using  Eqn.  fjlTj)  the  number  of  rotation  positions  needed  consid¬ 
ering  only  the  rotational  component  can  computed  as 


26-2  -  0  41 

- -j-  1  — - 

3-5-26  11 


(62) 


As  m  =  27  e  Q"*"  and  m  —  ^  Q"*"  we  can  see  the  system  meets  another 

necessary,  but  not  sufficient  condition  to  be  solvable.  For  it  to  be  solvable 
we  need  that  all  the  subgraphs  comply  with  Eqn.  m-  This  can  be  done 
by  first  determining  the  reduced  path  matrix  [T]  and  the  reduced  incidence 
matrix  [B],  The  path  matrix  consists  on  the  edges  that  lay  on  the  path  to 
a  given  node.  This  is  relative  to  the  rote  node,  which  for  this  example  is  Vi. 
Thus  the  reduced  path  matrix  can  be  written  as, 


[f| 


El 

E2 

Es 

Ei 

Es 

Ee 


Vs  V4  Vs  Ve  Vt 

11111 
1  0  0  0  0 

0  10  0  0 

0  0  10  0 

0  0  0  1  0 

0  0  0  0  1 


(63) 
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where  we  can  see  there  are  no  columns  for  neither  Vi  nor  V2  as  they  are  not 
end-effectors  and  have  been  eliminated. 

The  reduced  incidence  matrix  [B]  is 


[B] 


V2 

V3 

V4 

V5 

Ve 

W 


El  E2  Es  E4  E^  Eq 

111111 

010000 

001000 

000100 

000010 

000001 


(64) 


where  we  can  see  that  there  is  no  first  row  for  the  root  vertex  Vi. 

Now  the  end-effectors  must  be  iterated  on  using  Eqn.  (j4HD  to  construct 
the  edges  leading  to  the  end-effectors  and  Eqn.  (j4^.  There  are  in  general 
2^  —  2  possible  subgraphs.  However,  in  this  case  there  are  symmetries  as 
many  branches  are  the  same  leading  to  many  equivalent  subgraphs.  Eor 
single  branches  they  can  be  studied  using  the  single  serial  chain  equation 
from  Eqn.  (jHHl)  and  in  this  case  it  is  easy  to  see  that  all  branches  need  a 
negative  number  positions.  Therefore  none  of  these  subgraphs  are  solvable 
systems. 

Next  we  can  consider  the  two  branches  with  4  revolute  joints  (index  and 
middle  finger), 


B6^=[1  1  0  0  0]' 
The  system  has  the  following  edges. 


(65) 


Eg  =  [TIB^  =[2  1  1  0  0  0] 

[>o]  ^  ^ 

=  [1  1  1  0  0  0]' 


[>0] 


and  the  following  vertices. 


(66) 


B6  =  [H]E6=[1  1  1  1  0  0  0]^ 


(67) 
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Table  2:  All  solvable  subgraphs  of  the  anthropomorphic  hand  model 


Subgraph  b  r  m  Uf  = 


3R-(4R,4R,5R,5R,5R) 

3R-(4R,5R,5R,5R) 

3R-(4R,4R,5R,5R) 

3R-(4R,5R,5R) 

3R-(4R,4R,5R) 

3R-(4R,4R) 


5 

26 

27 

780 

4 

22 

45 

1056 

4 

21 

29 

672 

3 

17 

69 

1224 

3 

16 

33 

576 

2 

11 

45 

528 

We  can  see  graphically  from  Fig.  IHthat  the  system  indeed  has  the  edges 
El,  E2,  and  vertices  Vi,  V2,  V3,  V4.  The  value  niQ  can  be  calculated  by 
Eqn.  (1^. 


me 


4-11-0 


6-2-11 


+  1  =  45 


Additionally  ttIq  can  be  calculated  as, 


(68) 


me 


2-11-0 

- T  1 

3-2-11 


17 

y 


(69) 


We  can  clearly  see  that  ^  Q"*"  and  me  =  45  >  m  =  27,  therefore 
subgraph  is  solvable.  This  process  has  to  be  continued  for  all  the  possible 
subgraph,  and  if  all  possible  subgraphs  meet  the  criteria  we  will  say  that  the 
graph  is  solvable.  Through  continuing  we  can  obtain  the  results  from  Table  El 
From  this  we  can  see  that  all  the  possible  subgraphs  were  found  in  and 
that  the  entire  system  is  solvable.  It  is  also  important  to  note  that  as  all  the 
end-effectors  have  £  =  5e(3)  and  £nso(3)  =  5o(3),  all  m  positions  defined  in 
the  task  can  have  arbitrary  orientation  and  location.  This  is  generally  true 
for  all  unconstrained  pure  revolute-joint  systems  that  are  solvable. 

Now  that  the  task  specifications  have  been  defined  for  the  mechanism, 
synthesis  can  be  performed  for  a  specific  task,  consisting  of  m  spatial  posi- 
tions,  jjy  solving  the  design  equations  from  Eqn.  (j3HD.  In  our  previous  work 
jyi.  iyi|  we  have  employed  a  numerical  optimization  scheme  based  on  genetic 
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Figure  5:  Rooted  tree  graph  of  the  RP-(R,P)  mechanism. 


algorithm  and  Levenberg-Marquadt  minimization  that  has  been  proven  to 
be  successful  at  hnding  solutions  representing  different  mechanisms  that  can 
perform  the  task. 

9.2.  Algebraic  PR-(R,P) 

The  PR-(R,P)  consists  of  two  common  joints,  one  prismatic  and  one 
revolute,  that  fork  into  two  branches,  one  being  a  revolute  joint  and  the 
other  a  prismatic  joint  as  seen  in  Fig.  [SI  In  this  case,  we  have  two  subgraphs 
which  would  be  the  PRR  mechanism  and  the  PRP  mechanism.  To  decrease 
the  global  equation  system  size  either  subgraph  can  be  solved  individually 
and  then  the  results  would  be  used  to  solve  the  remaining  joint.  However, 
this  requires  more  task  positions  for  the  first  branch  solved  than  for  the 
remaining  joint.  Heterogeneous  numbers  of  positions  for  each  end-effector 
are  generally  not  desired. 

The  direct  method  for  solving  this  would  be  to  use  the  general  design 
equations  and  a  numerical  solver  such  as  a  Levenberg-Marquadt  optimizer, 
solving  for  all  branches  at  once.  From  Eqn.  we  can  count  the  number 
of  positions  needed  for  all  possible  chains  which  are  shown  in  Table  (H  The 
PRR  chain  needs  m  —  3  positions,  the  PRP  needs  m  =  3|  positions  and  the 
entire  system  needs  m  =  2|  positions.  As  we  can  see  the  entire  system  needs 
fewer  positions  than  either  branch. 

We  must  now  look  at  the  rotational  component  following  Eqn.  fjTTl).  We 
see  that  the  PRR  chain  needs  =  5  positions,  the  PRP  needs  =  2 
position  and  the  entire  system  would  also  need  =  2  positions.  We  can 
see  clearly  that  in  the  case  of  the  PRP  chain,  we  are  being  limited  to  only  two 
positions  with  a  rotational  component.  As  explained  in  Section  16.41  when 
<  m,  the  number  of  position  orientations  is  being  limited  by  m^.  There¬ 
fore  when  defining  the  task,  some  additional  positions  without  orientation 
information  will  have  to  be  added. 
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Table  3:  Solvability  of  the  different  subgraphs  of  the  PR-(R,P)  mechanism 


Subgraph  m  mF  Comments 

PR-(R,P)  2|  2  7  Full  system,  rotational  and  translational  components  solvable 

PRR  3  5  (X)  Full  system  and  rotational  component  solvable 

PRP  3i  2  oo  Only  rotational  component  solvable  <  m  and  mT'  0  Q+ 


In  order  to  make  sure  the  system  is  still  solvable,  we  must  also  check  the 
limit  of  translations  for  all  subgraphs.  For  the  PRR  and  PRP  chain  we 
obtain  =  oo,  while  for  the  entire  system  we  obtain  =  7.  This  indicates 
that  only  the  entire  system  is  solvable  for  only  translations  and  additionally 
that  the  PRP  subgraph  is  only  solvable  using  rotational  components.  The 
results  of  the  solvability  are  summed  up  in  Table  [3l 

Being  a  simple  mechanism  it  can  also  be  solved  algebraically.  For  solving 
algebraically  we  can  avoid  the  divide  and  conquer  approach  by  first  consid¬ 
ering  the  kinematic  chain  from  one  end-effector  to  another.  This  can  be 
thought  of  as  changing  the  root  node  to  one  of  the  end  effectors  and  then 
solving  a  subgraph.  The  forward  kinematics  of  both  branches  can  be  written 

clS, 


SUdpS%i9^)SRi9) 

—PpRR 

(70) 

S^p{d^)S%i9^)Spidl 

=  PpRR 

(71) 

common  branch 

pose 

By  considering  the  kinematic  chain  from  one  end-effector  to  another  we 
can  eliminate  the  common  joints  and  consider  the  kinematic  chain, 

Spid)-^SR{e)  =  Pp^RpPpRR  (72) 

where  Sp{d)~^  is  equivalent  to  Sp{—d).  This  is  analogous  to  making  the 
end-effector  at  the  end  of  the  P  edge  the  root  of  the  system  and  solving  the 
subgraph  formed  by  the  PR  branch  in  the  new  tree  graph. 

This  can  be  solved  algebraically  and  gives  a  single  solution  j4l|.  Given 
the  solution  the  position  of  the  rigid  body  connecting  the  common  branches 
can  be  solved  as  a  serial  chain. 
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sud°)s%(r}  =  Pp„pSp(-d} 


(73) 


which  also  has  a  single  solution.  Furthermore  the  entire  system  has  a  single 
solution. 

Therefore  the  problem  can  be  treated  as  two  separate  PR  chains  and 
solved  individually.  If  we  look  at  the  number  of  positions  each  PR  chain 
needs  we  see  it  is  m  =  2^  and  is  coincidentally  the  same  as  the  number  of 
positions  needed  for  the  entire  system.  The  procedure  to  solve  is  the  same 
as  in 


42 


As  m  =  2|  ^  N+  we  can  not  define  completely  arbitrary  positions.  Due 
to  the  fact  that  =  2  and  =  7,  we  realize  that  in  order  to  solve 
the  entire  system,  half  a  position  can  correspond  to  only  the  translation 
information  of  a  position.  Which  would  mean  we  would  have  to  define  3 
translation  positions,  where  2  additionally  have  orientation  information,  to 
perform  kinematic  synthesis.  This  gives  us  a  single  relative  rotation  and 
2  relative  translations.  If  we  were  to  define  more  than  2  orientations,  the 
rotational  component  of  the  system  would  be  overdetermined.  The  positions 
can  thus  be  defined  as. 


P^9  —  PddidPi 


12  —  -T  pjip-r  PRR 

^PRpPpRR 


—  Si2  +  bi2  +  +  b?. 


12 


Pl3  —  PddidP] 


12 


—  -512  +  bi2  +  e(s^3°  +  big) 


U2l 


13 


(74) 


where  we  can  see  they  share  the  same  orientation. 

From  the  relative  rotation  we  can  determine  R  joint  orientation  g  and 
angles  9  as, 


g  = 


>12 


l|b 


tan0  = 


ni\ 


i  =  2,3 


(75) 
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The  dual  part  can  then  be  solved  for  the  remaining  2  relative  translations 
to  obtain  the  moment  of  the  line  and  the  P  joint  orientation  h  with, 


0  1  0  dii  On  On  . 

g  =  bii  -  — (cos  Yh  +  sm— g  X  h),  t  =  2,3 


(76) 
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by  imposing  ||h||  =  1  and, 


^wO 

^12 


di2 

2 


Sin 


0l2 


^wO 

^13 


^13 

2 


Sin 


0l3 


(77) 


This  characterizes  the  RP  joint  formed  by  the  two  end-effector  edges. 
With  dii  and  h  known,  the  relative  transformation  from  the  end-effector 
of  the  P  joint  to  the  vertex  between  the  PR  chain  and  the  P  joint  can  be 
calculated  to  obtain  two  new  relative  transformations, 


Si2  —  PpRpSp{—d) 

>^13  =  PpRpSp{  —  d) 


—  Sl2  +  ^>^2  +  +  b°2) 

=  ■5^2'  +  ^^2  +  +  b?3) 


(78) 


The  procedure  follows  as  before  where  we  determine  the  new  system  using 
Eqn.  dZSD  and  Eqn.  (I7U1).  obtaining  all  the  joint  variables  and  structural 
parameters  of  the  system. 

The  entire  system  gives  a  single  unique  solution  for  a  set  of  3  translation 
positions  with  2  rotation  positions  for  each  end-effector.  The  method  for 
solving  the  RP-(R,P)  kinematic  structure  is  not  general  as  not  all  kinematic 
structures  can  be  split  into  two  non-overlapping  substructures  that  can  be 
solved  with  the  same  number  of  task  positions.  However,  this  example  shows 
a  novel  methodology  that  can  be  used  on  many  structures. 


10.  Conclusions 

In  this  paper  we  presented  a  methodology  for  the  kinematic  synthesis 
of  articulated  systems  with  a  tree  structure,  which  has  applications  on  the 
design  of  articulated  multi  fingered  hands  and  locomotion  systems,  among 
others.  The  design  process  follows  existing  techniques  for  the  dimensional 
synthesis  of  spatial  linkages,  however,  in  the  design  of  tree-like  topologies 
specific  issues  appear  that  are  explored  and  solved  here. 

The  method  is  based  on  representing  the  tree  as  a  rooted  graph  and 
performing  reduction  operations  in  order  to  simplify  the  initial  topology. 
The  forward  kinematics  equations  for  each  of  the  serial  chains  forming  the 
tree  articulated  system  are  stated  and  equated  to  a  set  of  task  positions,  and 
conditions  for  the  solvability  of  the  whole  tree  and  individual  subgraphs  or 
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branches  of  the  tree  are  derived.  The  inclusion  of  tree  articulated  systems 
among  possible  candidate  topologies  for  the  design  process  allows  to  extend 
dimensional  synthesis  to  systems  with  a  high  number  of  degrees  of  freedom 
and  more  complex  motion  tasks. 
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Figure  captions 

•  Figure  1:  Graph  representation  of  a  4R  manipulator  where  the  circle 
represents  the  root  and  the  square  represents  the  end-effector. 

•  Figure  2:  Reduction  of  a  complex  kinematic  structure  with  a  Sarrus 
linkage  to  a  tree  graph. 

•  Figure  3:  Both  branches  with  fewer  than  dim(£)  =  6  joints  form  sub¬ 
graphs  G1  and  G2  that  are  solvable  separately. 

•  Figure  4:  Rooted  tree  graph  of  an  anthropomorphic  hand  model. 

•  Figure  5:  Rooted  tree  graph  of  the  RP-(R,P)  mechanism. 

Table  captions 

•  Table  1:  Design  parameters  for  different  serial  chains. 

•  Table  2:  All  solvable  subgraphs  of  the  anthropomorphic  hand  model. 

•  Table  3:  Solvability  of  the  different  subgraphs  of  the  PR-(R,P)  mech¬ 
anism. 
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Tables 


Table  1:  Design  parameters  for  different  serial  chains 


Linkage  rij  Ug  d  m  mF  £ 

P  1  2  3  2  1  2 


R  14  6 

H  15  6 

C  2  4  6 

T  2  5  6 

E  3  2  6 

S  3  3  6 

PP  2  2  3 

RP  2  6  6 

RR  2  8  6 

PPR  366 
PRP  3  8  6 

PRR  3  10  6 

RRR  3  12  6 


2 

3 

SE{‘i) 

2 

2 

SE(3) 

2 

2 

5 

SE(3) 

2- 

5 

6 

SE{3) 

3 

2 

oo 

SE{3) 

2 

oo 

oo 

SE{3) 

3 

1 

3 

2- 

2 

7 

SE{3) 

3 

5 

9 

SE{3) 

3 

2 

oo 

SE{3) 

3- 

2 

oo 

SE{3) 

4i 

3 

5 

oo 

SE{3) 

5 

oo 

oo 

SE{3) 
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Table  2  :  All  solvable  subgraphs  of  the  anthropomorphic  hand  model 


Subgraph  b  r  m  Uf  = 


3R-(4R,4R,5R,5R,5R) 

3R-(4R,5R,5R,5R) 

3R-(4R,4R,5R,5R) 

3R-(4R,5R,5R) 

3R-(4R,4R,5R) 

3R-(4R,4R) 


5 

26 

27 

780 

4 

22 

45 

1056 

4 

21 

29 

672 

3 

17 

69 

1224 

3 

16 

33 

576 

2 

11 

45 

528 

Table  3:  Solvability  of  the  different  subgraphs  of  the  PR-(R,P)  mechanism 


Subgraph 

m 

Comments 

PR-(R,P) 

2- 

2 

7 

Full  system,  rotational  and  translational  components  solvable 

PRR 

3 

5 

oo 

Full  system  and  rotational  component  solvable 

PRP 

CO 

2 

oo 

Only  rotational  component  solvable  <  m  and  0  Q"*" 
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Figures 


Figure  1:  Graph  representation  of  a  4R  manipulator  where  the  circle  repre¬ 
sents  the  root  and  the  square  represents  the  end-effector. 


Figure  2:  Reduction  of  a  complex  kinematic  structure  with  a  Sarrus  linkage 
to  a  tree  graph. 
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Figure  3:  Both  branches  with  fewer  than  dim(£)  =  6  joints  form  subgraphs 
G1  and  G2  that  are  solvable  separately. 


Figure  4  :  Rooted  tree  graph  of  an  anthropomorphic  hand  model. 


Figure  5:  Rooted  tree  graph  of  the  RP-(R,P)  mechanism. 
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Single  Degree-of-Freedom  Exoskeleton  Mechanism  Design  for  Thumb 

Rehabilitation* 
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Abstract — This  paper  presents  the  kinematic  design  of  a 
spatial,  1-degree-of-freedom  closed  linkage  to  be  used  as  an 
exoskeleton  for  thumb  motion.  Together  with  an  already- 
designed  finger  mechanism,  it  forms  a  robotic  device  for  hand 
therapy.  The  goal  for  the  exoskeleton  is  to  generate  the  desired 
grasping  and  pinching  path  of  the  thumb  with  one  degree  of 
freedom,  rather  than  using  a  system  actuating  all  its  joints 
independently.  In  addition  to  the  path  of  the  thumb,  additional 
constraints  are  added  in  order  to  control  the  position  and  size 
of  the  exoskeleton,  reducing  physical  and  sensory  interference 
with  the  user. 

1.  INTRODUCTION 

Robotic  devices  have  been  shown  to  be  capable  of  au¬ 
tomating  the  strenuous  and  repetitive  nature  of  movement 
therapy  after  stroke  or  other  neurological  injury  (for  an 
introduction,  see  [1],  [2]).  Additionally,  robotic  devices  give 
scientists  a  new  investigative  tool  for  recording  progress 
during  movement  training  and  for  determining  the  factors 
that  promote  functional  recovery.  Of  particular  interest  is 
the  ability  to  design,  implement,  and  test  assistive  control 
strategies.  Many  different  control  strategies  have  been  de¬ 
veloped  (see  review:  [3]).  The  most  promising  approaches 
fall  into  the  assist-as-needed  category,  where  an  attempt  is 
made  to  vary  the  level  of  assistance  to  match  the  impairment 
level  of  the  patient.  For  example,  [4]  presents  an  assist-as- 
needed  controller  that  learns  a  model  of  the  patients  abilities 
while  simultaneously  reducing  assistance  when  the  patient 
performs  well.  The  result  is  a  robotic  device  that  can  help 
patients  complete  movements  but  continuously  challenges 
them  to  try.  The  efficacy  of  these  and  other  control  strategies 
has  been  documented  ([5],  [6],  [7])  but  it  remains  unclear 
what  specific  controller  characteristics  increase  patient  learn¬ 
ing  during  therapy. 

Proper  evaluation  of  assist-as-needed  control  strategies  is 
dependent  upon  the  abilities  of  the  robotic  device.  Ideally, 
the  device  would  be  able  to  apply  any  force  at  any  speed 
at  any  location  along  the  movement  trajectory.  In  practice, 
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this  is  impossible,  but  can  be  approached  in  a  robotic 
device  by  keeping  apparent  inertia  and  friction  low,  and  the 
controllable  force  bandwidth  high.  To  achieve  these  features, 
we  are  developing  an  exoskeleton  device  for  the  fingers  and 
thumb,  with  the  actuators  mounted  along  the  forearm  where 
their  effect  on  device  inertia  is  minimized.  In  addition,  the 
actuators  are  high-speed,  low-friction  linear  motors,  which 
allows  for  high-bandwidth  control.  These  characteristics  have 
not  been  fully  achieved  in  previous  robotic  hand  and  wrist 
devices,  including  end-effector,  glove,  and  exoskeleton  type 
devices  ([8],  [9],  [10]). 

The  device  presented  in  this  paper  is  obtained  following  a 
new  methodology  for  the  design  of  exoskeletons.  Tradition¬ 
ally,  exoskeletons  are  designed  so  that  they  try  to  align  with 
the  human  joint  axes  of  motion  [8].  This  assumes  that  the 
location  of  the  axis  can  be  accurately  known,  and  in  addition, 
that  such  a  fixed  axis  exists  for  the  range  of  motion  of  the 
joint  or  set  of  joints,  which  is  not  always  the  case.  A  clear 
example  of  complex  kinematic  modeling  is  the  thumb,  for 
which  precise  detection  methods  such  as  MRI  segmentation 
[11]  show  that  considering  fixed  rotational  axes,  especially 
for  the  CMC  joint,  is  not  a  good  approximation;  see  also  [12]. 
Using  the  methodology  described  in  this  paper,  based  on 
kinematic  synthesis,  it  is  not  necessary  to  know  the  geometry 
of  the  hand,  but  rather  to  have  a  description  of  its  motion  at 
the  point  of  attachment. 

To  meet  the  design  needs  for  the  rehabilitation  applica¬ 
tion  described  above,  a  lightweight  single-degree-of  freedom 
mechanism  has  been  selected  for  following  the  paths  of  the 
thumb  during  simple  pinch  and  grasping  movements.  The 
complete  exoskeleton  device  consists  of  two  separate  single 
degree-of-freedom  exoskeleton  mechanisms:  one  for  finger 
curling  motions,  whose  design  was  presented  in  [13],  and 
one  for  thumb  motions,  presented  in  this  paper.  The  resulting 
robot  will  be  able  to  assist  in  common,  naturalistic  finger 
and  thumb  motions.  As  such,  the  therapy  delivered  should 
translate  to  a  wide  range  of  functional  tasks,  even  if  the 
degrees-of-freedom  of  the  robot  are  minimal. 

The  linkage  to  perform  the  thumb  motion  was  selected 
among  several  single-degree-of-freedom  spatial  closed  link¬ 
ages  with  four  to  six  links,  with  a  single  end-effector  for 
controlling  the  orientation  and  position  of  the  proximal 
phalanx  of  the  thumb.  In  this  approach,  the  mechanism 
will  be  actuated  with  a  single  actuator,  and  so  the  design 
of  the  mechanism  is  responsible  for  appropriately  shaping 
the  thumb  motion.  In  addition,  the  designed  mechanism  is 
confined  to  the  back  of  the  hand,  so  as  to  minimize  sensory 


feedback  interference,  and  to  allow  the  mechanism  to  be 
manufactured  with  minimal  size.  This  combined  with  the 
intended  location  of  the  actuators  will  allow  the  device  to  be 
constructed  with  low  apparent  inertia. 

II.  Thumb  Mechanism  Design 

A.  Design  objectives 

The  human  thumb  presents  a  complex  3D  motion  that 
can  be  modeled,  depending  on  the  needed  accuracy,  with 
three  to  four  degrees  of  freedom,  and  using  variable  joint 
axes.  For  this  project,  the  targeted  task  of  the  thumb  is  a 
single  spatial  path  going  from  index  pinching  to  contacting 
the  tip  of  the  fingers.  We  postulate  that  it  is  still  possible 
to  use  simplified,  low-dof  linkages  for  assisting  in  this 
motion.  We  focus  on  a  set  of  closed,  spatial  overconstrained 
and  non-overconstrained  four-bar  to  six-bar  linkages  with 
low  mobility  that  present  the  desired  characteristics  for  this 
application,  see  [14]  and  [15].  The  spatial  mechanism  is  to 
be  attached  to  the  proximal  phalanx  of  the  thumb.  The  goal 
is  to  find  a  single-dof  mechanism  whose  path  is  as  close  to 
the  experimental  thumb  path  as  possible,  while  complying 
with  additional  size  and  placement  constraints. 

B.  Thumb  data 

The  method  is  based  on  synthesize  a  linkage  to  follow  as 
closely  as  possible  experimental  paths  of  the  human  thumb. 
The  thumb  data  was  acquired  using  a  Vicon  motion  tracking 
system.  The  set  up  we  used  had  eight  infrared  cameras  set 
around  the  room,  primarily  for  larger  applications;  however 
it  worked  very  well  for  the  hand  motions.  The  markers  that 
are  used  with  the  system  are  small  white  balls  that  reflect 
the  inferred  light.  We  used  arrays  with  the  markers  placed 
1.25  inches  apart  making  it  easy  to  collect  data  in  the  three 
dimensions.  In  order  to  assess  the  exact  location  of  the  fixed 
link  with  respect  to  the  hand,  additional  sets  of  sensors  are 
placed  on  the  arm,  see  Figure  1 


Fig.  1.  Markers  placed  in  the  thumb  and  data  capture  setup 

The  several  experimental  paths  so  obtained  were  separated 
for  clarity;  Figure  2  shows  one  typical  point  path,  seen  from 
the  reference  frame  of  the  motion  capture  system. 

For  the  design  of  spatial  motion,  it  is  sometimes  advan¬ 
tageous  to  work  with  relative  displacements.  Each  relative 
displacement  expresses  a  motion  of  the  thumb  from  a  refer¬ 
ence  configuration,  taken  as  the  thumb  position  at  the  first 
frame.  Each  displacement  can  be  modeled  as  an  axis,  plus 
a  rotation  about  and  a  translation  along  the  axis.  We  encode 
this  information  as  a  screw,  where  the  screw  axis  is  the  axis 
of  the  displacement  and  the  pitch  is  the  ratio  of  translation 
to  rotation  for  that  displacement. 


Fig.  3.  Thumb’s  proximal  phalanx  path:  screw  surface  of  relative  screw 
axes 

Figure  3  shows  the  displacements  of  the  thumb’s  proximal 
phalanx  path  as  screw  axes  with  a  pitch,  where  the  screw 
lengths  are  proportional  to  the  pitch.  The  screw  axes  of 
the  displacements  with  their  pitches  generate  a  screw  hyper¬ 
surface.  This  representation  has  all  the  information  of  the 
motion  except  for  the  value  of  the  rotation,  which  can  be 
calculated  independently. 

C.  Mechanism  Selection 

In  order  to  accomplish  simplicity  together  with  spatial 
motion  under  a  one-degree-of-freedom  system,  an  initial  set 
of  closed  spatial  linkages  with  four  to  six  links  and  standard 
revolute  (R),  prismatic  (P)  and  cylindrical  (C)  joints  has 
been  selected.  Some  of  these  linkages  are  overconstrained, 
while  others  are  trivial  linkages,  all  of  them  with  mobility 
equal  to  one  [14],  [15].  Figure  4  shows  the  topology  of  the 
spatial  CCCC  linkage  (a  linkage  with  four  cylindrical  joints); 
candidate  linkages  with  four  links  are  particular  cases  of  this 
one,  obtained  by  making  some  of  the  joint  variables  (Oi^Vi) 
constant. 

Similarly,  the  closed,  spatial  CCC-CCC  linkage  can  be 
seen  as  the  general  case  for  the  six-bar  candidate  linkages, 
see  Figure  5.  In  particular,  the  following  four-bar  linkages: 


Fig.  4.  A  spatial  4-bar  CCCC  linkage 
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Fig.  5.  A  spatial  6-bar  CCCCCC  linkage 


RC-CC,  RP-RP,  RR-RR,  and  the  following  six-bar  linkage: 
CRR-RRR  were  selected  as  candidates.  Here,  the  dash  sepa¬ 
rating  joints  indicates  where  the  end-effector,  or  attachment 
to  the  thumb,  is  being  placed. 

In  order  to  asses  the  suitable  topology  for  the  thumb 
linkage,  the  workspace  of  relative  displacements  has  been 
analyzed  for  each  of  these  linkages.  Figure  6  shows  a  typical 
workspace  for  the  candidate  linkage. 

From  inspection  of  the  workspace  shape,  the  candidate 
linkages  to  be  used  for  dimensional  synthesis  are  the  RR- 
RR,  the  RC-CC  and  the  CRR-RRR.  The  RRRR  is  an 
overconstrained  linkage,  while  the  other  two  present  trivial 
mobility  equal  to  one. 

Among  the  properties  of  these  linkages  that  are  useful 
for  our  application  we  can  cite  the  1-dof  motion,  requiring 
only  one  actuator,  and  topological  simplicity  while  creating  a 
complex  motion.  In  addition,  overconstrained  linkages  have 
other  advantages,  such  as  inherent  structural  rigidity. 


Fig.  6.  Workspaces  of  the  CCCR,  the  RRRR,  the  RPRP  linkages 


kinematics  equations  of  the  CRR  and  RRR  chains  using  dual 
quaternions  [16], 

A6>2,  A^s)  =  P[(cos  +  sin  ^Sj) 

i=l 

■r-r  A/9-  A/9- 

Qrrr{^0q,  A6'5,  Mi)  =  JJ  (cos  +  sin  ^Sj) 

iG{6,5,4} 

(1) 


whereA^i  =  -f  eAd^  is  the  dual  angle,  and  all  =  0 
except  di  corresponding  to  the  cylindrical  joint.  The  forward 
kinematics  so  expressed  represent  the  set  of  relative  displace¬ 
ments  of  the  chain  with  respect  to  a  reference  configuration. 

In  order  to  create  the  design  equations,  we  minimize 
the  distance  between  the  displacements  captured  in  Section 
II.B.  and  the  displacements  of  the  candidate  chain.  We 
perform  dimensional  synthesis,  that  is,  the  goal  is  to  find 
the  location  and  dimensions  of  the  mechanism  that  performs 
approximately  the  task. 

The  design  equations  are  created  by  equating  the  forward 
kinematics  of  the  mechanism  to  each  of  the  discrete  positions 
obtained  from  the  motion  capture.  If  we  denote  each  finite 
displacement  of  the  thumb  as  we  can  create  the  relative 
displacements  with  respect  to  the  first  position  of  the  thumb, 
pii  _  to  yield  design  equations 


D.  Mechanism  Design  Equations 

In  this  section,  the  design  equations  corresponding  to  the 
CRR-RRR  mechanism  are  presented.  The  reason  to  do  so  is 
that  it  turned  out  to  give  the  most  fitted  mechanisms  for  the 
task. 

Let  us  consider  the  closed  CRR-RRR  linkage  as  two  serial 
chains,  CRR  and  RRR,  joined  at  their  end-effectors.  The  axes 
are  labeled  as  shown  in  Figure  5,  starting  at  the  fixed  C  joint 
and  going  around  up  to  the  final  fixed  R  joint.  For  every 
joint  L  let  =  Si  -f  es^  be  the  joint  axis,  with  rotation  Oi, 
and  slide  (for  the  C  joint  only)  di.  We  express  the  forward 


QcRR{M{,Aei,Aei)=P^\ 
QRRRiAelAdi,Adi)=P^\  i  =  2,...,m.  (2) 

In  these  equations,  the  variables  we  are  interested  in 
are  what  we  call  the  structural  variables,  which  are  the 
Plucker  coordinates  of  the  joint  axes  Si  =  Si  +  es^  at  the 
reference  configuration.  In  addition,  the  optimization  process 
outputs  the  angles  of  the  chains  in  order  to  reach  the  thumb 
displacements. 

To  complete  the  system  of  equations  in  (2),  we  impose  size 
constraints  on  the  mechanism  so  that  it  can  be  attached  to  the 


lower  arm  and  with  reasonable  dimensions.  In  particular,  for 
the  six-link  CRR-RRR  mechanism,  we  add  the  constraints  of 
distance  between  both  fixed  axes  and  also  between  the  fixed 
axes  and  the  thumb. 

Si  •  Se  =  cos  a  -h  easing 

Si  •  =  cos/5 -h  e6sin/5  (3) 

where  is  the  screw  axis  of  the  first  thumb  position,  and  we 
fix  the  distance  between  the  axes  along  the  common  normal, 
a,  to  a  value  between  50mm  and  150mm,  and  the  distance 
between  the  thumb  attachment  and  the  coupler  axes,  b,  to 
similar  values. 

E.  Implementation  of  the  Design  Equations 

Ten  positions  were  selected  from  the  thumb  path,  and  the 
first  frame  was  taken  as  the  reference  configuration.  Each 
forward  kinematics  equality  is  composed  of  8  equations,  and 
forward  kinematics  are  written  for  both  serial  chains  com¬ 
posing  the  mechanism.  This  gives  a  total  of  144  nonlinear 
equations.  In  addition,  we  have  the  constraints  of  (3).  Overall, 
we  have  147  equations. 

The  variables  to  solve  for  are  the  Plucker  coordinates 
of  the  axes,  that  is,  six  parameters  per  axis,  and  the  joint 
variables  to  reach  each  thumb  position.  The  total  is  97 
unknowns. 

The  equations  were  solved  using  a  Levenberg-Marquardt 
nonlinear,  unconstrained  solver  implemented  in  Java.  This  is 
based  on  public  domain  MINPACK  routines,  translated  from 
FORTRAN  to  Java  by  Steve  Verrill  [17]. 

III.  Results 

The  best  results  were  obtained  for  the  CRR-RRR  mecha¬ 
nism.  One  of  the  sets  of  ten  equally- spaced  positions  selected 
from  the  thumb  data  can  be  seen  in  Figure  9.  The  equations 
were  run  14  times  for  three  different  sets  of  positions  chosen 
from  the  thumb  frames.  The  distance  to  the  desired  path  has 
been  optimized  by  minimizing  the  distance  at  each  step.  The 
overall  error  of  the  function  was  smaller  than  0.03,  and  it 
took  a  variable  amount  of  time,  from  a  few  minutes  to  a  few 
hours,  to  find  solutions.  For  these  14  runs,  14  considerably 
different  solutions  were  found. 

Out  of  these  14  solutions,  2  linkages  were  selected  because 
of  their  overall  dimensions  and  placement  on  the  hand. 
Figure  7  shows  the  SolidWorks  model  of  those  solutions, 
named  candidate  I  and  II. 

As  overall  solution,  we  selected  the  mechanism  with 
the  best  combination  of  fit  to  the  path,  dimensions  and 
placement.  Due  to  the  potentially  very  large  number  of 
solutions  for  this  problem,  not  all  the  solution  space  has 
been  searched  and  hence  we  cannot  assume  that  the  selected 
candidate  is  the  optimal  one,  but  rather  an  acceptable  one. 

Figures  8  and  9  present  the  actual  motion  of  the  linkage  as 
compared  to  the  thumb  path  and  design  poses.  Even  though 
there  is  some  small  divergence  in  the  paths,  we  must  point 
out  that  it  is  of  the  order  of  the  variability  of  the  several  paths 
observed  in  the  motion  capture  data,  rendering  an  overall 
motion  that  is  within  the  normal  thumb  actuation. 


Rapid  prototypes  have  been  built  in  order  to  assess  the 
manufacturing  and  to  better  design  the  hand  attachment  and 
compatibility  with  the  finger  exoskeleton.  Figure  10  shows 
one  of  the  prototype  linkages  mounted  on  the  hand. 

IV.  Conclusions  and  Future  Work 

This  paper  presents  a  task-oriented  design  methodology 
for  exoskeletons.  Previous  work  targeted  planar  motion, 
while  this  paper  focuses  on  the  application  to  spatial  motion. 
In  particular,  we  apply  the  methodology  to  develop  a  1-dof 
thumb  exoskeleton  for  rehabilitation.  The  kinematic  design 
is  followed  by  a  detailed  mechanical  design  and  prototyping. 

The  main  advantage  of  this  method  with  respect  to  pre¬ 
vious  exoskeleton  designs  is  that  it  does  not  need  any 
assumption  about  location  and  type  of  joints  in  the  subject; 
the  exoskeleton  is  going  to  follow  the  path  that  is  selected  as 
task  regardless  of  the  skeleton  structure  that  generates  it.  This 
allows  for  the  creation  of  new  and  innovative  exoskeleton 
designs.  The  high  number  of  solutions  obtained  mean  more 
choices  for  the  designer  regarding  placement,  size,  and 
inertia  of  the  exo skeleton. 

The  final  designs  presented  in  this  paper  have  been  tested 
for  the  desired  path  and  the  results  seem  to  be  acceptable. 
The  placement  of  the  mechanism  on  the  lower  arm  and  close 
to  the  wrist  is  also  according  to  specifications. 

The  next  step  is  the  force  analysis  of  the  mechanism.  This 
is  important  because  of  the  spatiality  of  the  linkage,  and  will 
allow  us  to  determine  the  best  joint  to  place  the  actuator. 


Fig.  8.  One  of  the  thumb  paths  (thin  frames)  with  superimposed  linkage 
path  (thick  lines) 


Fig.  9.  Comparison  between  design  positions  (thin  lines)  and  linkage 
positions  (thick  lines) 


Future  research  for  the  mechanism  optimization  includes 
identifying  a  small  subset  of  structural  variables  that,  when 
modified,  will  produce  a  new  mechanism  to  track  a  similar 
path  created  by  a  slightly  different  thumb.  In  a  fashion  similar 
to  [18],  this  will  allow  the  mechanism  to  be  re-configured  to 
varying  subject  sizes. 
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Abstract — Estimation  of  joint  angles  for  human  joints  is 
important  for  many  applications  in  Bioengineering.  Most  of 
the  existing  angular  joint  sensors  rely  on  the  assumption  of 
the  knowledge  of  the  type  of  motion  and  location  of  the  joint. 
This  paper  presents  a  new  design  for  the  measurement  of  finger 
joint  angular  motion.  The  design  presented  here  consists  of  an 
exoskeleton,  designed  to  fit  the  finger  motion,  in  which  we  can 
relate  the  angular  displacement  of  its  links  to  the  change  in 
orientation  of  the  phalanx  under  consideration.  Unlike  other 
designs,  the  exoskeleton  does  not  need  any  information  about 
the  actual  anatomy  and  dimensions  of  the  hand  in  order  to 
provide  with  the  angular  information.  The  design  is  to  be  used 
in  myoelectrical  signal  identification. 

1.  INTRODUCTION 

Accurate  hand  pose  tracking  and  finger  joint  measure¬ 
ments  are  important  research  topics  in  bioengineering  fields 
for  different  applications;  the  design  of  exoskeleton  and  pros¬ 
thetic  devices  and  the  implementation  of  control  algorithms 
are  a  few  of  those.  Almost  all  currently  available  prosthetics 
using  EMG  or  sEMG  sensors  compute  some  threshold  value 
for  the  corresponding  finger  joint  positions  [1].  In  most  cases, 
models  are  obtained  with  the  smoothed  sEMG  data  as  input 
and  the  respective  smoothed  finger  angle  data  as  output.  The 
dynamic  model  obtained  allows  the  instantaneous  control  of 
the  finger  motions.  Eor  these  and  other  reasons,  to  relate 
the  surface  EMG  signals  to  the  finger  motion,  and  also  for 
gesture  recognition,  researchers  have  been  using  data  gloves 
and  expensive  infrared  sensors  [2] .  These  devices  tend  to  be 
expensive  and  affected  by  noise;  in  the  case  of  glove  devices, 
the  fitting  greatly  influences  the  measurement  error  [3].  In 
addition,  the  accuracy  of  the  result  depends  on  a  faithful 
underlying  hand  model,  which  is  a  complex  problem  on  its 
own  [4].  This  paper  presents  a  novel  approach  to  estimate 
the  finger  joint- angles  that  can  be  applied  for  modeling  of 
surface  electromyography  (sEMG)  signals. 

The  approach  presented  here  is  based  on  creating  an 
exoskeleton  device,  which  can  be  attached  to  the  hand,  that 
links  in  a  one-to-one  relation  the  angular  pose  of  the  phalanx 
under  consideration  to  the  relative  angle  between  two  links 
of  the  exoskeleton.  This  relative  angle  is  easy  to  sense  in 
an  accurate  and  inexpensive  fashion.  The  exoskeleton  design 
follows  the  approach  of  [5]  and  [6]. 

In  order  to  design  the  exoskeleton,  a  camera  vision  system 
is  used  to  track  the  hand  motion.  Non-contact  technologies 
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are  mostly  vision-based  or  use  infrared  or  magnetic  technolo¬ 
gies.  Most  of  the  focus  in  single-camera  tracking  has  been 
with  detecting  the  region  of  interest  (ROI)  of  the  hand.  Some 
research  has  attempted  to  create  simplified  hand  models 
through  markerless  detection  [7],  [8].  Work  has  also  been 
done  using  markers  [8]  and  multi  camera  systems  [9].  In  this 
research  we  are  using  a  marker-based  detection  technique  to 
get  information  about  the  finger  motion. 

Using  the  vision  information  as  an  input,  the  kinematic 
synthesis  of  the  mechanism  is  performed  to  obtain  the 
exoskeleton-based  joint  angle  sensor.  After  that,  a  sensitivity 
analysis  is  performed  in  order  to  decide  the  location  of 
the  sensor.  The  linkage  analysis  yields  the  angular  relation 
between  the  sensed  angle  and  the  limb  orientation. 

II.  Einger  Exoskeleton  Design 

It  is  important  to  notice  that  the  internal  structure  of 
the  hand  -the  skeleton-  is  not  a  part  of  the  exoskeleton 
mechanism.  The  mid  phalanx  of  the  finger  is  attached  to 
the  coupler  of  the  linkage,  as  indicated  in  Eigure  1,  and 
the  whole  mechanism  is  placed  on  the  dorsal  carpal  of  the 
hand.  The  exoskeleton  is  designed  for  the  coupler  to  follow 
a  task  motion  -in  this  case,  the  motion  of  the  phalanx. 
The  exoskeleton  mechanism  is  designed  to  be  light  and 
have  a  smooth  motion  over  the  range  of  the  finger,  so  to 
minimize  dynamic  loading  effects  on  the  signal  under  study. 
An  angular  potentiometer  is  to  be  attached  to  one  of  the 
joints  of  the  linkage,  and  the  sensed  angle  is  to  be  related  to 
the  angle  of  the  coupler  with  respect  to  the  fixed  link. 

Type  synthesis,  the  selection  of  the  topology  of  the 
mechanism  to  be  used  as  exoskeleton,  is  a  first  step  in  the 
design  process.  Eor  this  sensor,  the  approach  has  been  to 
try  to  use  the  simplest  mechanism  possible,  for  decreased 
complexity,  weight  and  inertia  on  the  finger.  The  planar  four- 
bar  mechanism  was  tried  first,  but  it  was  not  successful  due 
to  the  interference  of  the  links  with  the  finger  and  the  dorsal 
part  of  the  hand  in  all  designs.  The  six-bar  linkage  is  the 
next  simplest  one.  It  allows  positioning  the  links  away  from 
the  finger  so  that  no  interference  appears,  while  matching  the 
planar  1-dof  motion  of  the  single  finger  joint.  Thus,  a  planar, 
single-dof  six-bar  linkage  (see  Eigure  6)  has  been  selected 
as  the  exoskeleton  topology. 

III.  Einger  Input  Data 

The  experimental  approach  to  get  the  data  is  based  on  the 
principle  that  the  pose  of  a  calibrated  camera  can  be  uniquely 
determined  from  a  minimum  of  four  coplanar  but  non- 
collinear  points.  Thus,  two  squares  attached  to  the  proximal 
phalanges  and  to  the  dorsal  part  of  the  carpal  are  used  as 


shown  in  Figure  3.  Then  the  index  finger  is  moved  to  its 
different  positions/reaches.  While  moving  the  index  finger, 
different  frames  are  captured  using  a  Dragonfly  2  camera 
from  GreyPoint,  with  a  Fujinon  l:1.4/9mm  lens,  interfaced 
with  a  computer  using  Lab  VIEW.  The  Lab  VIEW  program 
captures  and  saves  multiple  images  into  the  hard  disk  [10]. 
Once  the  frames  are  saved,  sample  frames  from  different 
orientation  of  the  index  finger  are  selected  for  processing. 

In  order  to  compute  pose  for  3D  to  2D  correspondences 
of  a  planar  target,  the  algorithm  used  is  based  on  Hager  and 
Schweighofer  [11].  The  algorithm  is  customized  to  obtain  a 
set  of  task  positions  from  a  video  stream  of  a  hand  moving 
with  markers.  As  it  is  clearly  visible  on  the  figure,  the  square 
on  the  dorsal  carpal  is  used  as  a  reference  position,  as  the 
relative  position  between  this  square  and  the  fixed  joint  of 
the  mechanism  is  always  constant  while  the  index  finger  is 
moving. 

The  markers  are  used  to  estimate  the  pose,  which  consists 
of  the  position  and  orientation  of  the  finger.  An  important 
aspect  of  this  setup  is  the  geometry  of  the  markers.  The 
geometry  of  a  marker  affects  directly  its  performance  and 
usability  in  computer  vision  applications.  The  design  used 
by  this  project  is  a  simple  white  square  with  a  smaller  black 
square  inside  as  shown  in  Figure  3.  It  gives  four  sharp 
visible  corners  that  form  a  perfect  square  to  be  used  to 
find  the  3D  pose  of  the  marker.  Figure  5  shows  a  properly 
detected  marker.  It  is  important  for  these  markers  to  be 
completely  rigid  for  accurate  pose  estimation.  For  detection 
of  the  candidate  points  the  Harris  corner  and  edge  detector 
algorithm  [12]  is  used.  To  get  a  better  result  in  both  the 
detection  and  pose  recovery,  image  segmentation  is  also 
performed  so  that  the  square  corners  are  visible  enough  to 
be  detected  as  shown  in  Figure  5.  The  overall  methodology 
to  design  the  exoskeleton-based  sensor  is  shown  in  Figure  2. 

The  3D  pose  recovery  algorithm  can  map  3D  reference 
points  from  the  2D  image  coordinates.  It  takes  a  set  of 
non-collinear  3D  coordinates  of  reference  points  Pi  = 
{xi^Ui^  Zif  =  1,  ...n,  n  >  3.  These  points  can  be  expressed 
in  an  object-centered  reference  frame.  The  corresponding 


Fig.  2.  The  methodology  adopted  to  design  the  exoskeleton  based  position 
sensor 


Fig.  3.  The  captured  image  of  the  index  finger  with  the  square  blobs  on  it 


Fig.  4.  The  index  finger  movement  and  the  square  blobs 


Fig.  5.  Corner  detection  of  one  frame  done  by  Harris  corner  detection 

camera- space  coordinates  are  =  (x-,  z')^.  These  two 

points  are  related  by  the  rigid  transformation 

Qi  —  RPi  +  (1) 

where  R  and  t  are  the  rotation  matrix  and  translation  vector 
respectively.  Using  this  approach  we  obtain  a  transformation 
matrix  Tpi  for  each  position  of  the  target  point  (the  point 
from  the  square  at  the  proximal  phalanx)  with  respect  to  the 
camera  and  we  also  obtained  Td  (the  point  from  the  square 
at  the  carpal)  with  respect  to  the  camera.  In  order  to  reference 
locally  all  movements  of  the  target  point,  we  use  coordinate 


transformation  as  Tcp  =  T~-^Tpi.  After  getting  Tcp,  the 
transformation  from  the  reference  frame  at  the  carpal  to 
the  proximal  phalange,  the  design  equations  are  formulated 
based  on  the  candidate  mechanism  . 

IV.  Exoskeleton  Design  Equations 

Eor  this  application,  the  desired  mechanism  is  required 
to  do  two  things:  firstly,  it  should  follow  the  trajectories 
described  by  the  collected  data;  and  secondly,  there  should  be 
a  one-to-one  correspondence  between  the  orientation  of  the 
MIP  joint  of  the  finger  to  one  of  the  joints  of  the  mechanism. 

The  six-bar  linkage  is  the  simplest  closed,  1-dof  planar 
linkage  able  to  follow  the  collected  trajectories  accurately. 
On  the  other  hand,  being  a  simple,  one-dof  linkage,  the 
relationships  between  all  its  angles  and  the  driving  joint  angle 
are  well  known  and  can  be  related  to  the  angle  of  the  coupler 
and  the  MIP  joint. 

The  variables  defined  for  the  six-bar  mechanism  are  shown 
in  Eigure  6,  where  6>i,  O2,  Os,  O4  and  0^  are  the  joint  angles 
and  the  remaining  parameters  (i.e.,  six,  siy,  S4x,  s^y,  a, 
h,  h,  h,  h,  h,  Oi,  62,  7  and  (5)  are  the  structural 

variables  of  the  mechanism.  Compared  with  the  more  com¬ 
mon  four-bar  mechanisms,  six-bar  mechanisms  have  more 
design  variables,  therefore  with  an  appropriate  design,  six- 
bar  mechanisms  can  adapt  to  a  wider  number  of  motions. 

Using  the  variables  defined  in  Eigure  6,  the  forward 
kinematic  equations  for  a  planar  six-bar  mechanism  are 
defined  as  [13],  [14] 

six~^h  cos(^i)  +  I2  cos(^i  -f  ^2  +  7)  + 

a  cos(^i  +  ^2  “1"  7  ^3  ~  —  0 

sin(^i)  +  I2  sin(^i  O2  7)  + 
a  sin(^i  O2  'y  Os  (y,)  —  Py  =  0 
sixPh  cos(6>i)  +  62  cos(6>i  +  O2)- 
{S4x  +  h  cos(6>4  +  (5))  =  0 
siyPh  sin(6>i)  +  62  sin(6>i  -1-  O2)- 
{s4y  +  h2  sin(6>4  +  (5))  =  0 
sixPh  cos(^i)  +  I2  cos(^i  O2 

Is  COs(^i  +  ^2  +  7  Os)  ~  {I5  COs(^4  +  ^5)“!“ 

I4  COs(6>4)  +  S4x)  =  0 
siy-\-li  sin(^i)  +  I2  sin(^i  H-  ^2  +  7)“^“ 

Is  sin(^i  +  ^2  +  7  +  Os)  —  {I5  sin(^4  -|-  ^5)  + 

I4  sin(6>4)  +  54^)  =  0.  (2) 

Erom  the  set  up  we  can  also  identify  the  following  anglular 
relation 

0iP02p^  +  0sPa  +  P-  ip  =  0.  (3) 

The  equations  given  above  in  (2)  and  (3)  were  used  to 
determine  the  trajectory  that  point  P  and  its  attached  frame 
would  follow  through  the  operation  of  the  mechanism.  The 
axis  shown  in  Eigure  6  indicates  the  angle  (p  is  the  same  as 
the  one  of  the  MIP  joint  of  the  finger. 


Fig.  6.  The  six-  bar  linkage  with  variables  used 


Nine  positions  are  selected  from  the  index  finger  trajectory. 
The  end-effector  location  at  the  coupler  link  yields  two 
equations,  and  the  loop  equations  account  for  four  equations 
for  each  position.  This  gives  a  total  of  52  nonlinear  equations. 
In  addition,  we  have  9  anglular  equations;  overall,  we  have 
63  equations.  The  total  variables  to  be  found  are  61  in  total. 
Some  auxiliary  equations  are  added  to  limit  the  size  of  some 
key  links  in  the  linkage. 

The  equations  are  solved  using  a  Levenberg-Marquardt 
nonlinear,  unconstrained  solver  implemented  in  Java.  This  is 
based  on  public  domain  MINPACK  routines,  translated  from 
EORTRAN  to  Java  by  Steve  Verrill  [15]. 

The  process  yields  many  solutions.  Each  solution  took 
an  average  of  7.5  minutes  on  a  2.2GHz  Intel  Core  i7.  We 
solved  several  times,  in  groups  of  50  runs,  out  of  which 
approximately  3  solutions  were  acceptable  each  time.  The 
acceptability  was  defined  in  terms  of  position  on  the  hand, 
overall  dimensions  and  hand  interference.  The  accepted 
candidates  were  modeled  using  CAD  software  in  order  to 
select  the  final  design. 

V.  Angular  Measurement 

Erom  the  design  of  the  mechanism  it  is  shown  that  the 
angle  ip  corresponds  to  the  orientation  of  the  MIP  joint  of 
the  finger.  Thus,  using  (3)  we  can  get  the  value  of  (p  for 
every  finite  displacement  of  the  finger  in  terms  of  the  angles 
Oi,  O2,  7,  Os,  (y  and  f3.  Here  a,  7  and  [3  are  constants,  and 
Oi,  O2  and  Os  are  the  joint  variables,  which  can  be  expressed 
in  terms  of  one  of  them  (for  instance  ^1), 

^i  =  0{^0ip0lPaPPP^,  (4) 

where  i  corresponds  to  any  single  measurement  of  the  angle. 

We  use  4,  together  with  the  constraint  relations  between 
the  joint  angles  [13]  that  give  O2  =  f{0\)  and  0^  =  f{0\). 

Therefore,  the  only  variable  that  we  need  to  measure  is 
0i  .  Since  one  of  our  objectives  is  to  come  up  with  a  cost- 
effective  sensing  device,  a  resistive  potentiometer  is  selected 
to  be  mounted  on  that  joint  of  the  six-bar  mechanism  to 
measure  Oi.  Similarly,  relations  can  be  found  to  place  the 
sensor  at  any  other  joint. s 

VI.  Sensitivity  Analysis 

The  selection  of  the  sensed  angle  is  based  on  calculating 
the  relative  variation  of  each  angle  with  respect  to  the  MIP 


joint  angle  ip.  If  possible,  the  sensor  should  be  mounted  on 
the  joint  that  presents  a  higher  sensitivity,  defined  as  the  ratio 
of  change  of  the  measured  angle  with  respect  to  the  change 
in  the  joint  angle. 

For  this  sensor,  0i  has  been  selected  as  the  sensed  variable, 
due  to  the  sensitivity  analysis  and  also  for  accessibility  in 
mounting  and  reading  the  sensor. 

Figure  7  shows  part  of  the  motion  in  which  a  constant 
angular  velocity  of  l.brad/sec  is  applied  to  jointl  0i  and 
the  change  of  the  angular  position  of  each  joint  has  been 
compared.  From  this  figure  we  can  deduce  that  all  the  other 
joint  angles  i.e  O2,  Os  and  O4  have  smaller  angular  changes 
than  0i  and  6^5.  The  angular  velocity  ratio  has  been  calculated 
and  it  is  shown  in  Figure  8  for  the  angle  Oi.  For  mounting 
the  potentiometer,  we  found  that  0i  is  more  convenient.  The 
potentiometer  is  mounted  as  shown  in  Figure  9. 


Timef  s] 


Fig.  7.  The  angular  positions  as  a  function  of  time 
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Fig.  8.  Sensitivity  analysis  for  61 

VII.  Results 

The  candidate  designs  were  ranked  considering  size, 
mechanism  placement  and  overall  structure.  The  selected 
design  is  optimized  and  modeled  as  shown  in  Figure  10.  The 
design  parameters  of  the  selected  six-bar  linkage  are  shown 
in  Table  I  (angles  in  radians  and  lengths  in  millimeters). 


Fig.  9.  The  exoskeleton  and  the  sensor  on  the  hand,  at  two  different 
configurations 

TABLE  I 

Exoskeleton  dimensions 


Si 

(46.34,  -94.63) 

S4 

(-30.49,  -57.91) 

a 

-77.66 

h 

-40.01 

h 

-68.46 

h 

20.00 

k 

-68.46 

h 

20.00 

hi 

-122.58 

h2 

-122.57 

7 

-021 

a. 

3.04 

5 

0.28 

0 

221 

A  rapid  prototype  has  been  built  in  order  to  further  assess 
the  performance  of  the  sensor  and  it  is  shown  in  Figure 
1 1 .  The  final  product  will  be  made  from  aluminum  and  the 
estimated  total  cost  for  several  joints,  including  machining, 
is  within  hundreds  of  dollars.  We  believe  that  this  sensor  will 
be  cheaper  than  other  sensors  such  as  data  gloves,  magnetic, 
and  infrared  sensors,  which  cost  in  the  order  of  thousands  of 
dollars. 

VIII.  CONCLUSIONS 

In  this  paper  we  present  the  development  of  a  simple  and 
cost-effective  mechanism  for  the  estimation  of  the  angles 
of  the  Metacarpal  interphalangeal  (MIP)  joint  of  the  index 


Fig.  10.  CAD  model  of  the  selected  linkage 


Fig.  11.  Initial  prototype  of  the  selected  linkage 


regarding  placement  and  size  of  the  exoskeleton. 

Future  research  includes  the  dynamic  analysis  of  the  de¬ 
vice  and  estimation  of  resolution,  noise  and  possible  loading 
effects  on  the  sensed  signal,  as  well  as  extension  to  other 
joints  of  the  hand. 
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finger.  The  design  strategy  includes  vision  system  and  image 
processing  coupled  with  kinematic  synthesis  techniques. 

The  main  advantage  of  this  method  is  that  it  does  not 
need  any  assumption  about  location  and  type  of  joints  in 
the  subject;  the  exoskeleton  is  going  to  follow  the  trajectory 
that  is  selected  as  task  regardless  of  the  skeleton  structure 
that  generates  it.  This  allows  for  the  creation  of  new  and 
innovative  exoskeleton-based  position  sensors  which  can 
help  for  EMG  and  position  modeling  in  the  grasp  and  control 
study.  The  application  of  image-processing  techniques  and 
use  of  a  six-bar  mechanism  and  a  simple  potentiometer 
grants  a  cheap,  effective  sensing  device.  The  high  number 
of  solutions  obtained  means  more  choices  for  the  designer 


Exact/approximate  Workspace  Synthesis  for 
RCCR  linkages 


Batchimeg  Batbold,  Federico  Thomas,  Yimesker  Yihun  and  Alba  Perez-Gracia 


Abstract  A  tool  for  the  exact  kinematic  synthesis  of  a  given  workspace  is  espe¬ 
cially  needed  when  designing  closed  linkages.  In  these  cases,  finite-position  synthe¬ 
sis  cannot  ensure  smoothness  of  motion  between  task  positions.  In  order  to  keep  the 
simplicity  of  the  finite-position  synthesis  approach  but  without  having  to  rely  on  big 
optimization  methods,  here  we  describe  the  workspace  of  relative  displacements  as 
a  set  of  screws  using  Parkin’s  definition  of  pitch.  The  workspace  can  then  be  seen 
as  a  line  bundle  called  screw  surface.  The  screw  surface  is  then  characterized  by  a 
number  of  screws  which  are  used  to  generate  the  whole  surface,  and  in  turn  to  per¬ 
form  dimensional  synthesis.  The  methodology  is  here  applied  to  the  overconstrained 
RCCR  closed  linkage. 


1  Introduction 


NOTE  TO  AUTHORS:  Here  I  just  literally  copied  the  intro  from  my  RPRP  paper. 
This  part  needs  to  be  upgraded  and  adapted  to  the  RCCR  case.  Synthesis  of  paral¬ 
lel  robots  has  focused  mainly  on  type  or  structural  synthesis,  using  group  theory, 
screw  theory,  or  geometric  methods,  see  for  instance  [9],  [2],  [7].  Dimensional  syn¬ 
thesis  examples  exist,  mainly  for  optimizing  performance  indices  [13],  [14],  [16] 
or  for  reachable  workspace  sizing  [1],  [18],  [6];  see  also  [19]  for  a  comprehensive 
approach. 

The  dimensional  synthesis  of  spatial  serial  chains  for  a  prescribed  set  of  positions 
can  be  used  for  the  design  of  parallel  robots  by  synthesizing  all  supporting  legs  for 
the  same  set  of  positions.  There  are  a  few  examples  of  finite-position  dimensional 
synthesis  of  parallel  robots  in  the  literature,  most  of  them  doing  partial  synthesis. 
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Wolbrecht  et  al.  [27]  perform  synthesis  of  3-RRS,  4-RRS  and  5-RRS  symmetric 
parallel  manipulators;  Kim  and  Tsai  [17]  and  Rao  [23]  solve  the  partial  kinematic 
synthesis  of  a  3-RPS  parallel  manipulator.  This  method  has  been  successfully  ap¬ 
plied  mainly  to  special  parallel  systems  with  imposed  symmetry.  In  general,  the 
method  does  not  allow  the  control  of  the  final  trajectory  of  the  parallel  system;  in 
the  most  extreme  cases,  it  may  yield  a  system  with  negative  mobility,  that  can  be 
assembled  at  each  task  positions  but  cannot  be  driven  from  task  position  to  task 
position. 

The  kinematic  mapping  is  used  for  the  synthesis  of  planar  and  spherical  linkages 
in  order  to  state  design  equations  and  to  provide  a  tool  for  visualizing  the  workspace 
and  trajectories  of  the  linkage.  See  Ravani  and  Roth  [24]  and  more  recent  applica¬ 
tions  by  Hayes  [8],  Schrocker  [25]  and  Wu  and  Ge  [28].  For  spatial  motion.  Study’s 
kinematic  mapping  is  used  to  obtain  simplified  equations  for  analysis  and  synthesis, 
see  Husty  et  al.  [15]  and  [5].  However,  the  kinematic  image  for  the  spatial  motion 
is  a  six-dimensional  quadric  and  that  makes  the  visualization  of  workspaces  and 
trajectories  difficult  for  the  designer. 

In  this  paper,  the  workspace  of  the  linkage  is  visualized  as  a  set  of  finite  screws 
corresponding  to  the  set  of  finite  displacements  of  the  end-effector.  One  interesting 
question  is  whether  the  finite-screw  surfaces  generated  by  a  set  of  task  positions 
can  give  any  information  for  the  synthesis  of  parallel  robots  and,  in  particular,  of 
some  overconstrained  closed  linkages.  Using  Parkin’s  definition  for  pitch  [20],  the 
screws  corresponding  to  finite  displacements  of  some  linkages  can  form  screw  sys¬ 
tems.  Huang  [10]  showed  that  the  single  RR  chain  forms  a  finite  screw  system  of 
third  order;  however,  the  set  of  finite  displacements  of  the  coupler  of  the  Bennett 
linkage  form  a  cylindroid,  which  is  a  general  2-system  of  screws  [11].  Baker  [4]  has 
also  studied  the  motion  of  the  Bennett  linkage.  Perez  and  McCarthy  [21]  used  two 
arbitrary  displacements  to  generate  the  cylindroid  of  finite  screws  associated  to  the 
Bennett  linkage  in  order  to  perform  dimensional  synthesis. 

In  this  paper,  the  focus  is  on  the  simplest  of  the  overconstrained  linkages,  the 
closed  spatial  RPRP  linkage.  This  linkage  is  one  of  the  Delassus  linkages,  later 
studied  by  Waldron  [26]  and  Baker  [3].  Recently,  Huang  [12]  has  shown  that  the  set 
of  screws  corresponding  to  displacements  of  this  linkage  forms  a  2-screw  system. 
We  use  this  result  in  order  to  synthesize  RPRP  linkages  with  positive  mobility  and 
for  a  given  shape  of  the  screw  system  of  relative  displacements.  In  order  to  do  so,  we 
state  the  design  equations  using  the  Clifford  algebra  of  dual  quaternions  [22] .  The 
dual  quaternion  expression  can  be  easily  related  to  the  screw  system  and  it  is  also 
used  to  assign  the  magnitude  to  the  screws  in  order  to  obtain  the  correspondence 
between  the  screw  system  and  the  trajectory  of  the  end-effector.  The  design  yields  a 
single  RPRP  linkage. 
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2  The  Workspace  of  Finite  Screws 


Given  the  forward  kinematics  for  an  articulated  system,  we  can  define  the  workspace 
as  the  set  of  finite  displacements  obtained  when  giving  values  to  all  active  joint  vari¬ 
ables  within  their  ranges.  If  the  forward  kinematics  used  is  that  of  relative  motion 
from  a  reference  configuration,  giving  values  to  the  active  joint  variables  we  obtain 
the  workspace  of  relative  displacements.  Each  of  these  displacements  can  be  as  a 
rotation  about  and  a  translation  along  a  screw  axis. 

The  relative  rotations  can  hence  be  expressed  as  screws  with  a  magnitude  and  a 
pitch.  While  for  infinitesimal  screws  the  pitch  is  defined  in  a  fairly  universal  way, 
for  finite  screws  several  pitch  definitions  can  be  found.  For  the  purpose  of  this  re¬ 
search,  Parkin’s  definition  of  pitch  [20]  is  used.  When  using  this  pitch,  the  screws 
corresponding  to  finite  displacements  of  some  linkages  can  form  linear  systems  of 
screws,  which  are  called  screw  systems.  However  some  other  definitions  of  pitch 
exist  that  handle  the  inherent  nonlinearity  of  finite  displacements  in  a  different  way. 

Parkin’s  definition  of  pitch  appears  naturally  from  the  expression  of  the  forward 
kinematics  equations  using  the  Gifford  algebra  also  known  as  dual  quater¬ 

nions.  For  an  introduction  to  the  use  of  dual  quaternions  in  robot  kinematics,  see 

[22]. 

The  Pliicker  coordinates  S  =  (s,c  x  s)  of  a  line  can  be  identified  with  the  Clif¬ 
ford  algebra  element  S  =  s  +  ec  x  s,  with  =  0.  Similarly,  a  screw  J  becomes  the 
element  J  =  (1  +  /ie)S,  where  {l  is  the  pitch.  Using  the  Clifford  product  we  can 
compute  the  exponential  of  the  screw  |  J, 


ej  6  d  .  6  6  d  ^  nc  ^ 

^ 2  =  (cos  -  -  -  sm  -e)  +  (sm  ^  +  2  2  =  cos  -  sm  -S. 


(1) 


The  exponential  of  a  screw  defines  a  unit  dual  quaternion,  which  can  be  identified 
with  a  relative  displacement  from  an  initial  position  to  a  final  position  in  terms  of  a 
rotation  around  and  a  slide  along  axis  S. 

For  a  serial  chain  with  n  joints,  in  which  each  joint  can  rotate  an  angle  Gt  and 
slide  a  distance  dt,  around  and  along  the  axis  S/,  /  =  1, . . . ,  k,  the  forward  kinematics 
of  relative  displacements  (with  respect  to  a  reference  position)  can  be  expressed  as 
the  composition  of  Clifford  algebra  elements  corresponding  to  the  motion  of  each 
joint.  Let  Gq  and  do  be  the  joint  parameters  of  this  chain  when  in  the  reference 
configuration,  so  we  have  A0  =  (0  —  0o  +  (d  —  do)e).  Then,  the  movement  from 
this  reference  configuration  is  defined  by 


D{A0)  =  cos 


2  2 


(2) 


Notice  that  it  is  immediate  to  find  the  screw  axis  of  the  relative  displacement  S 
from  this  expression.  If  we  concentrate  now  on  that  part  of  the  forward  kinematics 
that  contains  the  screw  axis,  we  can  easily  obtain  a  magnitude  and  a  pitch. 
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sin  ts  =  (sin  ^  cos  y  )S  =  sm^{l  +  e-^)S,  (3) 

2  2  2  2  2  tan  ^ 

so  that  we  can  see  the  relative  workspace  as  a  set  of  screw  axes  with  magnitude 
sin  ^  and  Parkin’s  pitch  It  turns  out  that,  for  the  case  of  finite  displacements, 

the  value  of  the  magnitude  is  unique  and  can  be  calculated  using  the  scalar  part  of 
the  forward  kinematics,  which  yields  a  nonlinear  relation.  See  [12]  for  details. 

As  a  conclusion,  the  workspace  of  relative  displacements  can  be  expressed  as  a 
set  of  unit  screws  plus  a  scalar  magnitude  equation.  It  turns  out  that  this  set  of  screws 
form  linear  systems  of  screws  (screw  systems)  for  several  well-known  linkages. 
However,  most  of  the  linkages  have  a  workspace  which  cannot  be  expressed  as  a 
screw  system,  but  rather  as  a  screw  surface  of  a  certain  degree.  We  will  denote  this 
as  the  finite- screw  workspace  of  the  linkage. 

We  can  derive  a  general  formula  for  the  expression  of  the  finite-screw  workspace 
if  we  develop  the  forward  kinematics  equations  in  Eq.(2).  The  Clifford  product  of 
screw  transformations  about  each  axis  can  be  collected  as  a  linear  combination  of 
the  joint  axes  plus  products  of  joint  axes  as  follows, 

D{A0)=cos'^  +  sm'^{l  +  e^)S=[ld  Si  ...SkSiS2  ...  5i...5jV,  (4) 

.4  z  tan  ^ 

where  the  dual  vector  V  contains  products  of  the  joint  variables.  For  a  closed  chain, 
the  relations  among  those  joint  variables  may  simplify  the  expression  of  the  linear 
combination. 


3  Classification  of  Screw  Surfaces 

NOTE  TO  AUTHORS:  Futuristic  section...  the  idea  here  is  to  see  if  we  can  derive 
some  property  of  the  screw  surface  just  by  looking  at  its  parameterized  expression 
(for  instance,  determine  whether  it  is  linear...  So  far,  the  way  I  have  determined 
linearity  is  by  calculating  the  determinant  to  see  the  dimension  of  the  space  that 
the  appropriate  number  of  screws  generate,  and  then  the  linear  combination.  For 
instance,  if  I  know  that  a  linkage  has  1  dof,  then  I  check  whether  3  arbitrary  screws 
of  the  workspace  have  dimension  two.  Then  I  see  if  the  linear  combination  of  two 
screws  is  another  screw  of  the  workspace.  Now  to  move  to  higher  dimensions  and 
quadratic  workspaces,  we  need  a  more  clever  way  of  doing  it. 


4  The  Closed  RCCR  Linkage 

There  closed  RC-CR  linkage  is  overconstrained  and  able  to  move  with  one  degree 
of  freedom  [26]  when  the  cylindrical  (C)  and  revolute  (R)  joints  of  each  pair  are 
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parallel,  while  both  pairs  are  skew  one  to  each  other.  The  geometry  of  the  closed 
linkage  can  be  seen  in  Figure  ??  and  Figure  ??. 


4.1  The  overconstrained  RC-CR  linkage 


In  order  to  prove  the  above  statement,  let  us  start  calculating  the  mobility.  The  mo¬ 
bility  of  this  spatial  four-bar  linkage,  assuming  that  the  axes  are  arbitrarily  posi¬ 
tioned,  is,  using  CKG  formula,  equal  to  zero.  However  it  is  possible  to  obtain  a 
one-dof  linkage  for  some  special  geometry. 

The  geometric  features  and  the  joint  variable  functions  can  be  derived,  for  in¬ 
stance,  by  equating  the  forward  kinematics  of  both  RC  serial  chains  at  their  end- 
effector.  According  to  the  coordinate  frame  shown  in  Figure  ??,  and  assuming  par¬ 
allel  axes,  that  is,  ai  =  as  =  0,  the  forward  kinematics  of  chain  1-2  is. 


[Dn] 


c(^0\  @2)  — *^(^1  *^(^1  T  ^2^S^2  “1“  ^2)  Cl\cQ\ 

^(0i-f-02)  c{Q\-vQ2)ca2  -c{Q\^Q2)sa2  a2s\Q\ Q2)  ^ ci\sQ\ 
0  ^a2  ca2  R\^r2 

0  0  0  1 


where  5'  and  c  stand  for  the  sin  and  cos  functions  respectively. 

The  forward  kinematics  of  the  second  half  of  the  linkage  is  given  by 


(5) 


[£>43] 


c(03  +  64)  s{62  +  64)  0  —02064  —  04 

—s{62-\-64)ca4  c(03  +  04)ca4  sa4  {r2-\-R4)sa4-^02s64Ca4 
s{62  +  64)sa4  —c{62  +  64)sa4  ca4  (rs  -\-R4)ca4  —  02s64sa4 

0  0  0  1 


(6) 


Some  geometrical  constraints  and  angular  relations  are  obtained  from  equating 
these  two  transformations. 


cos  a2  =  cos  a4  a4  =  ±a2, 

cos(0i  -k  62)  =  ±1,  sin(0i  -{-62)  =0  62  =  0^71  —  61, 

cos(03  +  64)  =  ±1,  sin(03  +  @4)  =  0  62  =  71  —  64,  (7) 

which  indicate  that  the  directions  of  the  fixed  joints  are  parallel  to  the  directions  of 
the  moving  joints,  with  opposite  rotation  angles.  We  can  also  derive  the  following 
joint  variable  relations: 
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64  =  ±arccos( 


±a2  —  a4  —  ai  cos  61 
as 


) 


rs 


ri 


a\  sin  61  —  as  cos  a4  sin  64  —  R4  sin  a4 
sina4 

ai  cos  a4  sin  61  —  as  sin  64  —  Ri  sin  a4 
sina4 


(8) 


4.2  The  Workspace  of  Finite  Displacements  of  the  RC-CR  Linkage 


If  we  apply  the  conditions  in  Eqs.  (7)  and  (8)  with  one  of  the  signs,  we  can  compute 
the  workspace  of  the  linkage  as  all  possible  transformations  obtained  when  giving 
values  to  the  actuated  joint  variable  (in  this  case  selected  as  the  angle  61).  We  are 
considering  the  particular  case  of  an  RC-CR  linkage  located  with  respect  to  the  fixed 
frame  as  shown  in  Figure  ??. 

10  0  cos  01— (22 

r  0  —  cosa2  sina2  aisinOi 

^  0  sina2  cosa2  ((2i  cosa4sin0i  —  (23  sin04)/sina4 

0  0  0  1 

Notice  that  the  RC-CR  linkage  has  a  constant-orientation  workspace. 

In  particular,  we  are  interested  in  the  workspace  of  relative  displacements  with 
respect  to  a  reference  configuration.  The  reference  configuration  can  be  arbitrarily 
selected,  and  the  joint  variables  are  now  increments  from  the  reference  configura¬ 
tion,  that  is,  Ar2  =  r2  —  r2o,  and  A  Ot  =  Ot  —  0/0  •  Now  we  are  going  to  start  using  dual 
quaternions  to  define  the  displacements,  as  they  give  a  simpler  expression  with  an 
easier  geometric  interpretation.  We  obtain  the  following  expression: 


✓  \ 

0 

(2i(cos^  ^  —  sin^  ^  —  cos  ^) 

0 

>  -^£  < 

(2i(cos  ^  sin  ^(2(cos^  ^  —  sin^  ^)  —  1) 

0 

Ar2 

1 

0 

(10) 


Here  again  we  can  observe  that  the  relative  displacements  have  zero  rotation. 

In  order  to  find  the  workspace  of  relative  displacements  for  an  arbitrarily-located, 
RC-CR  linkage,  we  write  its  forward  kinematics  in  dual  quaternion  form, 

D  =  R{A0i)C{A02,Ar2)  ~  ^  +  (z\r2Si  -|-(cosA0i  +  I)(c2  — Ci)  —  sinA0i(c2  — Ci)) 

(11) 

where  R ( A  0i )  is  a  rotation  about  an  axis  with  Plucker  coordinates  S 1 ,  and  C(z\  02 ,  ^  r2 ) 
is  a  rotation  and  a  translation  about  and  along  an  axis  with  Plucker  coordinates  S2. 
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Both  axes  share  the  same  direction  si ,  and  the  points  Ci  and  C2  are  any  points  on  the 
axes  along  a  common  normal  line. 

NOTE  TO  AUTHORS:  Now  what  we  need  to  do  is  to  add  the  expression  of  r2  in 
this,  in  order  to  have  everything  as  a  function  of  theta  1.  For  doing  so,  remember  that 
the  formula  for  the  angular  relation  is  for  absolute  angles,  while  these  are  relative. 
That  is  not  important  for  linear  relations,  but  for  cos  we  need  to  apply  the  cosine  of 
the  difference  of  angles  formula.  We  need  to  keep  working  on  it. 


5  Dimensional  Synthesis  for  the  RCCR  Linkage 

In  the  previous  section  we  have  proved  that  the  workspace  of  the  RCCR  linkage 
is  a  constant-orientation  one.  Hence,  the  synthesis  problem  for  this  linkage  reduces 
to  a  point-path  synthesis  problem.  The  point-path  synthesis  problem  is  stated  as 
follows:  given  an  initial  point  Pi  (which  we  will  use  as  reference  configuration), 
relative  displacements  of  the  RC-CR  chain  will  move  this  point  to  the  rest  of  task 
points  P2,P3,...,Pn. 

The  action  of  the  chain  on  this  point  can  be  calculated  using  the  conjugation  in 
the  Clifford  algebra.  If  the  forward  kinematics  of  relative  displacements  of  Eq.(ll) 
is  denoted  by  D  =  1  +  ed,  then 

Vi=bPib\  i  =  (12) 

where  A  =  (1  +  ^Pi)  is  the  dual  quaternion  expression  of  the  point  Pi,  and  the 
conjugation  yields 

(l+e^d)(l  +  ePi)(l  +  e^d)  =  l  +  e(Pi+d)  (13) 

Let  us  consider  first  the  case  of  the  serial  RC  chain  in  which  the  values  of  B\  and 
r2  are  not  constrained.  This  results  in  3 (n  —  1)  design  equations,  with  the  structural 
variables  Si  and  a  =  C2  —  ci  and  the  values  of  the  joint  variables  r2  and  Q\  for  each 
point,  which  is  a  total  of  4  +  2(^  —  1)  unknowns.  Simply  equating  these  two  values 
we  obtain  that  we  can  define  up  to  ^  =  5  point-positions  in  order  to  do  exact  point- 
path  synthesis. 

In  the  case  of  the  RC  chain  belonging  to  the  movable  RC-CR  linkage,  we  have 
only  one  joint  variable  and  hence  the  number  of  unknowns  is  4  +  (^  —  1).  The  max¬ 
imum  number  of  points  we  can  define  for  exact  point-path  synthesis  is  ^  =  3. 

NOTE  TO  AUTHORS:  Here  we  have  an  example  of  the  first  case,  r2  and  thetal 
independent,  but  not  of  the  second  one  because  we  don’t  have  the  expression  worked 
out  yet.  We  need  to  do  so. 
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6  The  workspace  of  the  RC-CR  linkage  as  a  screw  surface 

7  Synthesis  for  the  RC-CR  workspace 

8  Conclusions 
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ABSTRACT 

In  a  finite-  position  synthesis  of  a  closed  linkage  spatial 
mechanisms,  obtaining  a  smoother  motion  between  task  posi¬ 
tions  is  difficult  due  to  a  number  of  conflicting  objectives  and 
constraints. In  this  paper  ,In  order  to  keep  the  simplicity  of  the 
usual  synthesis  techniques  ,we  have  developed  a  methodology 
to  Optimize  spatial  mechanisms  by  obtaining  the  best  results 
for  a  group  of  design  variables  which  will  meet  constraints  in¬ 
cluding  dimension,  restricted  region  and  force  transmission  .  The 
evaluation  is  expressed  by  means  of  an  objective  function  that 
has  to  meet  certain  restrictions  or  requirements  to  minimize  the 
overall  dimensions. For  illustration,  the  methodology  is  applied 
to  a  spatial,  CRR-RRR,  I -degree-of -freedom  closed  linkage  to  be 
used  as  an  exoskeleton  for  thumb  motion.  The  algorithm  is  im¬ 
plemented  on  the  exoskeleton  to  consider  additional  constraints 
to  control  the  position  and  size  of  the  exoskeleton,and  reduc¬ 
ing  physical  and  sensory  interference.The  Exoskeleton  is  opti¬ 
mized  by  using  two  nonlinear  constrained  optimization  algo¬ 
rithms  namely,Genetic  algorithm(GA)  and  gradient -based  mini¬ 
mization  .  The  Methodology  implemented  in  this  paper  allow  and 
help  to  interactively  monitor  and  control  objectives  and  con¬ 
straints,  which  will  yield  practical  solutions  to  realistic  spatial 
mechanism  design  problems. 


INTRODUCTION 

In  exact  synthesis,  the  number  of  positions  to  be  reached  are 
limited  by  the  number  of  structural  variables  in  the  design.  Af¬ 


ter  that  maximum  number,  any  other  position  will  be  only  ap¬ 
proximated  by  the  linkage.  Designers  use  different  optimiza¬ 
tion  methods  to  design  a  higher  number  of  task  positions.  To 
mention  some  of  the  Optimization  methods  used  in  Mechanism 
design  one  of  the  simplest  one  is  Least-square  technique  with 
vector  geometric  and  functional  equations  as  it  is  discribed  in 
[l],it  is  a  straightforward  method  to  state  equations  but  it  has 
many  more  equations  than  needed.  Its  problems  can  be  sum¬ 
marized  as:  overdimensioned  set  of  equations,  no  condition  for 
same-assembly  trajectory  included  in  set  of  equations,  degen¬ 
erate  cases  may  appear.Least- square  technique  with  assembly 
constraints, many  authors  have  used  this  methodology,  for  in¬ 
stance  [2]  and  [3].  See  also  [4].  The  method  is  designed  to 
accommodate  slight  nonassembly  in  the  solutions  (which  trans¬ 
lates,  once  the  linkage  is  assembled,  in  some  error  in  reaching  the 
positions).  The  numerical  problem  appears  when  the  assembly 
conditions  are  exact  constraints  of  the  optimization  process,  as 
they  may  not  be  able  to  hold  for  all  positions.  Some  researchers 
use  a  method  with  a  modification  of  the  previous  two  methods,  in 
which  we  use  the  constraints  between  angles  to  reduce  the  num¬ 
ber  of  angular  variables  to  a  minimum.lt  requires  the  analysis  of 
the  linkage,  which  is  easy  for  the  4-bar  linkage  but  more  com¬ 
plicated  to  generalize.Many  authors  have  used  the  loop  equation 
method,  but  following  the  equations  can  be  expressed  in  different 
ways.For  instance,  [5],  whose  work  has  been  extended  for  a  six- 
bar  linkage  by  [6].  Also  in  [7],  and  [8]. There  are  other  interesting 
approaches  for  the  synthesis  of  linkages  for  instance,  workspace 
optimization  [9];  geometric  constraint  programming  [10];  topol- 
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ogy  optimization  [11];  genetic  algorithms  (  [12],  [13]);  others, 
especially  used  for  optimization  of  more  complicated  linkages 
( [14],  [15],  [16]).  Kinematic  mapping  is  another  method  of  Op¬ 
timization,  which  is  basically  the  mapping  of  the  minimum  pa¬ 
rameters  that  define  the  motion  with  an  algebraic  meaning,  as 
coordinates  of  a  three-dimensional  space  (six-dimensional  space 
in  the  case  of  spatial  motion)  creating  a  given  manifold.  This 
method,  started  by  Ravani  and  Roth  [17],  has  a  relatively  small 
group  of  followers,  maybe  because  of  the  more  complicated  math 
involved.  It  can  be  related  to  the  dual  quaternion  method  for  spa¬ 
tial  linkages.  See  [18],  [19].  In  this  paper  the  optimization  is  per¬ 
formed  based  on  two  nonlinear  constrained  optimization  algo¬ 
rithms  namely,Genetic  algorithm(GA)  and  gradient-based  min- 
imization.The  GA  creates  a  grid  of  iterative  points  and  keeps 
only  those  under  a  certain  value  with  respect  to  the  previous 
iteration,then  the  output  from  the  GA  is  used  as  an  input  for 
the  gradient-based  minimization  to  get  into  a  global  minimum 
point.  This  approach  of  exoskeleton  optimization  allow  and  help 
to  interactively  monitor  and  control  objectives  and  constraints. 
In  the  following  section,  the  optimization  approach  is  illustrated 
on  a  spatial,  CRR-RRR,l-degree-of-freedom  closed  linkage  to 
be  used  as  an  exoskeleton  for  thumb  motion 


FIGURE  1 .  Caption  for  Manuopt 


THE  OPTIMIZATION  APPROACH 

The  kinematic  synthesis  of  a  spatial  mechanism  performed 
in  many  ways  for  a  desired  task.  The  algorithm  implemented 
here  is  to  consider  additional  constraints  for  controlling  the  posi¬ 
tion  and  size  of  the  spatial  mechanisms.  The  Optimization  starts 
from  the  screw  axes  of  the  mechanism  expressed  in  Plucker  co¬ 
ordinates.  The  main  principle  of  the  design  is  based  on  the  prin¬ 
ciple  that  moving  a  joint  along  the  screw  axis  will  not  affect 
the  motion  of  the  end  effector  ,However,  the  force  transmission 
and  higher  derivatives  of  the  mechanism  may  change.Hence,  by 
defining  control  design  variables  on  each  screw  axis  objective 
functions  and  constrains  are  formulated.  Size  constraint,  bet¬ 
ter  force  transmission  and  avoidance  of  restricted  regions  in  the 
work  space  of  the  mechanism  are  three  major  issues  in  the  de¬ 
sign  of  a  spatial  mechanisms. The  methodology  adopted  here, 
considered  those  three  conditions.  For  illustration  purpose  the 
constrained  region  is  modeled  as  a  cylindrical  surface  however  it 
can  be  spherical  or  any  other  geometrical  shape. 

OPTIMIZATION  OF  CRR-RRR  SPATIAL  MECHANISM 
USED  AS  SN  EXOSKELETON  FOR  THUMB  MOTION 

The  dual  quaternion  synthesis  approach  has  been  imple¬ 
mented  in  the  design  of  spatial  mechanism  of  CRR-RRR.  This 
mechanism  was  designed  to  be  used  as  an  exoskeleton  device  for 
thumb  motion  [] .  The  mechanism  has  a  single  degree  of  freedom 
,which  can  be  listed  as  one  of  the  advantages  of  the  mechanism 
which  requires  a  single  actuator  yet  gives  3D  complex  motion. 


The  goal  for  the  exoskeleton  is  to  generate  the  desired  grasp¬ 
ing  and  pinching  path  of  the  thumb  with  one  degree  of  freedom, 
rather  than  using  a  system  actuating  all  its  joints  independently. 
In  addition  to  the  path  of  the  thumb,  additional  constraints  are 
added  in  order  to  control  the  position ,  size  of  the  exoskeleton  and 
reducing  physical  and  sensory  interference  with  the  user.  The 
kinematic  synthesis  alone  had  147  nonlinear  equations  and  97 
variables  which  makes  it  challenging  to  add  more  constraints. The 
synthesis  gave  a  mechanism  which  can  follow  the  desired  trajec¬ 
tory  however  it  may  be  over  sized  and  interfered  with  a  restricted 
region  as  .Therefore,  it  is  found  that  additional  optimization  is 
necessary.To  start  with  such  process,  a  CAD  model  for  manual 
adjustment  has  been  created  as  shown  in  Figure  1.  It  works  by 
plotting  the  screw  axes  obtained  from  the  synthesis  and  then  ad¬ 
justing  the  link  size  and  orientation  by  moving  joint  points.  This 
procedure  can  give  a  mechanism  which  is  out  of  the  constrained 
region, however  it  is  time  taking  and  do  not  give  the  optimized  so¬ 
lution  as  well.  Therefore  considering  the  size  and  the  constraints 
,  an  optimization  problem  has  been  developed  and  solved  using 
genetic  algorithm  coupled  with  fmincon  through  the  hybrid  op¬ 
timization  algorithm  option  in  Matlab.  The  procedure  and  the 
technique  implemented  here  can  also  be  applied  for  other  prob¬ 
lems  too.  the  mechanism  is  required  to  be  compact  while  pre¬ 
serving  its  function. 

Optimization  probiem  formuiation:  The  design  ob¬ 
jective  considered  here  is  the  minimization  of  the  total  link  length 
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needed  for  the  mechanism  .  In  this  stage  ,the  link  dimensions 
were  optimized  by  converting  them  into  a  single  combined  ob¬ 
jective  function.  The  problem  has  a  number  of  geometrical  con¬ 
straints. To  formulate  the  objective  function  for  minimizing  the 
overall  length  of  the  mechanism,  The  parameters  shown  in  the 
Figure  2  are  used  where  Si,  are  the  screw  axes  obtained  from  the 
mechanism  synthesis  expressed  in  dual  quaternion  form  .  Q,  are 
the  points  on  Si  at  which  the  line  from  the  origin  and  Si  are  per¬ 
pendicular  .Pik  and  1))  are  two  arbitrary  points  on  axis 

Si.  tik  and  ti{k^  1)))  are  corresponding  distances  of  Pik  and 
Pi{k^  l))from  the  point  Q  respectively 

Si  =  Si  +  £5'!^  (1) 


{Si)x{s^) 

{SiUSi) 


(2) 


Then  Pik  and  (k  + 1 ))  are  expressed  with  respect  to  Q  as  follow. 


Pik 

Pi(k+l)  =Ci^h(k+l){^i) 


The  objective  function  formulated  to  minimize  the  distance  be¬ 
tween  points  in  the  same  axis  as  well  as  the  links  between  each 
axis.F  is  a  nonlinear  function  with  twelve  variables  in  it. 


Constraint  Functions:  (i)  The  distance  between  Pik 
and  1))  is  set  to  be  greater  than  or  equal  to  a  constant 

value  d,  this  will  help  for  latter  construction  of  joints  and  ease 
of  assembly  of  the  mechanism  .This  results  six  linear  equality 
constraints. 


(ii)  Space  constraints:  as  a  requirement  the  mechanism  should 
not  interfere  with  the  hand.  For  the  convenience  of  analysis  the 
hand  has  been  represented  or  modeled  as  a  cylindrical  region 
with  radius  Rc  and  the  axis  of  the  cylinder  through  points  Pc  1 
and  Pc2  as  shown  in  the  Figure  3.  The  constraint  functions  are 
defined  in  such  a  way  that  the  3D  points  of  the  mechanism  joint 


FIGURE  2.  THE  SCREW  AXES  OE  CRR-RRR  MECHANISM 


should  stay  out  of  the  cylinder  .  The  unit  vector  along  the  cylin¬ 
der  axis  is  defined  as  Equation  (6). 

VC=  (Pc2  -Pci)/^[(Pc2-Pci)-(Pc2-Pci)]  (6) 

If  any  of  the  mechanism  joint  points  represented  by  Pmi,  the  dis¬ 
tance  of  Pjni  with  respect  to  the  point  Pci  along  Vc  is  represented 
by  LmC  as  Equation  (7). 

Lmc  =  (P™-Pci)-Vc  (7) 

Since  the  CRR-RRR  mechanism  has  six  axes  and  twelve 
points  (joints)  we  have  a  total  of  twelve  nonlinear  constraint 
functions  for  this  space  constraint,  each  of  them  defined  as  Equa¬ 
tion  (8). 


(P™-Pci)-(P™-Pci)-LL>4  (8) 

(iii)Link  length  constraints  ,  as  the  final  mechanism  is  re¬ 
quired  to  be  compact  in  size  ,this  constraint  is  necessary  .  Con¬ 
sidering  manufacturability  and  compactness  the  minimum  and 
maximum  link  lengths  have  been  set  20mm  and  150mm  respec¬ 
tively  for  this  particular  mechanism.Therefore,  the  constraint 
functions  for  this  case  are  defined  as  Equation  (9). This  gives  a 
total  of  twelve  nonlinear  constraints. 

iPii+i)k  - Pi(k+i))-iP(i+i)k  - Pi(k+i))  >  (20)^ 

{Pii+i)k-Piik+i))-{Pii+i)k-Piik+i))  >  (150)2  ^  ^ 

Considering  all  the  constraints  and  the  objective  function  , 
the  optimization  problem  involves  twelve  decision  variables  , 
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FIGURE  3.  RESTRICTED  REGION  REPRESENTED  BY  A 
CYLINDRICAL  SUREACE 


one  nonlinear  objective  functions  ,  six  linear  inequality  con¬ 
straints  and  twenty  four  nonlinear  constraints.  Each  variable  also 
bounded  within  a  lower  and  an  upper  limit.  The  nonlinearity 
in  the  objective  function  over  the  constraints  provide  the  main 
difficulty  in  solving  the  problem.  A  set  of  randomly  generated 
solutions  over  the  above  mentioned  variable  bounds  indicate  that 
about  only  one  in  10^  solutions  is  feasible.  Such  a  severity  of  the 
feasible  region  makes  the  problem  even  more  difficult  to  solve. 
In  the  following  section  the  optimization  method  and  simulation 
results  are  presented  for  one  particular  solution. 

Consider  one  of  the  solution  obtained  through  the  synthesis 
of  CRR-RRR,  figure  4.  The  screw  axis  in  plucker  coordinate 
are  given  in  the  Table.  The  Black  colors  are  the  links  of  the 
mechanism,  whereas  the  colored  lines  represent  the  screw  axes 
i.e  red=5'i,  blue=5'2  etc.  where  the  cylinder  represents  the  hand 
with  which  the  mechanism  should  not  interfere.  As  we  can  see  , 
some  of  the  joints  are  in  the  hand  or  in  the  restricted  region(the 
cylinder)  and  the  link  sizes  are  also  not  controlled,  ranges  from 
very  small  to  a  very  large  one.  Both  of  them  are  not  acceptable 
in  terms  of  compactness  ,  manufacturability  and  assembly  point 
of  view.  Therefore,  a  post  processing  of  the  design  results  was 
found  necessary. 

After  the  applying  the  genetic  algorithm  based  on 
the  objective  function  and  constraints  defined  above  the 
link  lengths  become  Lpl2,Lp23,Lp34,Lp45,Lp56,Lp61= 
107.091,1 19.521, 140.557,71.2734,103. 12,125.262.the  solution 
satisfies  all  the  constraints,  as  we  can  see  in  the  Figure  5 
the  space  constraint  is  also  satisfied.  The  result  obtained 
was  further  refined  by  using  a  hybrid  genetic  algorithm 
approach.  Here  the  above  solution  has  been  given  as  an 
initial  value  for  the  nonlinear  gradient  optimization. The  re- 


FIGURE  4.  MECHANISM  OBTAINED  THROUGH  SYNTHESIS 


FIGURE  5.  MECHANISM  OBTAINED  THROUGH  GA 


suit  obtained  is  shown  in  Figure  6.  The  link  lengths  are 
Lpl2,Lp23,Lp34,Lp45,Lp56,Lp61=74.9468,37.5481,94.2339,48.6024,3S 
which  is  a  more  optimized  one  and  still  satisfies  the  constraints. 
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FIGURE  6.  MECHANISM  OBTAINED  THROUGH  A  HYBRID 
OPTIMIZATION  METHOD 
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The  dimensional  synthesis  of  spatial  chains  for  a  prescribed 
set  of  positions  can  be  applied  to  the  design  of  parallel  robots 
by  joining  the  solutions  of  each  serial  chain  at  the  end  ef¬ 
fector.  This  design  method  does  not  provide  with  the  knowl¬ 
edge  about  the  trajectory  between  task  positions  and,  in  some 
cases,  may  yield  a  system  with  negative  mobility.  These  prob¬ 
lems  can  be  avoided  for  some  overconstrained  but  movable 
linkages  if  the  finite  screw  system  associated  to  the  motion 
of  the  linkage  is  known.  The  finite  screw  system  defining  the 
motion  of  the  robot  is  generated  by  a  set  of  screws,  which 
can  be  related  to  the  set  of  finite  tasks  positions  traditionally 
used  in  the  synthesis  theory.  The  interest  of  this  paper  lies 
in  presenting  a  method  to  define  the  whole  workspace  of  the 
linkage  as  the  input  task  for  the  exact  dimensional  synthesis 
problem.  This  method  is  applied  to  the  spatial  RPRP  closed 
linkage,  for  which  one  solution  exists. 

Nomenclature 

S  Line  or  dual  vector,  defined  using  Pliicker  coordinates, 
s  Vector 

S  Quaternion  or  dual  quaternion 
w  Dual  number 
[M]  Matrix 

1  Introduction 

Synthesis  of  parallel  robots  has  focused  mainly  on  type 
or  structural  synthesis,  using  group  theory,  screw  theory,  or 
geometric  methods,  see  for  instance  [1],  [2],  [3].  Dimen¬ 
sional  synthesis  examples  exist,  mainly  for  optimizing  per¬ 
formance  indices  [4],  [5],  [6]  or  for  reachable  workspace  siz¬ 
ing  [7],  [8],  [9];  see  also  [10]  for  a  comprehensive  approach. 

The  dimensional  synthesis  of  spatial  serial  chains  for 
a  prescribed  set  of  positions  can  be  used  for  the  design  of 
parallel  robots  by  synthesizing  all  supporting  legs  for  the 
same  set  of  positions.  There  are  a  few  examples  of  finite- 
position  dimensional  synthesis  of  parallel  robots  in  the  lit¬ 


erature,  most  of  them  doing  partial  synthesis.  Wolbrecht  et 
al.  [1 1]  perform  synthesis  of  3-RRS,  4-RRS  and  5-RRS  sym¬ 
metric  parallel  manipulators;  Kim  and  Tsai  [12]  and  Rao  [13] 
solve  the  partial  kinematic  synthesis  of  a  3-RPS  parallel  ma¬ 
nipulator.  This  method  has  been  successfully  applied  mainly 
to  special  parallel  systems  with  imposed  symmetry.  In  gen¬ 
eral,  the  method  does  not  allow  the  control  of  the  final  trajec¬ 
tory  of  the  parallel  system;  in  the  most  extreme  cases,  it  may 
yield  a  system  with  negative  mobility,  that  can  be  assembled 
at  each  task  positions  but  cannot  be  driven  from  task  position 
to  task  position. 

The  kinematic  mapping  is  used  for  the  synthesis  of  pla¬ 
nar  and  spherical  linkages  in  order  to  state  design  equations 
and  to  provide  a  tool  for  visualizing  the  workspace  and  tra¬ 
jectories  of  the  linkage.  See  Ravani  and  Roth  [14]  and  more 
recent  applications  by  Hayes  [15],  Schrocker  [16]  and  Wu 
and  Ge  [17].  For  spatial  motion.  Study’s  kinematic  mapping 
is  used  to  obtain  simplified  equations  for  analysis  and  synthe¬ 
sis,  see  Husty  et  al.  [18]  and  [19].  However,  the  kinematic 
image  for  the  spatial  motion  is  a  six-dimensional  quadric  and 
that  makes  the  visualization  of  workspaces  and  trajectories 
difficult  for  the  designer. 

In  this  paper,  the  workspace  of  the  linkage  is  visualized 
as  a  set  of  finite  screws  corresponding  to  the  set  of  finite  dis¬ 
placements  of  the  end-effector.  One  interesting  question  is 
whether  the  finite- screw  surfaces  generated  by  a  set  of  task 
positions  can  give  any  information  for  the  synthesis  of  paral¬ 
lel  robots  and,  in  particular,  of  some  overconstrained  closed 
linkages.  Using  Parkin’s  definition  for  pitch  [20],  the  screws 
corresponding  to  finite  displacements  of  some  linkages  can 
form  screw  systems.  Huang  [21]  showed  that  the  single  RR 
chain  forms  a  finite  screw  system  of  third  order;  however, 
the  set  of  finite  displacements  of  the  coupler  of  the  Bennett 
linkage  form  a  cylindroid,  which  is  a  general  2- system  of 
screws  [22].  Baker  [23]  has  also  studied  the  motion  of  the 
Bennett  linkage.  Perez  and  McCarthy  [24]  used  two  arbitrary 
displacements  to  generate  the  cylindroid  of  finite  screws  as¬ 
sociated  to  the  Bennett  linkage  in  order  to  perform  dimen- 


sional  synthesis. 

In  this  paper,  the  focus  is  on  the  simplest  of  the  over¬ 
constrained  linkages,  the  closed  spatial  RPRP  linkage.  This 
linkage  is  one  of  the  Delassus  linkages,  later  studied  by  Wal¬ 
dron  [25]  and  Baker  [26].  Recently,  Huang  [27]  has  shown 
that  the  set  of  screws  corresponding  to  displacements  of  this 
linkage  forms  a  2-screw  system.  We  use  this  result  in  order 
to  synthesize  RPRP  linkages  with  positive  mobility  and  for  a 
given  shape  of  the  screw  system  of  relative  displacements.  In 
order  to  do  so,  we  state  the  design  equations  using  the  Clif¬ 
ford  algebra  of  dual  quaternions  [28].  The  dual  quaternion 
expression  can  be  easily  related  to  the  screw  system  and  it 
is  also  used  to  assign  the  magnitude  to  the  screws  in  order 
to  obtain  the  correspondence  between  the  screw  system  and 
the  trajectory  of  the  end-effector.  The  design  yields  a  single 
RPRP  linkage. 


2  Clifford  Algebra  Equations  for  the  Synthesis 

The  approach  used  in  this  paper  for  stating  design  equa¬ 
tions  is  based  on  the  method  of  Lee  and  Mavroidis  [29] .  They 
equate  the  forward  kinematics  of  a  serial  chain  to  a  set  of  goal 
displacements  and  consider  the  Denavit-Hartenberg  parame¬ 
ters  as  variables.  A  more  efficient  formulation  for  our  pur¬ 
poses  consists  of  stating  the  forward  kinematics  of  relative 
displacements  using  the  even  Clifford  subalgebra  of  the  pro¬ 
jective  space  C+(P^),  also  known  as  dual  quaternions  [28]. 

The  Plucker  coordinates  S  =  (s,  c  x  s)  of  a  line  can  be 
identified  with  the  Clifford  algebra  element  S  =  s  +  £c  x  s, 
with  8^  =  0.  Similarly,  a  screw  J  becomes  the  element  J  = 

(1  +^£)S,  where  ju  is  the  pitch.  Using  the  Clifford  product 
we  can  compute  the  exponential  of  the  screw  |  J, 

e.  .  0J.0...0J  Qxr'  Q 

=  (cos - sm-£)-l-(sm--|--cos-£)5  =  cos-+sm-5. 

22  2^^22  2^  2  2 

(1) 

The  exponential  of  a  screw  defines  a  unit  dual  quater¬ 
nion,  which  can  be  identified  with  a  relative  displacement 
from  an  initial  position  to  a  final  position  in  terms  of  a  rota¬ 
tion  around  and  a  slide  along  an  axis. 


G2 


2.1  Forward  Kinematics 

For  a  serial  chain  with  n  joints,  in  which  each  joint  can 
rotate  an  angle  0;  and  slide  a  distance  di,  around  and  along 
the  axis  S/,  i  =  1, . . .  ,^,  the  forward  kinematics  of  relative 
displacements  (with  respect  to  a  reference  position)  can  be 
expressed  as  the  composition  of  Clifford  algebra  elements 
corresponding  to  the  motion  of  each  joint.  Let  0o  and  do 
be  the  joint  parameters  of  this  chain  when  in  the  reference 

configuration,  so  we  have  A0  =  (0  —  0o  +  (J  —  do)£).  Then, 
the  movement  from  this  reference  configuration  is  defined  by 


2(A0)  — — ^ 


,  A01  .  A01 

(cos— — hsm— —  bi) 


,  A02  ,  .  A02_  .  .  A0^  .  A0. 

(cos  —  -1-  sm  — S2)  •  •  •  (cos  —  -1-  sm  — S„). 


(2) 


The  RPRP  linkage  has  a  mobility  M  =  —2  using  the 
Kutzbach-Gruebler  formula;  however,  for  certain  dimen¬ 
sions  of  the  links,  it  moves  with  one  degree  of  freedom. 
Waldron  [25]  shows  that  the  RPRP  linkage  will  have  posi¬ 
tive  mobility  only  if  both  revolute  joints  are  parallel,  and  the 
directions  of  the  prismatic  joints  are  symmetric  with  respect 
to  the  plane  containing  the  revolute  joints. 

The  RPRP  linkage  can  be  seen  as  a  serial  RP  chain  and 
a  serial  PR  chain  joined  at  their  end-effectors.  The  RP  se¬ 
rial  chain  consists  of  a  revolute  joint  followed  by  a  prismatic 
joint.  Figure  1  shows  the  RP  serial  chain  and  Figure  2  shows 
a  sketch  of  the  RPRP  linkage  with  its  axes.  In  the  PR  serial 
chain,  the  order  of  the  joints  in  the  chain  is  switched. 

For  both  the  RP  and  PR  serial  chains,  let  G  =  g  +  £g^  be 
the  revolute  joint  axis,  with  rotation  0,  and  H  =  h  +  £h^  the 
prismatic  joint  axis,  with  slide  d.  Notice  that,  for  synthesis 


purposes,  the  location  of  the  slider,  given  by  h^,  is  irrelevant. 
The  Clifford  algebra  forward  kinematics  equations  for  the 
RP  chain  are 


QRp{^%,^d)  =  (cos  — +  sin— G)(1+£— H) 

,  Ae  .  A0  ,  ,AJ  A0, 

=  (cos  —  +  sin  — g)  +  8(  —  cos  — h+ 

.  A0  Q  AJ  .  A0 

sm— g  +  — sin  — (gxh-g-h)).  (3) 

For  the  PR  chain,  the  only  difference  is  a  negative  sign  in  the 
cross  product.  In  Eq.  (3),  the  angle  and  slide  are  measured 
from  a  reference  configuration. 


2.2  Design  Equations  and  Counting 

Given  a  set  of  m  task  positions  expressed  as  relative  dis¬ 
placements,  P\j  =  cos  +  sin  7  =  2, . . .  ,m,  we 

equate  them  to  the  forward  kinematics  equations  in  Eq.  (2), 


Pij  =  e~ 


^2  . 


j  =  2,...,m  (4) 


in  order  to  create  the  design  equations. 

The  result  is  8  (m  —  1)  design  equations.  The  design  vari¬ 
ables  that  determine  the  dimensions  of  the  chain  are  the  n 
joint  axes  S/,  i  =  1, . . .  ,^,  in  the  reference  configuration.  In 
addition,  the  equations  cointain  the  ^(m  —  1)  pairs  of  joint 
parameters  A0/7  =  A0/7  +  Adij£,  which  are  also  unknown. 

For  the  RP  (and  similarly  for  the  PR)  serial  chain,  the 
design  equations  are 

QRp{AeJ,M^)=Pij,  j  =  2,...,m.  (5) 


In  order  to  determine  the  maximum  number  of  task  po¬ 
sitions  for  the  RP  and  PR  chains,  we  apply  Eq.  (6)  to  obtain 
m  =  2.5  task  positions.  Additional  information  is  obtained 
using  Eq.  (7)  to  compute  mR  =  2  task  rotations,  and  mt  =  3 
task  translations.  Hence,  we  can  define  one  arbitrary  rela¬ 
tive  displacement  and  a  second  relative  displacement  whose 
orientation  is  not  general. 


3  Screw  System  for  the  RPRP  Linkage 

In  the  context  of  this  paper,  a  finite- screw  surface  is  a 
ruled  surface  in  which  the  lines  with  their  associated  pitch 
correspond  to  relative  displacements.  A  screw  surface  will 
be  a  screw  system  if  it  is  closed  under  addition  and  scalar 
multiplication,  that  is,  if  every  screw  of  the  set  can  be  written 
as  a  linear  combination  of  screws  belonging  to  it. 


3.1  The  finite  Screw  System  Generated  by  the  Motion 
of  the  RPRP  Linkage 

The  linear  combination  of  two  arbitrary  screws  repre¬ 
senting  relative  displacements  form  a  2- system  known  as  the 
cylindroid,  which  turns  out  to  be  the  manifold  for  the  rel¬ 
ative  displacements  of  the  closed  4R  linkage.  Huang  [27], 
by  intersecting  the  3-systems  associated  with  the  finite  dis¬ 
placements  of  the  RP  and  PR  dyads,  shows  that  the  screw 
surface  of  the  closed  RPRP  linkage  forms  a  2-system  of  a 
special  type,  the  fourth  special  type  according  to  Hunt  [31], 
also  known  as  2-IB  [32].  The  screws  of  this  system  are  par¬ 
allel,  coplanar  screws  whose  pitches  vary  linearly  with  their 
distance. 

The  screw  system  corresponding  to  the  RPRP  linkage 
can  be  obtained  in  a  quite  straightforward  way  by  using  the 
composition  of  relative  displacements  at  each  joint,  as  ex¬ 
pressed  in  Eq.(3).  Let  us  denote  the  resulting  displacements 


The  counting  of  independent  equations  and  unknowns 
defines  the  maximum  number  of  arbitrary  positions  m  that 
can  be  reached,  based  only  on  the  type  and  number  of  joints 
of  the  serial  chain,  see  [30]  for  details.  Consider  a  serial 
chain  with  r  revolute  and  p  prismatic  joints.  The  maximum 
number  of  task  positions  is  given  by 


3r  +  p-\-6 
6-{r^p)' 


(6) 


QRp{Ad,Ad)  =  cos 


All/  .  A\|/^ 

— +  sm— S^P  = 


,  A\^  At  .  A^\f.  .  A\^, 

(cos  — - 8—  sm  — — )  +  sm  — —  ( 1 

^  2  2  2  ^  2  ^ 


A 

2 


tan 


A\\f 


(8) 


where  A\\f  and  At  are  the  angle  about  and  slide  along  the 
screw  axis  Srp  of  the  resulting  relative  displacement.  Ex¬ 
pand  the  product  in  Eq.(3)  and  separate  the  dual  scalar  and 
the  dual  vector  part,  so  that 


Eor  serial  chains  with  less  than  three  revolute  joints,  the 
structure  of  semi-direct  product  of  the  composition  of  dis¬ 
placements  needs  to  be  considered,  and  the  maximum  num¬ 
ber  of  rotations  mp  needs  to  be  calculated  too.  Assuming  that 
the  orientations  are  given  and  that  both  the  directions  of  the 
revolute  joints  and  the  angles  to  reach  the  task  orientations 
are  known,  we  can  count,  in  a  similar  fashion,  the  number  of 
translations  mp  that  the  chain  can  be  defined  for. 


3  -f  r 
3^’ 


2r  +  /7  +  3 
3-p 


(7) 


All/  At  .  A\\f  A0 

cos  — - 8—  sm  — —  =  cos  — 

2  2  2  2 

sin^(l+8^^)S«P  = 


Ad  .  A0^  ,, 
-8—  sm  — G  •  H 
2  2 


2  tan 


A\\f ' 
2 


.  A0^  Ad  A0..  Ad  .  A0^  .. 

sm— G  +  8— cos— H  +  8— sm  — G  x  H.  (9) 


Eor  studying  the  screw  system,  we  are  only  interested  in 
the  dual- vector  part  of  Eq.(9),  which  defines  the  lines  with 
their  associated  pitch. 


mp  = 


mp  = 


The  resulting  screw  is  parameterized  by  joint  variables 
A0  of  the  revolute  joint  and  AJ  corresponding  to  the  pris¬ 
matic  joint.  We  denote  the  expression  in  Eq.(9)  as  the  finite 
kinematic  generator  of  the  screw  system.  In  the  case  of  finite 
displacements,  the  screw  systems  correspond  to  subspaces  of 
a  projective  space,  and  so  we  take  the  unit  screws  as  repre¬ 
sentatives  by  dividing  the  dual  vector  of  Eq.(9)  by  sin^. 
Erom  the  real  part  of  the  first  equation  in  (9)  we  can  see  that 
sin  ^  ±  sin  ^ ,  so  that 


which  is  different  from  zero  when  the  angle  0  and  the  slide  d 
are  independent,  except  for  special  parallel  or  perpendicular 
arrangements  of  the  joints.  Hence,  a  maximal  set  of  indepen¬ 
dent  screws  has  cardinality  3. 

In  order  to  generate  the  screw  system  of  the  RPRP  link¬ 
age,  we  impose  the  motion  constraint  relations  between  the 
joint  variables.  The  conditions  are  derived  in  [27]  from  the 
closure  equations  of  the  linkage,  to  obtain 


A.  M  A  j 

GxH.  (10) 

tan  ^  tan  ^  2 

If  we  give  values  to  the  joint  variables  A0  and  AJ,  we 
will  generate  a  screw  surface  of  dimension  3  of  a  special 
type,  in  which  all  the  screws  have  parallel  directions. 

It  is  easy  to  show  that  the  set  of  screws  generated  by  the 
motion  of  the  RP  serial  chain  is  indeed  a  screw  system,  that 
is,  closed  under  addition  and  multiplication  by  scalar.  Gener¬ 
ate  two  unit  screws  S\  and  S2  using  Eq.(lO)  and  perform  the 
linear  combination  with  real  constants  k\  and  ^2.  We  normal¬ 
ize  the  resulting  screw  by  dividing  by  k\  +  ^2  to  obtain 

=g  +  e(g'’  +  e^rh  +  e-^gxh), 

tan^  2 

(11) 


where 


A^/r  — 


k\ 


k\  +^2 


A0C 

tan — ^  = 


AJi- 

AJi 


h 


k\  -\rk2 


AJ2, 


M2 

2 


k\- 


(12) 


■  Afe- 


^02 


hence  the  linear  combination  belongs  to  the  screw  system 
generated  by  the  relative  motion  of  the  RP  chain.  Next  is  to 
calculate  the  dimension  of  this  screw  system.  Notice  that  the 
direction  of  all  unit  screws  generated  is  equal  to  g,  then  we 
just  need  to  look  at  the  dimension  of  the  dual  part.  Generate 
three  screws  with  values  A0;  and  AJ/,  /  =  1 , 2, 3.  Eor  the  three 
vectors  corresponding  to  the  dual  part  to  be  linearly  indepen¬ 
dent,  the  determinant  of  the  column  vector  matrix  must  be 
different  from  zero.  We  obtain  the  value  for  the  determinant 


d  =  J2, 

0  =  ±(02  -:t), 
tan  I  sinai2 
d  a\2^a22 


(14) 


where  the  twist  angle  a\2  and  link  lengths  a\2,  <223  are  shown 
in  Eigure  2;  the  angles  0,  02  and  slides  d,  J2,  also  shown  in 
Eigure  2,  have  to  be  measured  according  to  the  convention 
[27]  from  the  previous  common  normal  line.  The  plus/minus 
sign  corresponds  to  folded  and  unfolded  linkages.  Eor  our 
purposes,  only  the  third  condition  is  needed.  It  is  important 
to  notice  that  this  condition  applies  to  absolute  values  of  the 
joint  variables,  measured  from  the  previous  common  normal 
line  as  stated  before. 

In  order  to  use  this  relation,  substitute  Ad  =  d  —  do, 
A0  =  0  —  00  to  apply  Eq.(14)  so  that  the  resulting  expression 
depends  only  on  d,  for  instance.  Eor  all  possible  values  of  the 
slide  d,  this  generates  a  2-IB  system  of  screws  [31, 32].  This 
can  be  checked  numerically  by  generating  6  random  screws 
and  computing  the  rank  of  the  matrix  that  has  the  screws  as 
columns.  In  this  case,  the  rank  is  2.  It  can  also  be  shown  that 
when  the  third  condition  in  Eq.(14)  holds,  the  determinant  in 
Eq.(13)  is  equal  to  zero. 

The  unit  screws  of  the  system  can  be  related  to  spa¬ 
tial  displacements  if  we  add  the  value  of  the  magnitude  of 
the  screw.  Eor  finite  displacement  screws,  the  value  of  the 
magnitude  related  to  each  screw  is  unique;  this  is  due  to  the 
fact  that  finite  screw  systems  are  projective  subspaces  [33]. 
The  information  about  the  magnitude  corresponding  to  each 
screw  can  be  extracted  from  the  scalar  part  of  the  dual  quater¬ 
nion  product  in  Eq.(9).  This  equation  relates  the  rotation 
associated  to  the  resulting  screw,  A\j/,  to  the  joint  variables 
of  the  kinematic  chain.  Eor  the  RPRP  chain,  this  yields 
sin  ^  =  ±  sin  ^  as  noted  before. 

Eigure  3  illustrates  the  nonlinear  relation  between  the 
screws  generated  by  an  RPRP  closed  chain  and  the  corre¬ 
sponding  set  of  absolute  positions  of  the  end  effector  (for 
those  positions  we  assume  that  the  reference  configuration  is 
the  identity).  We  use  as  values  for  the  linkage  those  of  an 
example  from  [27]. 


det([s°])  =g-h 


g'’-h( 


/AJ3  ^  Ad2. 


^  Ml  Mi  ^  M2  Ml 

tan^^  2  2  2  2  ’’’ 

(13) 


3.2  The  Finite  Screw  System  Generated  as  a  Linear 
Combination  of  Two  Screws 

It  has  been  shown  that  the  relative  displacements  of  the 
RPRP  chain  generate  a  2-IB  finite  screw  system.  By  defini¬ 
tion,  this  same  screw  system  can  be  generated  as  the  linear 
combination  of  two  screws  with  same  direction  and  arbitrary 


Fig.  3.  Screw  system  generated  by  the  RPRP  linkage,  above;  cor¬ 
responding  absolute  displacements,  below 


location  and  (possibly)  finite  pitches.  From  a  synthesis  point 
of  view,  the  key  is  that  this  coincides  with  the  results  of  the 
counting  in  section  2.2.  The  task  positions  defined  for  the 
synthesis  of  the  RP  (or  PR)  chain  are  two  relative  displace¬ 
ments  with  same  direction  and,  in  general,  finite  pitches. 

The  screw  system  is  characterized  by  the  pitch  distribu¬ 
tion  as  a  linear  function  of  the  distance  between  screws  along 
a  common  normal.  In  this  derivation  we  can  parameterize  the 
results  as  a  function  of  the  angle  0  or  the  slide  d. 

Consider  the  screw  Srp  =  (1  +  ^p)Srp  =  Srp  +  es^^.The 

s 

pitch  is  obtained  by  computing  p  =  in  Eq.(lO), 


the  axis,  Crp  =  ^^rp-Srp  computing  the  norm  of  the  dif¬ 
ference  for  two  of  them. 


cb-ca  =  (^gxh+i(gg-h-h))(J5-^/A) 
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The  slope  of  the  (linear)  pitch  distribution  is  computed 
as 


PB-PA 

N-CAir 


(19) 


and  for  the  RPRP  chain  we  can  simplify  the  expression  to 


K  =  ± 


cosai2 


Jq  sin^  ai2  +  (<^12  +  <^23)^ 


,  ,  cosai2  .  00 

do  =  ±  — - sm  — . 

smai2  2 


(20) 

Notice  that  the  slope  is  constant  and  depends  on  the  initial 
configuration.  The  sign  is  negative  if  dp  <  dA  or  if  tan  2  ^ 
tan^. 

The  screw  system  is  related  to  the  displacement  of  the 
RPRP  linkage  by  computing  the  distribution  of  the  magni¬ 
tude  with  respect  to  the  known  pitch,  distance  and  magnitude 
of  the  screws  Sa  and  Sr  used  to  define  the  distribution.  Con¬ 
sider  the  magnitude  of  the  screws  as  m  =  sin  ^  ±  sin  ^ . 

Knowing  the  magnitude  and  pitch  of  screws  Sa  and  5^,  we 
can  solve  for  the  magnitude  me  of  a  screw  Sc  using  Eq.(18) 


^  .  A0C  X 

me  =  ±  sm - =  ,  , 

2 


(21) 


where  the  factor  X  is  simplified  using  Eq.(15)  to  (20)  to 


1  -|-  k^ddo  ,  1  / . 

P  = - S-h  =  — (1 

^  2k  ^  2k^ 


-tany  tan-)g-h.  (15) 


For  two  screws  Sa  and  Sp,  the  difference  in  the  pitches  is 
given  by 


Pb 


kdog-h  tanfg-h  0^  0^ 

-PA  =  — ^ — {dB-dA)  = - ^ - (tany -tany) 

(16) 

The  distance  between  two  screws  along  the  common 
normal  is  calculated  by  finding  the  perpendicular  point  on 


||cB-CA||pAtan^-  ||cc-CA||(i3Atan^±PBtan^) 

“  \\cb-Ca\\pc 

(22) 

The  positive  and  negative  signs  in  the  expression  of  X 
correspond  to  the  sign  of  the  tan  ^  —  tan  ^  factor. 

3.3  Defining  the  Kinematic  Task  as  a  Finite  Screw  Sys¬ 
tem 

It  is  now  possible  to  define  the  screw  system  as  the  input 
task  for  the  dimensional  synthesis  of  the  RPRP  closed  chain. 


As  a  linear  subspace,  it  is  easy  to  shape  the  task  at  our  conve¬ 
nience.  Once  we  have  a  satisfactory  screw  system,  any  two 
screws  from  it  can  be  selected  to  perform  the  dimensional 
synthesis  and  to  obtain  a  finite  number  of  solutions  (in  this 
case,  just  one). 

We  have  several  strategies  for  shaping  the  screw  sys¬ 
tem.  For  instance,  we  can  define  a  first  relative  displace¬ 
ment,  §12  =  COS  ^  +  sin  ^  (si2  +  £8^2)-  rotation  axis  of 

the  displacement,  S12  is  common  to  both  §12  and  the  second 
relative  displacement.  We  set  S12  =  S13  and  select  a  rotation 
angle  to  define  the  relative  rotation  ^13. 

We  can  then  set  the  slope  of  the  pitch  distribution  in  or¬ 
der  to  shape  the  screw  system.  The  pitch  for  the  finite  dis¬ 
placement  screws  is  [20] 


Pii  = 
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tan 
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(23) 


The  equations  corresponding  to  the  dual  part  are  linear  in  the 
moment  of  the  revolute  joint,  g^. 
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Adi 


A01 


sm 


AOi/ 
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gxh)), 
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(26) 


Equating  the  solution  of  g®  for  both  relative  displacements, 
we  can  solve  linearly  for  h  as  a  function  of  the  slides  AJ12, 
AJ13.  The  relation  between  the  slides  is  given  by  the  pitch 
condition. 


(27) 


Imposing  ||h||  =  1,  we  can  solve  for  the  slides  to  obtain  one 
solution.  Using  the  same  process,  we  can  solve  for  the  PR 
serial  chain. 


directly  calculated  from  the  dual  quaternion  using  pn  = 

St  -S^- 

.  Similarly,  a  point  on  the  screw  axis  is  calculated  as 


Define  the  slope  of  the  distribution  as  ^  ,  accord¬ 

ing  to  Eq.(20).  If  we  set  the  value  of  K,  we  can  solve  for 
Atis  in  order  to  define  the  pitch  of  the  second  relative  dis¬ 
placement,  the  location  of  its  screw  axis  being  defined.  This 
is  one  possible  way  of  defining  the  screw  system.  Convert¬ 
ing  from  this  to  absolute  displacements  we  can  easily  check 
whether  the  trajectory  for  the  synthesis  is  acceptable. 

Any  other  strategy  to  basically  define  a  triangle  in  space 
can  be  used.  The  purpose  of  this  is  to  have  a  better  control  on 
the  shape  of  the  trajectory  of  the  linkage  than  the  one  given 
by  just  two  separate  finite  positions. 


5  Examples 

Two  examples  are  presented  below.  The  first  one  is  per¬ 
formed  to  check  the  method,  while  for  the  second  one,  a  fully 
general  task  is  used. 

5.1  First  Example 

In  this  first  case,  the  two  relative  displacements  are  gen¬ 
erated  using  the  RP  chain  presented  in  Huang  [27].  In  this 
example,  the  revolute  joint  is  located  at  the  origin  and  the 
prismatic  joint  is  located  along  the  v  direction  with  a  twist 
angle  of  ai2  =  7t/5  and  link  length  an  =  5.  We  use  the  loop 
condition  in  Eq.(14)  and  random  values  for  the  slide  to  gen¬ 
erate  the  set  of  relative  displacements  of  the  corresponding 
RPRP  closed  chain.  Erom  those,  we  randomly  select  two 
displacements,  the  ones  in  Table  1. 

Table  1.  Goal  relative  displacements  for  the  RP  and  PR  chains, 
Huang’s  example 


4  Dimensional  Synthesis  of  the  RPRP  Linkage  for  a 
Prescribed  Screw  System 

The  synthesis  of  the  RP,  and  similarly,  PR  chains,  is  sim¬ 
ple  and  yields  one  solution.  In  general,  the  task  positions 
are  expressed  as  relative  displacements  Qn  =  QiQ^^  with 
respect  to  the  first  task  position  Qi  .Eor  the  RP  or  PR  chains, 
the  maximum  number  of  task  positions  that  we  can  define  is 
/  =  3,  as  explained  in  section  2.2.  Given  an  arbitrary  relative 
displacement  Qn  =  (^n  +  ^12)  +  ^(^12  ^12)  ^  second 

displacement  2i 3  =  (^^3 +  ^13) +^(^13+^13)  such  that  both 
have  same  direction  and  a  given  pitch  distribution,  we  equate 
them  to  the  forward  kinematics  in  Eq.(3).  We  can  solve  for 
the  direction  of  the  revolute  joint  g  and  the  rotation  angles. 


g  = 


qi2 

Ilqi2ir 


tan 


A9i,-  ||qi,|| 

2  ^ 


i  =  2,3. 


(25) 


(0, 0,  -0.05, 0.99)  +  8(0.02, 0.37,  -0.5 1 ,  -0.03) 
(0,0, -0.34, 0.94) +8(0.80, 2.23, -3.08, -1.10) 


The  resulting  screw  system  is  shown  in  Eigure  4,  where 
the  length  of  each  screw  is  proportional  to  its  pitch.  Also 
the  corresponding  trajectory  of  absolute  displacements,  con- 
isdering  the  reference  position  as  the  identity,  is  shown  in 
same  Eigure. 

Using  the  synthesis  procedure  explained  in  Section  4, 
we  obtain  the  RP  and  PR  chains  of  Table  2.  Notice  that  they 
coincide  with  the  values  given  in  [27],  which  means  this  is 
a  folded  RPRP  overconstrained  movable  linkage.  Eigure  5 
shows  the  linkage  reaching  some  of  the  positions.  Notice 
that  the  shape  of  the  coupler  link  attached  to  the  end  effector 
depends  on  the  position  chosen  as  reference  configuration. 


Fig.  4.  Above,  screw  system  generated  by  S12  and  S13  (shown  as 
first  and  last  screws);  below,  corresponding  absolute  displacements 
with  reference  displacement  being  the  identity 


Fig.  5.  RPRP  linkage  reaching  three  positions  of  the  trajectory 


5.2  Second  example 

For  the  second  example,  the  dual  quaternions  in  Table 
3  have  been  generated  as  explained.  §12  has  been  randomly 
generated,  while  the  rotation  in  ^13  is  such  that  it  belongs  to 
the  workspace  of  the  chain. 

We  set  the  location  of  the  second  screw  axis  of  the  rela¬ 
tive  displacement  with  a  point  P13  =  (0.083,2.159,-3.226), 
randomly  generated.  Then  we  choose  a  value  for  the  slope  of 
the  pitch  distribution,  K  =  0.480,  which  allows  us  to  create 
the  second  relative  displacement. 

The  resulting  screw  system  is  shown  in  Figure  6,  where 


Table  2.  Joint  axes  for  the  RPRP  linkage  at  the  reference  configu¬ 
ration,  Example  1 
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Table  3.  Goal  relative  displacements  for  the  RP  and  PR  chains 


(0.46,  -0.13,  -0.56,  -0.67)  +£(1.66,0.34,  -0.02, 1.08) 
(0.13,  -0.04,  -0.17,0.98)  +£(0.02,  -0.57,  -0.92,  -0.18) 


the  length  of  each  screw  is  proportional  to  its  pitch.  The  cor¬ 
responding  trajectory  of  absolute  displacements,  conisdering 
the  reference  position  as  the  identity,  is  shown  in  Figure  7. 

We  obtain  one  solution  for  the  RPRP  linkage,  specified 
in  Table  4  as  the  Pliicker  coordinates  of  the  axes  and  the  joint 
variables  to  reach  the  positions. 

Again,  the  dimensions  form  an  overconstrained  mov¬ 
able  RPRP  linkage.  Figure  8  shows  the  chain  reaching  three 
displacements  along  the  trajectory,  considering  the  reference 
displacement  as  the  identity. 

6  Conclusions 

This  papers  presents  the  exact  workspace  synthesis  of  an 
overconstrained  closed  linkage,  the  RPRP.  The  knowledge  of 
the  screw  system  that  corresponds  to  the  finite  displacements 
of  the  linkage  is  used  to  generate  the  workspace  of  the  link¬ 
age,  which  in  turn  ensures  that  the  solutions  of  the  synthesis 
of  the  RP  and  PR  serial  chains  can  be  assembled  to  create  a 
movable  system.  The  counting  of  the  maximum  number  of 
positions  for  the  finite-position  synthesis  of  the  serial  chain 
turns  out  to  fully  define  the  finite  screw  system  of  the  link¬ 
age.  This  provides  an  easy  method  to  shape  the  whole  trajec¬ 
tory  of  the  RPRP  linkage  as  an  input  for  the  synthesis  pro¬ 
cess.  Even  though  the  method  targets  the  whole  motion  of 
the  linkage,  the  synthesis  equations  need  to  be  stated  only  at 


Fig.  6.  Screw  system  generated  by  512  and  5i3  (first  and  last 
screws) 


the  task  positions  used  to  generate  the  linear  combination  of 
screws,  hence  the  finite-position  synthesis  equations  can  still 
be  used.  The  method  yields  a  single  RPRP  linkage. 
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Design  of  a  Prosthetic  Hand  with  Remote  Actuation* 

Kurt  Scott,  Alba  Perez-Gracia 


Abstract —  One  of  the  main  issues  of  prosthetic  hands  is  to  be 
able  to  fulfill  all  the  specifications  about  speed,  torque,  weight 
and  inertia  while  placing  all  the  components  within  the 
prosthetic  hand.  This  is  especially  true  when  full  dexterity  is 
required  in  the  prosthesis.  In  this  paper,  a  new  design  for  a 
prosthetic  hand  is  presented,  which  uses  remote  actuation  in 
order  to  satisfy  most  of  those  requirements.  The  actuators  are 
to  be  located  in  the  back  of  the  subject  and  the  transmission  is 
implemented  via  cables.  Other  characteristics  of  this  new 
prosthetic  hand  include  torque  limitation  and  the  possibility  of 
switching  between  underactuated  and  fully  actuated  functions. 


1.  INTRODUCTION 
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The  design  of  robotic  prosthetic  hands  is  a  very  active 
field  of  research.  Recent  research  has  focused  on  finding 
better  actuation  systems  [1-4],  integrating  some  compliance 
in  the  design  [5-8],  and  generating  better  control  strategies 
or  input  signals  [8-10].  In  addition  to  this,  newer  mechanical 
designs  of  fingers  and  hands  are  also  being  developed 
[5,6,11,12,13,14].  Some  robotic  hands  that  could  be  used  for 
prosthetics  are  in  an  advanced  design  stage,  such  as  DLR 
hand,  i-Limb  hand.  Shadow  hand,  and  fluidhand  [2]. 
However,  a  prosthetic  hand  with  all  the  properties  desired  by 
^ the  users  [15,  16]  has  yet  to  be  achieved. 

The  main  reason  for  the  current  state  of  hand  prostheses 
is  the  complexity  associated  with  the  human  hand,  with  its 
many  actuators  and  sensors,  which  makes  use  of  forearm 
muscles,  nervous  system,  and  body’s  energy  generation 
system.  Fitting  all  needed  components  within  the  physical 
size  of  the  hand  requires  a  degree  of  miniaturization  that  is 
still  to  be  achieved. 

There  are  two  primary  designs  that  are  commonly  used 
to  specify  how  a  robotic  hand  is  actuated.  Using  one  actuator 
for  each  degree  of  freedom  produces  a  fully-actuated  system. 
This  approach  allows  maximum  dexterity  and  manipulation, 
but  often  results  in  a  bulky  design  requiring  complex  control 
algorithms  and  elaborate  sensor  modules  for  each  degree  of 
freedom.  Underactuated  systems,  which  require  fewer 
actuators,  have  been  known  to  adapt  to  variable 
environmental  conditions  without  the  use  of  sensors  [17], 
[18],  [19].  This  approach  simplifies  the  control  algorithms 
by  sacrificing  hand  function,  strength,  and  the  ability  for  the 
hand  to  adapt  to  the  user. 
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The  human  hand  has  an  average  weight  of  400  grams 
[20]  (distal  to  the  wrist  and  not  including  the  forearm 
extrinsic  muscles).  However,  prosthetic  terminal  devices  of 
similar  weight  have  been  described  as  being  too  heavy  by 
users  [21].  This  is  primarily  because  the  attachment  methods 
between  the  prosthesis  and  the  user  compound  the  effects  of 
the  weight  in  the  terminal  device.  Although  researchers  are 
currently  working  to  alleviate  attachment  problems  through 
the  use  of  integrated  attachment  mechanisms,  the  weight  of 
the  prosthesis  is  a  key  contributor  to  interface  discomforts 
and  user  fatigue  [22]. 

In  this  paper,  we  explore  two  specific  problems 
associated  with  robotic  prosthetics:  1)  the  ability  for  the 
robot  to  adapt  to  the  user  and  2)  the  reduction  in  weight  on 
ergonomics. 

Our  solution  uses  a  remote -actuation,  hybrid  design, 
with  an  external  multi-degree-of-freedom  actuating  system 
that  can  be  switched  from  coupled  actuation  to  full 
actuation. 

A  key  performance  of  this  hybrid  design  is  to  produce 
power  grasps  that  passively  make  contact  at  multiple  points, 
thereby  providing  the  user  the  ability  to  apply  the  desired 
force  on  the  object  from  multiple  contact  points.  Due  to  the"^ 
limited  number  of  actuators  and  the  uncertainty  in  object 
location  and  shape,  the  coupled  actuation  must  be  designed 
to  minimize  situations  in  witch  not  all  links  make  contact 
with  the  object. 

It  is  expected  that  the  flexibility  associated  with  this 
design  will  allow  for  a  better  adaptation  to  the  many 
different  types  of  amputees. 
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11.  Mechanical  Design 


A.  Hand  Structure 


The  overall  shape  and  size  of  the  hand  is  based  on  the 
average  human  hand.  This  includes  five  fingers  and  a  thumb 
that  are  attached  to  a  fixed  palm.  Revolute  joints  make  up  the 
10  degrees  of  freedom  for  the  interphalangeal  (IP)  joints  of 
the  fingers  and  IP  and  MCP  joints  of  the  thumb.  Universal 
joints  are  used  in  the  Metacarpals  of  each  finger  (MCP  joints) 
and  the  CMC  joint  of  the  thumb,  as  well  as  the  combination 
of  flexion-extension  and  abduction-adduction  of  the  wrist. 
These  joint  make  up  the  other  12  degrees  of  freedom  in  this 
design.  Joint  actuation  is  created  by  a  cable  system  that 
converts  actuator  rotational  motion  to  linear  motion  and  that 
back  to  rotational  motion  in  the  joint. 
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To  achieve  the  desired  motion  in  a  lightweight,  durable 
construction,  the  hand  components  are  made  from  thin  gauge 
stainless  steel.  Individual  links  that  makeup  each  finger  and 
the  thumb  are  created  by  bending  thin  gauge  sheet  metal  into 
a  tube  like  section  that  allow  the  finger  pulleys,  cables,  and 
cable  conduit  to  be  discreetly  hidden  inside. 

The  palm  of  the  hand  is  constructed  in  a  similar  fashion 
using  shaped  sheet  metal  as  an  external  shell.  Consecutive 
links  are  connected  with  3  mm  axle  shafts  that  pass  through 
ball  bearings  creating  the  re  volute  and  universal  joints.  To 
drive  the  joint  motion,  0.039  diameter  Teflon-coated  cables 
pass  through  0.100  diameter  cable  conduit  as  it  is  roughed 
through  each  finger  to  the  palm  and  then  out  to  actuators 
located  away  from  the  hand.  Figure  1  shows  the  joint 
arrangement. 


B.  Joint  Actuation 


This  simple  design  is  repeated  for  the  Distal,  Proximal, 
and  Metacarpal  joints  of  each  finger  and  the  thumb. 
However  the  metacarpal  joints  on  each  finger  and  the  thumb 
are  universal  joints  and  add  a  second  degree  of  freedom  and 
a  second  pull-pull  actuation  cable  system  to  the  joint,  see 

Figure  2. 


The  linear  actuation  design  in  this  paper  operates  with  the 
use  of  a  pull-pull  cable  system.  Each  joint  is  controlled  by 
two  cables  that  pass  through  cable  conduits,  from  the 
actuator  to  the  joint  pulley.  The  actuator’s  rotational  motion 
causes  the  pulley  on  the  actuator  to  release  cable  on  one  side 
and  draw  cable  in  on  the  other.  This  results  in  a  rotation  of 
the  joint  pull  and  ultimately  a  rotation  of  the  joint.  In  reverse 
fashion  when  the  actuator  rotates  in  the  reverse  direction  the 
opposite  cable  is  drawn  or  pulled  in  causing  a  tension  in  the 


Figure  2:  Metacarpal  Universal  Joint 


The  2-dof  wrist  joint  is  also  a  universal  joint,  but  a  third 
rotational  degree  is  added  to  allow  hand 
pronation/supination.  This  results  in  23  degrees  of  freedom. 
Because  of  the  fact  that  the  distal  IP  joints  of  a  human  hand 
on  average  are  70%  coupled  to  the  Proximal  IP  joints,  the 
distal  joint  and  the  proximal  joint  of  this  design  are  actuated 
with  one  actuator  resulting  in  a  coupled  motion  for  each 
finger.  This  coupling  reduces  the  total  independent  degrees 
of  freedom  down  to  19. 

The  cable  conduit  that  is  used  to  route  the  cable  to  the 
specific  joint  is  a  Bowden  cable  design  and  provides-^ 
compression  strength  that  is  usually  provided  by  the  bones  in 
the  human  hand.  This  allows  thinner  material  to  be  used  in 
the  construction  of  the  fingers  and  palm  reduction  weight 
that  is  felt  by  the  user.  The  cables  act  as  tendons  that  in  this 
case  are  connected  to  actuators  instead  of  mussels.  A  cable 
passing  through  a  cable  conduit  can  be  seen  in  Figure  3. 
Notice  that  two  cables  are  needed  for  each  degree  of 
freedom. 
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Figure  3:  Cable  conduit 

III.  Actuation  Sensing 
A.  Faulhaber  Actuation 


To  minimize  the  overall  weight  seen  by  the  user,  the 
actuators  that  control  the  hand  motion  are  to  be  placed 
remotely,  in  an  operational  backpack.  This  allows  actuators 
to  be  sized  based  on  output  power  instead  of  overall 
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dimensions.  The  power  unit  that  is  used  to  power  both  the 
control  system  and  the  actuators  can  also  benefit  from  this 
design. 
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Figure  4:  Faulhaber  Gearmotor  and  Encoder 
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For  each  degree  of  freedom  a  Faulhaber  Gear  Motor  and 
Encoder  (Figure  4)  will  be  used  to  drive  the  19  active 
degrees  of  freedom.  The  windings  have  an  overall  resistance 
of  11  ohm,  which  means  the  motor  will  draw  0.55  amps  at 
6V  if  stalled.  The  motor  has  a  peak  efficiency  of  74%.  The 
no-load  motor  speed  is  13,400  RPM  at  6V  but  will  be  slower 
with  a  gearhead  attached.  Error!  Reference  source  not 
found,  shows  the  output  shaft  that  connects  to  the  actuator 
dive  pulley.  Resulting  forces  caused  by  tension  in  the  cables 
will  pass  through  the  actuator  mounting  screws  to  the 
actuator  mounting  plate,  then  to  the  cable  conduit. 

The  dual-channel  encoder  is  similar  to  an  HEM  encoder 
that  accepts  a  4.5v  to  15v.  To  measure  only  RPM  or 
distance,  the  encoder  has  two  channels,  one  of  them 
providing  one  high  pulse  per  revolution  of  the  motor.  There 
will  be  141  high  pulses  per  revolution  of  the  gearshift,  or 
about  2.55  degrees  of  final  output  rotation  per  pulse.  To 
increase  resolution  or  to  measure  rotation  direction,  the 
microcontroller  can  watch  both  channels  A  and  B.  The 
output  of  the  encoder  is  very  clean,  see  Figge  5. _ 


Figure  5:  Oscilloscope  trace  of  two  channel  encoder 


To  connect  the  gear  motors  to  the  individual  finger 
pulleys,  the  pull-pull  system  described  above  is  to  be 
utilized.  The  routing  of  the  individual  cable  conduits  is  yet  to 
be  developed. 


B.  Pressure  Sensing 

To  provide  tough/strength  of  grasp  sensing  in 
the  hand,  the  actuator  utilizes  a  variable  resistance  sensor. 
This  sensor  provides  feedback  to  the  controller  of  the  toque 
being  applied  by  the  actuator  to  the  finger.  In  simple  control 


layouts  the  input  voltage  for  the  motor  would  pass  through 
the  variable  resistor  controlling  the  speed  and  stopping 
signal  based  on  the  spring  constant.  In  more  complicated 
controls  this  resistive  signal  would  provide  the  force  input 
that  will  allow  one  finger  to  provide  more  force  then  another 
and  possibly  create  motion  of  object  that  have  already  been 
grasp. 

This  sensor  is  constructed  by  connecting  a  variable 
resistor  to  the  dive  hub  and  the  motor  pulley.  A  torsion 
spring  connects  the  motor  pulley  to  the  drive  hum.  When 
force  increased  due  to  object  contact,  this  force  is  carried 
through  the  actuation  cables  to  the  motor  pulley  and  then 
into  the  torsion  spring.  As  the  spring  stores  this  energy  it 
allows  the  motor  pulley  to  rotate  on  the  drive  hub  and 
change  the  resistance  in  the  variable  resistor.  This  change  in 
resistance  provides  feedback  to  the  motor  controller  on  the 
strength  of  grasp  that  the  robot  is  producing.  This  sensor  also 
provides  a  buffer  to  jerk  that  would  otherwise  be  produced 
in  the  actuation  system  during  grasp  contact.  A  diagram  of 
this  sensor  is  shown  in  Figure  6. 

One  of  the  main  benefits  of  using  this  type  of 
tough/strength  sensing  is  it  allows  for  contact  to  be  sensed 
no  matter  where  it  occurs  on  the  robotic  hand.  Pressure 
sensors  located  at  the  tips  of  each  finger  have  been  used  to 
provide  similar  sensing  however  if  object  contact  does  not 
happen  in  the  unit  normal  direction  this  force  can  be 
misinterpreted  by  the  sensor. 


Faulhaber  Gear 
motor 
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Variable  Resistor 


Figure  6:  Pressure  Sensor 


IV.  Motion  Analysis 


Because  this  design  does  not  incorporate  complex 
coupling  linkages,  the  kinematics  of  the  fingertip  positions  is 
relatively  simple.  Let  Ri,  R2  and  R3  be  the  lengths  of  the 
phalanges  and  0i  to  64  be  the  joint  angles  for  the  four  finger 
joints.  The  pose  of  the  fingertip  (point  B)  respect  to  point  A 
can  be  expressed  as  a  transformation,  where  the  orientation 
of  the  fingertip  is  given  by  the  quaternion 


(  0,  Or.  +  Or.  +  0  .  ^ 

sin(  — )sin(  ^ ^ - -) 

2  2 

0,  0,  +  0,  +  0, 

sin(  — )  cos( - ) 

2  2 

0.  0  J  +  0  r,  +  0  . 

cos(  — )  sin( - ) 

2  2 

6,  0,  +  0,  +  0. 

cos(  — )cos( - ) 
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Figure  7:  Joint  notation 


( cos(  0^){R^  cos(  0^)  +  cos(  ^2  +  ^3)  “  (2(^1  +  ^2)  +  ^3)cos(  ^2  +  ^3  +  ^4))^ 
/*„  =  I  sin(  6^2)  +  R2  sin(  6^2  +  6^3)  -  (2(i?j  +  R^)  +  ^^3) sin(  ^2  +  ^3  +  ^4) 


sin(  6^){-R^  cos(  O^)  -  R2  cos(  6^  +  0^)  +  (2(i?,  +  R^)  +  R^)cos{  ^2  +  ^3  +  ^4). 


Since  01,  02,  and  03  joints  are  controlled  by  their  own 
independent  actuator  and  03  and  04  are  coupled  1 : 1 ,  the  pose 
of  the  finger  can  be  quickly  determined. 


V.  Prototype 
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Solidworks®  CAD  software  (Figure  8)  will  allow  each 
link  in  the  hand  to  be  created  with  an  interlocking  design 
that  minimizes  weight  and  maintains  strength.  This  design 
also  allows  for  simple  maintains  on  the  joint  pulleys,  cables, 
and  cable  conduits  by  allowing  access  to  these  areas  without 
major  disassembly. 


Figure  8:  Sheet  Metal  Construction 


be 


The  remaining  palm  and  wrist  of  the  hand  will 
constructed  in  similar  fashion.  Formed  sheet  metal  stainless 
steel  plates  are  joined  together  to  form  the  bearing  carrier  for 
each  metacarpal  universal  joint.  The  thumb  of  the  hand  is 
constructed  the  like  each  finger  and  connected  to  the  palm 
plates  with  internal  sheet  metal  bearing  carriers.  Structural 
strange  of  the  system  is  achieved  after  all  components  are 


connected.  This  included  the  access  plates  that  are  used  to 
maintain  the  actuation  cables.  Actuators  for  each  degree  of 
motion  are  mounted  to  a  common  mounting  plate  that  is 
located  in  an  operational  backpack.  A  general  layout  of  the 
actuators  can  be  found  in  Figure  9. 


The  location  of  point  B  referenced  from  point  A  is  given 
by  the  vector 


Figure  9:  Remote  Actuation 


The  prototype  will  be  created  using  a  sheet  metal  laser. 
^Thin  gauge  stainless  and  sheet  metal  flat  patterns  created  in 
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Figure  10:  Conduit  Layout 


Cable  conduit  runs  connect  the  robotic  hand  to  the  remote 
actuators  that  are  located  in  the  operational  backpack.  These 
conduit  runs  will  attach  the  outside  of  the  operators  arm  and 
follow  the  arm  down  to  the  hand  similar  to  the  sleeve  on  a 
shirt. 
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Figure  11:  General  Layout 


The  prototype  is  currently  being  built  and  will  be  used  for 
testing  the  design. 


VI.  Conclusions 
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This  paper  presents  a  new  design  for  a  prosthetic  hand. 
The  design  is  based  on  remote  actuation  of  electric  DC 
motors  via  cables.  This  type  of  construction  and  design 
shifts  the  weight  of  the  hand  from  the  end  of  the  prosthesis 
to  a  localized  point  closer  to  the  center  of  mass  of  the  user. 
This  shift  in  weight  is  intended  to  reduce  strain  and  fatigue 
on  the  operator  during  normal  daily  activities. 

Future  work  includes  the  detailed  modeling  and 
simulation  of  the  design,  and  the  assembly  and  testing  of  the 
prototype. 
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ABSTRACT 

In  this  paper,  we  explore  the  idea  of  designing  non- 
anthropomorphic  multi-fingered  robotic  hands  for  tasks  that 
replicate  the  motion  of  the  human  hand.  Taking  as  input  data 
a  finite  set  of  rigid-body  positions  for  the  five  fingertips,  we  de¬ 
velop  a  method  to  perform  dimensional  synthesis  for  a  kinematic 
chain  with  a  tree  structure,  with  five  branches  that  share  three 
common  joints. 

We  state  the  forward  kinematics  equations  of  relative  dis¬ 
placements  for  each  serial  chain  expressed  as  dual  quaternions, 
and  solve  for  up  to  five  chains  simultaneously  to  reach  a  number 
of  positions  along  the  hand  trajectory.  This  is  done  using  a  hy¬ 
brid  global  numerical  solver  that  integrates  a  genetic  algorithm 
and  a  Levenberg-Marquardt  local  optimizer. 

Although  the  number  of  candidate  solutions  in  this  problem 
is  very  high,  the  use  of  the  genetic  algorithm  allows  us  to  perform 
an  exhaustive  exploration  of  the  solution  space  to  obtain  a  set  of 
solutions.  We  can  then  choose  some  of  the  solutions  based  on  the 
specific  task  to  perform.  Note  that  these  designs  match  the  task 
exactly  while  generally  having  a  finger  design  radically  different 
from  that  of  the  human  hand. 


*  Address  all  correspondence  to  this  author. 


NOMENCLATURE 

b  Number  of  kinematic  chains  branches. 
n  Number  of  j  oints . 

m  Number  of  end-effector  positions  for  all  branches  consid¬ 
ered. 

£  Dual  unit  such  that  =  0. 

V  A  vector. 

Q  A  dual  quaternion. 

S  Pliicker  coordinates  of  a  line:  S  =  s  + 


INTRODUCTION 

There  are  many  applications  for  which  a  robotic  system  is 
needed  to  work  in  human  environments  and  to  perform  tasks  that 
are  designed  for  the  human  hand.  In  most  cases,  the  solution 
adopted  for  grasping  and  manipulation  consists  of  anthropomor¬ 
phic  robotic  hands,  which  imitate  to  a  certain  extent  the  topology 
and  joint  location  of  the  human  hand.  See  [1]  for  a  review  of 
applications  and  concept  definition. 

It  is  difficult  to  match  the  complexity  of  the  human  hand, 
commonly  accepted  to  have  26  degrees  of  freedom  when  count¬ 
ing  the  motion  at  the  wrist  and  the  pronation/supination  of  the 
forearm.  The  anthropomorphic  design  must  include  a  complex 
mechanical  system,  actuation  and  sensing  in  a  small  space  [2]. 
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In  order  to  reduce  complexity,  current  designs  limit  the  active  de¬ 
grees  of  freedom,  through  simplification  of  the  mechanical  struc¬ 
ture  or  by  designing  underactuated  hands.  The  design  of  simpli¬ 
fied  grippers  limits  the  tasks  of  the  robotic  end-effector  to  some 
grasping  and  manipulation  actions.  Pairing  these  designs  with 
some  degree  of  underactuation  and  compliance,  it  is  then  pos¬ 
sible  to  perform  robust  grasping  of  objects  of  unknown  shape. 
Dollar  and  Howe  [3]  present  a  simplified,  underactuated  design 
for  reliable  grasping.  Ciocarlie  and  Allen  [4]  optimize  an  under¬ 
actuated,  non-anthropomorphic  gripper  for  performing  a  series 
of  grasps  from  a  database.  A  more  thorough  review  on  underac¬ 
tuated  hands  can  be  found  in  [5]. 

In  order  to  perform  some  of  the  more  complex  functions 
of  the  human  hand  (not  only  grasping  and  manipulation,  but 
also  perception  through  surface  exploration),  it  seems  that  an 
end-effector  with  several  independently- actuated  fingers  may  be 
needed.  There  are  many  examples  of  anthropomorphic  robotic 
hands,  see  for  instance  [6]  for  a  relatively  recent  review.  How¬ 
ever,  for  complex  multi-fingered  designs,  it  may  not  be  necessary 
that  the  robotic  fingers  mimic  those  of  the  human  hand  in  order  to 
perform  human-like  tasks.  We  want  to  explore  these  alternative 
designs  with  the  use  of  kinematic  synthesis. 

These  alternate  designs  may  have  multiple  applications.  One 
possible  usage  is  on  the  design  of  exoskeletons.  These  exoskele¬ 
tons  move  the  finger  tips  exactly  like  a  human  hand,  while  being 
able  to  be  mounted  on  a  hand  without  interfering  with  the  hand’s 
movement.  Another  application  is  the  improvements  of  exist¬ 
ing  designs.  Solutions  can  be  chosen  with  additional  criteria  like 
equal  distribution  of  joint  velocities  for  a  given  task  or  location 
criteria  for  the  joint  axes.  This  can  allow,  for  instance,  designs 
optimized  for  particular  actuators. 

Kinematic  design  of  robotic  hands  has  focused  on  the  de¬ 
sign  of  individual  motion  of  fingers  or  parts  of  the  hand.  Dai  and 
Wang  [7]  use  kinematic  synthesis  to  design  a  spherical  mech¬ 
anism  to  act  as  the  palm  of  a  metamorphic  hand.  Van  Var- 
seveld  and  Bone  [8]  designed  a  finger  mechanism  for  a  non- 
anthropomorphic  dexterous  hand.  Walker  et  al.  [9]  also  design 
planar  linkages  for  the  fingers  of  a  non-anthropomorphic,  dexter¬ 
ous  hand.  Schafer  and  Dillman  [10]  present  the  kinematic  design 
of  a  humanoid  robotic  wrist. 

In  this  paper,  we  develop  a  method  for  the  design  of  a  full 
non-anthropomorphic  multi-fingered  robotic  hand  for  tasks  that 
replicate  the  motion  of  the  human  hand  at  the  fingertips.  Taking 
as  input  data  a  finite  set  of  rigid-body  positions  for  the  human  fin¬ 
gertips,  we  perform  dimensional  synthesis  for  a  kinematic  chain 
with  a  tree  structure,  with  three  common  joints  and  five  branches. 
As  a  whole,  the  process  entails  the  simultaneous  solution  of  up 
to  five  serial  chains,  two  of  them  having  four  independent  joints 
and  three  of  them  with  five  independent  joints,  plus  three  com¬ 
mon  joints  for  all  of  them.  The  total  degrees  of  freedom  of  the 
non-anthropomorphic  hand  design  is  26,  similar  to  the  human 
hand. 


We  state  the  forward  kinematics  equations  of  relative  dis¬ 
placements  for  each  serial  chain  expressed  as  dual  quaternions, 
and  solve  for  all  five  chains  simultaneously  to  reach  a  number  of 
positions  along  the  hand  trajectory.  The  synthesis  of  spatial  se¬ 
rial  chains  for  up  to  five  degrees  of  freedom  using  this  technique 
was  developed  in  [11].  We  use  a  similar  methodology  together 
with  a  hybrid  global  numeric  solver,  composed  of  a  genetic  al¬ 
gorithm  paired  with  a  Levenberg-Marquardt  local  optimizer.  For 
the  tree-like  kinematic  structure,  a  high  number  of  positions  can 
be  defined  to  perform  exact  synthesis,  obtaining  a  good  approxi¬ 
mation  for  the  desired  trajectory. 

Finding  the  complete  solution  set  for  the  synthesis  of  com¬ 
plex  kinematic  chains  is  an  unsolved  problem.  Only  dyads,  such 
as  the  RR  kinematic  chain  [12, 13],  and  some  triads  with  partic¬ 
ular  characteristics  [14],  have  been  fully  studied.  Even  the  3R 
kinematic  chain  has  not  been  completely  solved  with  a  closed  al¬ 
gebraic  expression  [15].  The  complexity  of  a  tree-like  kinematic 
chain  with  a  total  of  26  revolute  joints,  and  our  numerical  results, 
lead  to  believe  that  there  will  be  a  very  large  amount  of  solutions. 
This  is  an  issue  that  has  been  found  before  even  for  simpler  kine¬ 
matic  chains,  see  [14].  In  order  to  deal  with  this,  additional  con¬ 
straints  may  be  added  to  help  in  the  selection  of  the  final  design, 
depending  on  the  task.  We  present  two  of  the  solutions  for  a  hand 
task  that  was  synthetically  generated.  The  designs  exactly  match 
the  task  while  having  a  finger  design  radically  different  from  that 
of  the  human  hand. 


KINEMATIC  HAND  MODEL 

The  human  hand  has  5  fingers  formed  by  14  joints.  These 
joints  are  created  at  the  contact  surface  of  the  27  major  bones 
forming  the  hand.  The  joints  do  not  exactly  match  the  motion 
of  a  classical  lower  pair,  and  some  of  them  present  more  than 
one  degree  of  freedom.  However,  they  can  be  modeled  fairly 
precisely  using  only  simple  re  volute  kinematic  joints.  The  axes 
of  these  revolute  joints  do  not  necessarily  have  to  intersect  within 
the  same  joint. 

The  full  hand  can  be  modeled  using  a  total  of  26  joints  if  we 
consider  the  wrist  and  the  pronation/supination  of  the  forearm 
to  be  formed  by  3  revolute  joints.  The  index  and  middle  finger 
have  4  re  volute  joints,  while  the  third,  fourth  and  thumb  have  5 
re  volute  joints.  The  dimensions  are  taken  from  the  literature  [16, 
17].  The  skeleton  can  be  represented  by  drawing  the  common 
normals  of  the  joint  axes  as  shown  in  Fig.  1. 

Hand  Task  Generation 

The  task  is  defined  as  a  series  of  finite  positions  (locations 
and  orientations)  for  each  finger  tip,  created  by  assigning  a  set  of 
joint  variables  to  the  kinematic  model.  The  range  of  motion  of 
each  joint  varies  greatly  among  the  population  and  it  is  therefore 
impossible  to  assign  a  precise  range  to  each  joint.  In  this  paper. 
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FIGURE  1 :  HAND  SKELETON  USED  TO  GENERATE  POSI¬ 
TIONS. 


TABLE  1 :  JOINT  ANGLES  USED  TO  GENERATE  THE  TRA¬ 
JECTORY. 


Chain 

Hand  task  re  volute  joint  limits  [Omin-Omax] 

Common 

[-90°  ,90°] ,  [-90°  ,90°] ,  [-90°  ,90°] 

Index 

[-10°,90°],[-10°,10°],[0°,100°],[0°,90°] 

Middle 

[- 1 0°  ,90°  ] ,  [- 1 0° ,  1 0°  ] ,  [0° ,  1 00°  ] ,  [0°  ,90°  ] 

Third 

[-10°,10°],[0°,20°],[-10°,10°],[0°,100°],[0°,90°] 

Fourth 

[-10°,10°],[0°,20°],[-10°,10°],[0°,100°],[0°,90°] 

Thumb 

[-25°,25°],[-25°,25°],[-10°,10°],[0°,70°], 

[-10°,85°] 

we  will  evaluate  our  solver  using  synthetically  generated  trajec¬ 
tories.  These  trajectories  are  generated  from  random  positions 
within  the  joint  angle  ranges  defined  in  Table  1  to  simplify  the 
convergence  of  the  solver. 


KINEMATIC  SYNTHESIS 

The  goal  of  the  dimensional  kinematic  synthesis  is  to  find 
the  location  and  orientation  of  a  set  of  joint  axes  able  to  per¬ 
form  a  given  motion,  where  the  number  and  type  of  joints  are 
pre-defined.  This  is  also  known  as  the  motion-to-form  problem 
in  which  we  are  given  a  motion,  defined  by  a  sequence  of  end- 
effector  positions,  as  an  input  and  must  calculate  the  form  as  a  set 
of  joints  and  angles  that  can  perform  the  motion.  In  this  paper, 
we  follow  the  original  idea  of  [18]  of  using  the  forward  kinemat¬ 
ics  equations  of  the  kinematic  chain,  but  formulated  as  relative 


displacements  and  expressed  as  dual  quaternions,  see  [11]  for  a 
complete  description  of  this  approach. 

The  input  data  for  the  synthesis  are  the  m  —  1  relative  trans¬ 
formations  Pij  =  cos  +  sin  j  =  2, . . .  ,m,  defining 

the  task;  the  output  are  the  Pliicker  coordinates  Si  =  st  +  £s^  = 
Si  £Ci  X  Si,  i  =  1 , . . . ,  of  the  n  joints  that  define  the  kinematic 
chain  at  a  reference  configuration,  and  also  the  7  =  2, . . .  ,m  sets 
of  joint  variables  Ad  j  =  Oij  —  On  +  £{dij  —  ),  /  =  1 , . . . ,  used 

to  reach  the  task  positions,  measured  from  the  reference  config¬ 
uration  01  =  0/1  +  £dii, 

Forward  Kinematics 

We  can  represent  each  individual  branch  of  a  tree-like  topol¬ 
ogy  as  an  individual  kinematic  serial  chain,  which  shares  a  num¬ 
ber  of  joints  with  other  branches.  Given  a  kinematic  serial  chain 
with  n  joints,  we  can  write  the  kinematics  equations  using  the 
product  of  exponentials  of  the  screws  corresponding  to  the  joint 
axes,  as  described  in  [19].  In  this  paper,  instead  of  calculating 
the  exponentials  using  matrix  algebra,  we  do  the  exponentials 
for  the  Clifford  even  subalgebra  of  the  projective  space,  in  which 
the  unit  elements,  also  known  as  dual  quaternions,  express  spa¬ 
tial  displacements.  The  exponential  of  a  screw  represented  by 
the  Clifford  algebra  element  J  =  (l  +  /ie)Sof  axis  S,  where  jl  is 
the  pitch  relating  the  slide  d  and  the  rotation  0  along  and  about 
the  screw,  yields  a  finite  displacement. 


e  i  ,  0  d  .  6  .  ,  .  0  d  0  .. 

=(cos  2  “  2  ^  2^2  2 

^  .  K 

=  cos — hsin— b.  (1) 

2  2 

For  a  serial  chain  with  ^joints,  in  which  each  joint  can  rotate 
an  angle  0/  and  slide  a  distance  J/,  around  and  along  the  axis  S/, 
/  =  1, . . .  ,^,  we  calculate  the  forward  kinematics  of  relative  dis¬ 
placements  (with  respect  to  an  arbitrary  reference  configuration). 


2(A0) 

A01  .  A01  a4  ,  .  AO. 

=  (cos  —  +  sm  — Si)  •  •  •  (cos  —  +  sm  — S„), 

(2) 

where  A0  =  0^-  —  0 1  -{-£{dj  —  di )  contains  the  joint  variables,  as 
relative  values  with  respect  to  the  joint  parameters  of  the  chain 
01  and  di  when  in  the  reference  configuration. 

Synthesis  Design  Equations 

The  dimensioning  of  the  articulated  system  has  to  be  done 
so  that  the  forward  kinematics  equations  in  Eqn.  (2)  can  reach  all 
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FIGURE  2:  TOPOLOGY  OF  THE  KINEMATIC  CHAIN. 

the  desired  task  positions  P\j, 

A01  .  ^e2j  AG^j 

=  j  =  2,...,m  (3) 


where  7  =  1  is  reserved  for  the  reference  configuration. 

This  results  in  8(m  —  1)  design  equations,  considering  the 
fact  that  we  are  using  dual  quaternions  which  have  8  compo¬ 
nents.  The  design  variables  that  determine  the  dimensions  of  the 
chain  are  the  n  joint  axes  S/,  /  =  1 , . . . ,  in  the  reference  config¬ 
uration.  In  addition,  the  equations  contain  the  ^(m  —  1)  pairs  of 
joint  parameters  AOtj  =  AOij  +  eAdtj,  which  are  also  unknown. 


Design  Equations 

We  state  the  design  equations  by  adapting  Eqn.  (3)  to  our 
particular  topology.  Eor  each  one  of  the  serial  chains  in  the  par¬ 
allel  arrangement  we  state  a  set  of  design  equations,  to  obtain  the 
total  system  of  equations 


P>[j  =  e 


^3, 


A02y^_  A03^.^_  AG^^^ 


P^j  = 


4  •  •  -e 


qk 


individual 


ke{i,2}, 

kG  {3,4,5}, 


j  =  2,...,m. 

(4) 


Here  k  identifies  the  kinematic  chain  and  7  =  2, . . . ,  m  is  the  index 
of  the  task  position.  The  fingers  are  denoted  by:  index,  k  =  1; 
middle,  k  =  2;  third,  k  =  3;  fourth,  k  =  4  and  thumb,  k  =  5. 

Each  of  the  five  serial  chains,  taken  individually,  has  a  total 
of  seven  or  eight  degrees  of  freedom,  depending  on  the  finger 
it  corresponds  to.  Even  though  the  exact  dimensional  synthesis 
does  not  apply  to  serial  chains  with  six  or  more  degrees  of  free¬ 
dom,  by  having  three  common  degrees  of  freedom  we  are  able  to 
state  the  design  equations  of  the  system  as  a  whole. 

Notice  that  even  though  each  individual  finger  has  more  than 
six  degrees  of  freedom,  the  tree-like  architecture  is  not  kinemat¬ 
ically  redundant  when  defining  the  motion  of  several  branches  at 
the  same  time. 


NON-ANTHROPOMORPHIC  HAND  SYNTHESIS 

In  this  paper,  we  are  interested  in  the  synthesis  of  robotic 
grippers  for  human-hand  tasks.  We  do  not  impose  any  explicit 
limitation  on  the  link  dimensions  or  placement.  The  resulting 
design  should  be  able  to  perform  a  given  human-hand  task  while 
having  a  non- anthropomorphic  aspect. 


System  Topology 

As  input  topology,  we  define  a  tree-like  kinematic  chain  with 
three  common  joints  in  series  at  the  base,  connected  to  five  serial 
chains  arranged  in  parallel,  two  of  them  with  four  degrees  of 
freedom  and  three  of  them  with  five  degrees  of  freedom.  This 
structure  follows  the  generally  accepted  joint  arrangement  of  the 
human  hand  plus  the  wrist  motion.  Eigure  2  shows  the  topology 
of  the  kinematic  chain  to  be  synthesized. 

Note  that,  to  our  knowledge,  no  previous  approach  has  ad¬ 
dressed  the  synthesis  of  tree-like  structures.  In  addition,  tree 
topologies  can  also  be  used  to  represent  pure  serial  topologies, 
when  there  is  only  one  branch,  and  loop  topologies,  when  end- 
effectors  of  multiple  branches  are  placed  at  the  same  position. 


KINEMATIC  SOLVER 

In  order  to  deal  with  the  large  system  of  equations  presented 
in  the  previous  section,  the  selected  solver  aims  to  minimize  the 
error  in  Eqn.  (4)  for  each  kinematic  chain.  In  principle,  problems 
with  selection  of  the  metric  does  not  apply  to  this  case,  as  we  are 
targeting  exact  synthesis. 

The  objective  of  the  solver  is  to  perform  general  inverse 
kinematics,  that  is,  adjust  both  joint  angles  and  joint  axes  to  fol¬ 
low  a  motion.  However,  by  making  the  joint  axes  constant  it  can 
also  perform  inverse  kinematics. 

Objective  Functions 

Given  a  vector  v  =  {4,4,5,5,5}  with  the  number  of  indepen¬ 
dent  joints  for  each  finger,  the  design  equations  from  Eqn.  (4)  can 
be  written  as  a  set  of  unconstrained  functions. 


/?‘(s‘,Ae;)  =  n 


3  A0,-/  3+Vj^  AGj^- 


i=l 


n 

i=4 


ij  ck 


-P\ 


If’ 


common  individual 


7  =  2, 

k=  1, 


.  ,m 

.,5 


(5) 
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where  we  can  separate  the  product  of  the  common  joints  from 
the  individual  joints  that  belong  to  each  branch. 

The  global  objective  of  the  solver  is  to  solve  the  design  equa¬ 
tions  defined  in  Eqn.  (4).  This  can  be  written  as, 


/  =^b{m  —  1) 

f=6bim-l)  (10) 


m  5  , 

(6) 

j=2k=\ 

In  order  to  avoid  falling  into  local  minima  we  will  use 
a  hybrid  solver  composed  of  both  a  genetic  algorithm  and  a 
Levenberg-Marquadt  optimizer. 

Genetic  algorithms  behave  better  with  defined  positive  max¬ 
imization  objective  functions.  We  can  convert  Eqn.  (6)  to  a  min¬ 
imization  function  and  invert  it  to  obtain, 


(m  5 

E  E  l^f(s^A0 

j=2k=l 

which  we  can  see  is  defined  positive  if  the  domain  of  Eqn.  (5)  is 
finite.  This  single  function  is  also  known  as  the  fitness  function. 

Eor  the  Levenberg-Marquadt  local  optimizer  we  use  the 
minimizing  least  squares  objective  function. 


m  5  , 

minimize  EE^/(S^Ae})2  (8) 

S,Ae  j=2k=l 

Dimension  of  the  Equation  Set 

The  equations  and  variables  in  the  objective  functions 
Eqn.  (5)  are  not  all  linearly  independent.  The  equations  are 
formed  by  unit  dual  quaternions  Q  =  q-\-  which  have  a  di¬ 
mension  of  eight,  but  are  subject  to  the  two  implicit  constraints 
qq*  =  1  and  q^q^  =  0,  which  reduce  the  independent  dimension 
of  the  dual  quaternion  to  6.  Similarly,  only  four  of  the  six  Plucker 
components  of  each  line  are  independent  as  they  are  subject  to 
the  two  implicit  constraints  ||s||  =  1  and  s  •  =  0.  The  number 

of  variables  v  and  independent  variables  can  be  written  as. 


V  =n{6  +  (m  —  1)) 

=n{4 {m  —  1))  (9) 

The  number  of  equations  /  and  independent  equations 
can  be  written  as. 


An  important  question  remaining  is  how  many  task  positions 
m  are  required  for  the  system  to  have  a  finite  number  of  solutions, 
see  [20]  for  details.  This  can  be  obtained  by  imposing  =  x^ 
and  solving  to  obtain. 


m 


An 


6b  — n 


(11) 


The  number  of  task  positions  obtained  is  the  amount  needed 
to  have  a  finite  solution  for  non-degenerate  tree  topologies.  Non¬ 
degenerate  tree  topologies  are  those  where  no  kinematic  chain 
segment,  that  is  the  smallest  kinematic  serial  chain  from  an  end- 
effector  to  a  fork  or  from  the  origin  to  a  fork,  has  fewer  than  6 
degrees-of-freedom  and  that  no  serial  chain  from  the  origin  to  an 
end  effector  has  fewer  joints  than  the  largest  kinematic  chain  seg¬ 
ment  from  a  fork  to  an  end-effector.  Degenerate  tree  topologies 
have  redundant  equations  and  thus  Eqn.  (10)  is  no  longer  valid. 

More  task  positions  can  be  provided  although  this  overde¬ 
termines  the  system.  If  the  system  is  overdetermined  by  task 
positions  from  the  same  workspace  it  will  still  have  solutions, 
otherwise  an  exact  match  will  generally  not  exist.  Overdeter¬ 
mined  systems  can  lead  to  problems  of  convergence  and  much 
slower  performance. 

Applying  Eqn.  (11)  to  our  model  with  b  =  5  branches  and 
n  =  26  revolute  joints,  three  of  them  being  shared  by  all  the 
branches,  we  obtain  that  we  can  solve  exactly  for  a  task  defined 
by  m  =  27  finite  positions  for  each  finger.  This  gives  a  total  of 
156  structural  parameters  and  676  joint  variables  for  our  set  of 
equation. 


Solver  Implementation 

Note  that  the  complexity  of  the  problem  that  we  are  trying 
to  solve  is  especially  challenging.  However,  the  use  of  Clifford 
algebra  allows  reducing  the  number  of  equations  and  variables, 
compared  to  a  matrix-based  approach.  In  particular,  we  represent 
the  entire  equation  system  with  only  832  input  variables  between 
both  structural  and  joint  variables.  This  is  a  reduction  of  33%  in 
the  number  of  variables  compared  to  using  homogeneous  matrix, 
only  considering  the  3x4  submatrix  containing  the  rotation  and 
translation  information. 

Genetic  algorithms  have  already  been  used  in  many  kine¬ 
matic  problems  [21,22].  The  genetic  algorithm  performs  an  ex¬ 
haustive  exploration  of  the  solution  space  in  order  find  a  solution. 
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However,  due  to  complexity  of  the  system  a  pure  genetic  algo¬ 
rithm  would  have  convergence  problems  past  a  certain  fitness. 
This  problem  was  overcome  by  reducing  the  solution  space  used 
by  the  genetic  algorithm  to  only  the  local  minima.  This  con¬ 
verts  the  solution  space  from  a  continuous  domain  to  a  discrete 
finite  domain  that  improves  the  behaviour  of  the  genetic  algo¬ 
rithm.  The  local  minima  are  found  by  a  Levenberg-Marquardt 
optimizer. 

The  genetic  algorithm  chromosomes  consist  of  sets  of  vari¬ 
ables  that  belong  to  the  full  solution  space.  After  being  generated 
they  are  then  converged  to  a  local  minima.  This  local  optimiza¬ 
tion  is  also  computed  when  chromosomes  are  crossed  or  mutated 
to  ensure  each  chromosome  always  represents  a  local  minima  of 
the  search  space. 

The  fitness  is  calculated  as  the  inverse  of  the  sum  of  the  er¬ 
ror  as  seen  in  Eqn.  (7).  This  makes  the  fitness  a  continuous  posi¬ 
tive  function,  which  allows  the  usage  of  roulette- wheel  selection 
when  choosing  pairs  from  the  genetic  algorithm  population  to 
crossover.  It  also  converts  the  genetic  algorithm  to  a  maximiza¬ 
tion  problem.  The  crossover  rate  is  kept  low  to  encourage  diver¬ 
sity  in  the  population,  since  the  strong  convergence  is  provided 
by  the  Levenberg-Marquardt  optimizer. 

To  avoid  explicit  constraints  the  chromosomes  are  generated 
in  the  proximity  of  the  ideal  kinematic  solution.  This  plays  the 
role  of  a  soft  limit  for  the  possible  shapes  of  the  robotic  hand. 
However,  it  is  not  unusual  for  the  Levenberg-Marquardt  mini- 
mizer  to  move  far  from  the  generation  space  and  find  extremely 
non- anthropomorphic  solutions. 

The  solver  is  executed  until  the  fitness  surpasses  the  value  of 
10^^  at  which  it  is  considered  to  have  arrived  to  a  solution.  The 
error  is  attributed  to  the  imprecision  in  the  computer  representa¬ 
tion  of  real  numbers. 

Kinematic  Subsystems 

It  is  worth  noting  that  it  is  possible  to  solve  a  subsystem 
of  the  full  kinematic  chain  tree.  These  subsystems  are  indepen¬ 
dently  solvable  as  long  as  they  have  a  finite  number  of  task  posi¬ 
tions  m  needed  for  a  finite  number  of  solutions.  To  have  m  G 
the  subsystem  must  satisfy  the  following  inequality. 


6/?  — r>0  (12) 

which  is  obtained  from  imposing  m  >  0  in  Eqn.  (11).  Table  2 
shows  all  the  possible  subsystems  of  the  hand  model  that  can  be 
solved. 

The  most  interesting  configurations  to  solve  are  the  5  kine¬ 
matic  chains  at  once,  to  minimize  the  needed  positions,  and  the 
configuration  with  only  two  4R  branches  to  reduce  the  amount  of 
variables  needed.  The  two  4R  branches  are  the  index  and  middle 


5IC 


FIGURE  3:  TOPOLOGY  OL  THE  SOLVABLE  (4R,  4R)  LIN¬ 
GERS  SUBSYSTEM. 


TABLE  2:  SOLVABLE  SYSTEMS  OL  EQUATIONS  LOR  DIL- 
LERENT  COMBINATIONS  OE  CHAINS. 


b 

r 

V 

/ 

m 

Notes 

5 

26 

832 

1092 

21 

Lull  model 

4 

22 

1100 

1452 

45 

(5R,  5R,  5R,  4R)  fingers 

4 

21 

714 

938 

29 

(5R,  5R,  4R,  4R)  fingers 

3 

17 

1258 

1666 

69 

(5R,  5R,  4R)  fingers 

3 

16 

608 

800 

33 

(5R,  4R,  4R)  fingers 

2 

11 

550 

726 

45 

(4R,  4R)  fingers 

1 

5 

130 

170 

21 

5R  finger,  common  solved 

1 

4 

56 

72 

9 

4R  finger,  common  solved 

fingers  and  can  be  seen  in  Eig.  3.  Afterwards,  the  remaining  fin¬ 
gers  can  be  solved  individually  as  the  common  revolute  joints  are 
now  identified.  There  are  also  other  systems  that  can  be  solved 
that  are  a  compromise  between  the  number  of  positions  and  the 
number  of  variables  needed. 


RESULTS 

It  is  very  important  for  the  solver  to  converge  that  the  end- 
effector  positions,  for  all  branches  describing  the  task,  do  not 
follow  an  equation  for  the  movement.  This  can  lead  to  implicit 
equations  that  can  lower  the  dimension  of  the  system  so  that 
Eqn.  (11)  no  longer  guarantees  a  finite  number  of  solutions.  It 
is  also  important  for  the  difference  between  end-effector  posi¬ 
tions  to  be  large  to  aid  in  the  solver  convergence,  and  that  all  the 
joints  present  movement  in  the  generated  task. 

The  algorithm  presented  in  this  paper  has  a  parallel  nature 
and  can  be  adjusted  to  run  on  supercomputers  or  other  distributed 
computing  systems  to  increase  the  calculation  speed.  This  is  due 
to  the  nature  of  the  genetic  algorithm  which  forms  part  of  the 
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TABLE  3:  SOLVER  EXECUTION  INEORMATION. 


Solution 

Generations 

Time  (hours) 

1 

13 

20.8 

2 

5 

20.5 

3 

10 

16.5 

4 

12 

85.0 

FIGURE  4:  CONVERGENCE  OE  A  SOLVER  EXECUTION. 


hybrid  solver  presented. 

We  have  obtained  best  results  when  using  a  population  size 
of  100  for  the  genetic  algorithm.  This  is  much  lower  than  what 
would  be  expected  to  be  needed  for  a  pure  genetic  algorithm  for 
an  equation  system  of  this  size.  The  crossover  rate  was  set  at  0.2 
while  the  mutation  rate  was  set  extremely  high  at  0.5.  This  is 
due  to  the  fact  that  our  hybrid  solver  uses  a  Levenberg-Marquadt 
optimizer  which  provides  the  strong  convergence.  Therefore  the 
genetic  algorithm  must  explore  as  much  of  the  solution  space  as 
possible  and  not  focus  on  local  convergence. 

Runtime  information  can  be  found  in  Table  3  for  the  vari¬ 
ous  solutions  found.  These  results  were  obtained  on  an  Intel@ 
Core™  i7-870  CPU  running  at  2.93  GHz.  The  solver  was  us¬ 
ing  all  4  cores  of  the  CPU  by  using  5  threads  for  the  local  op¬ 
timization  of  the  chromosomes,  which  is  the  slowest  part  of  the 
algorithm.  An  example  of  the  solver’s  converge  can  be  seen  in 
Pig.  4. 

We  present  two  example  solutions  that  can  be  seen  in  Pig.  5 
and  Pig.  6.  The  non- anthropomorphic  solutions  are  rendered  on 
top  of  the  anthropomorphic  skeleton  used  to  generate  the  data, 
and  both  are  drawn  as  joint  axes  linked  along  their  common  nor¬ 
mal  lines.  The  anthropomorphic  skeleton  is  represented  by  thick 
gray  lines  while  the  non-anthropomorphic  solution  is  represented 
using  thinner  green  lines. 


CONCLUSIONS 

In  this  paper  we  have  presented  a  method  for  the  kinematic 
synthesis  of  tree-like  articulated  systems,  with  an  application 
in  the  design  of  a  robot  to  perform  human-hand  tasks.  To  our 
knowledge  this  is  the  first  time  kinematic  synthesis  has  been  ap¬ 
plied  to  tree  topologies.  This  methodology  allows  obtaining  non- 
anthropomorphic  designs  that  can  perform  an  anthropomorphic 
finite-position  task  exactly,  while  having  a  very  different  joint 
distribution  and  motion.  These  designs  have  applications  in  ex¬ 
oskeleton  design,  as  they  could  be  mounted  on  the  hand  without 
physically  interfering  with  it. 

The  presented  methodology  is  not  limited  to  anthropomor¬ 
phic  tasks  and  hand  models.  It  can  be  applied  to  generic  serial, 
loop  and  tree  topologies  of  articulated  systems,  making  the  solver 
a  powerful  tool. 

Our  hybrid  solver  has  managed  to  successfully  find  solu¬ 
tions  to  kinematic  synthesis  problems  much  larger  than  previ¬ 
ously  considered.  This  has  been  accomplished  by  using  Clifford 
algebra  to  provide  a  more  compact  system  of  equations  that  is 
then  solved  by  the  application  of  both  meta-heuristics  and  clas¬ 
sical  math  optimization. 

Erom  the  dimensional  synthesis  point  of  view,  an  interest¬ 
ing  result  is  that,  due  to  the  tree  structure,  we  can  perform  exact 
synthesis  for  general  serial  chains  with  more  than  five  degrees  of 
freedom.  We  may  conclude  from  this  that,  despite  common  be¬ 
lieve  that  the  human  wrist/hand  is  a  redundant  mechanical  sys¬ 
tem,  it  may  not  be  so  when  we  consider  a  task  in  which  several 
fingers  must  act. 

The  dimensional  synthesis  for  articulated  systems  like  the 
one  presented  here,  with  a  high  number  of  joints,  yields  many 
solutions.  A  good  selection  process  is  required  in  order  to  choose 
a  solution  from  the  pool  of  candidates.  Eor  instance,  for  the  ap¬ 
plication  presented  in  this  paper,  additional  constraints  could  be 
imposed  either  in  the  solving  process  or  in  the  post-processing 
phase  in  order  to  find  a  suitable  design.  Among  others,  we  can 
cite  size  or  location  restrictions  for  exoskeletons  mounted  on  the 
human  hand,  or  dexterity  conditions  at  given  configurations  for 
manipulation  in  human  environments.  Euture  work  will  take  into 
consideration  possible  link  collisions  that  may  be  present  in  some 
of  the  solutions  of  the  kinematic  synthesis. 

In  order  for  the  designs  to  be  able  to  perform  realistic  human 
tasks,  not  only  fingertip  positions,  but  also  fingertip  forces  and 
infinitesimal  motion  need  to  be  considered.  Euture  work  will 
focus  on  including  task  velocities  and  accelerations  in  order  to 
define  grasping  actions. 
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(d)  Third  Finger  (e)  Fourth  Finger 

FIGURE  5:  OVERVIEW  OE  A  SOLUTION  EOUND. 


(f)  Thumb 
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(a)  Full  Hand 


(b)  Index  Finger 


(c)  Middle  Finger 


(f)  Thumb 


FIGURE  6:  OVERVIEW  OE  A  SECOND  SOLUTION  EOUND. 
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Abstract:  Recent  evidence  suggests  silicon  dioxide  micro-  and  nanoparticles  induce  cytotoxic 
effects  on  lung  cells.  Thus,  there  is  an  increasing  concern  regarding  their  potential  health 
hazard.  Nevertheless,  the  putative  toxicity  of  nanoparticles  in  mammalian  cells  has  not  yet  been 
systematically  investigated.  We  previously  noted  that  several  metallic  oxide  nanoparticles  exert 
differential  cytotoxic  effects  on  human  neural  and  nonneural  cells.  Therefore,  we  hypothesized 
that  silicon  dioxide  nanoparticles  induce  cytotoxicity  in  U87  cells  by  lowering  their  survival 
by  decreasing  cell  survival  signaling  and  disturbing  mitochondrial  function.  To  investigate  this 
hypothesis,  we  determined  the  activities  of  the  key  mitochondrial  enzymes,  citrate  synthase  and 
malate  dehydrogenase,  in  astrocytoma  U87  cells  treated  with  silicon  dioxide  nanoparticles.  In 
addition,  we  studied  the  expression  of  the  mitochondrial  DNA-encoded  proteins,  cytochrome 
C  oxidase  II  and  nicotinamide  adenine  dinucleotide  (NADPH)  dehydrogenase  subunit  6,  and 
cell  signaling  pathway  protein  extracellular  signal-regulated  kinase  (ERK)  and  phosphorylated 
ERK  in  treated  U87  cells.  The  activated  form  of  ERK  controls  cell  growth,  differentiation, 
and  proliferation.  In  parallel,  we  determined  survival  of  U87  cells  after  treating  them  with 
various  concentrations  of  silicon  dioxide  nanoparticles.  Our  results  indicated  that  treatment 
with  silicon  dioxide  nanoparticles  induced  decreases  in  U87  cell  survival  in  a  dose-related 
manner.  The  activities  of  citrate  synthase  and  malate  dehydrogenase  in  treated  U87  cells 
were  increased,  possibly  due  to  an  energetic  compensation  in  surviving  cells.  However,  the 
expression  of  mitochondrial  DNA-encoded  cytochrome  C  oxidase  subunit  II  and  NADH 
dehydrogenase  subunit  6  and  the  cell  signaling  protein  ERK  and  phosphorylated  ERK  were 
altered  in  the  treated  U87  cells,  suggesting  that  silicon  dioxide  nanoparticles  induced  disruption 
of  mitochondrial  DNA-encoded  protein  expression,  leading  to  decreased  mitochondrial  energy 
production  and  decreased  cell  survival/proliferation  signaling.  Thus,  our  results  strongly 
suggest  that  the  cytotoxicity  of  silicon  dioxide  nanoparticles  in  human  neural  cells  implicates 
altered  mitochondrial  function  and  cell  survival/proliferation  signaling. 

Keywords:  cytotoxicity,  silicon  dioxide  nanoparticles,  mitochondrial  enzyme,  extracellular 
signaling  regulated  kinase,  cell  signaling,  neural  cells 
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Introduction 

According  to  the  Environmental  Protection  Agency,  exposure  to  nanomaterials  can 
occur  during  the  manufacturing  or  production  process,  and  also  has  the  potential  to 
pollute  the  environment,^  in  this  case  the  occupational  environment.  A  case  in  point 
is  exposure  to  silicon  dioxide  nanoparticles  because  silicon  dioxide,  including  a 
range  of  its  particle  sizes,  is  being  used  in  cosmetics,  food,^  and  drug  formulations.^ 
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In  general,  silicon  dioxide  is  viewed  as  a  nontoxic  substance 
and  its  industrial  applications  are  numerous. Nevertheless, 
there  have  been  reports,  at  least  in  the  last  two  decades,  that 
silicon  dioxide  particles  are  not  as  harmless  as  they  were 
previously  assumed  to  be. 

When  the  size  of  silicon  dioxide  is  above  the  micrometer 
scale  (ie,  >  1  jam),  it  appears  to  be  benign  to  human,  insects, 
and  microorganisms.  However,  diatomaceous  earth,  which 
contains  more  than  85%  of  amorphous  silicon  dioxide,  is 
used  as  insecticide  in  dust  form,"^  but  its  toxicity  to  insects 
is  not  well  defined.  When  the  size  of  silicon  dioxide  is  in 
the  micrometer  scale  and  below,  several  toxic  effects  have 
been  observed  in  humans  and  animals.  Most  noticeable  is 
the  disease  of  silicosis  in  humans,^  resulting  from  prolonged 
exposure  to  crystalline  silica  dust,  and  similar  symptoms  have 
also  been  reported  in  rats.^  Thus  far,  silicon  dioxide  toxicity 
reports  have  been  almost  exclusively  on  particle  sizes  at  the 
micrometer  scale,  and  mostly  concerning  pulmonary  injuries 
or  lung  inflammation.^’^  Few  studies  have  been  conducted  on 
silicon  dioxide  at  the  nanometer  scale,^’^  and  even  fewer  stud¬ 
ies  so  far  reported  have  been  conducted  with  human  cells. 

In  macroscopic  sizes,  silicon  dioxide  is  not  known  to  be 
cytotoxic. However,  a  recent  study  demonstrated  that 
exposure  of  amorphous  spherical  silicon  dioxide  nanoparticles 
of  different  sizes  induced  decreases  in  viability  of  human 
endothelial  cells,  an  expression  of  their  cytotoxicity  which  was 
apparently  dependent  on  their  particle  size.^  Nevertheless,  few, 
if  any,  studies  have  examined  the  putative  cytotoxic  effects  of 
silicon  dioxide  nanoparticles  on  human  neural  cells. 

There  was  an  early  study  indicating  that  silica  particles  (in 
the  micrometer  and  nanometer  ranges)  when  introduced  into 
the  brains  of  rats  and  mice  induced  an  inflammatory  response 
in  brain  astrocytes  and  macrophages,  and  the  degeneration 
of  some  adjacent  axons  and  axon  terminals,  as  elucidated 
by  light  and  electron  microscopy.^  Furthermore,  silicon  and 
aluminum  were  found  to  be  co-localized  in  the  central  region 
of  senile  plaque  cores  in  the  cortex  of  patients  with  senile 
dementia  of  the  Alzheimer  type,^  and  the  accumulated  silicon 
and  aluminum  appeared  to  be  localized,  at  least  in  part,  in 
lipofuscin  granules  in  the  brains  of  patients  who  died  with 
Alzheimer’s  disease.^®  Consequently,  these  early  studies^”^® 
suggest  that  silicon  dioxide  nanoparticles  may  exert  cytotoxic 
effects  on  neural  cells. 

We  recently  found  that  exposure  to  titanium  dioxide  and 
two  other  metallic  oxide  (namely,  ZnO  and  MgO)  nano¬ 
particles  induced  differential  cytotoxicity  on  human  neural 
cells.  Because  of  our  recent  findings^ ^  and  the  increasing 
evidence  that  a  variety  of  nanoparticles  (including  silicon 


dioxide-containing  nanoparticles)  can  cross  the  blood-brain 
barrier, we  initiated  this  study  to  investigate  the  putative 
cytotoxic  effect(s)  of  silicon  dioxide  nanoparticles  on  human 
neural  cells.  In  particular,  we  focused  on  investigation  of 
the  putative  cytotoxic  effects  of  these  nanoparticles  on 
mitochondrial  function  and  survival  cell  signaling  in  human 
astrocytoma  U87  cells  that  are  astrocyte-like  in  view  of 
the  fact  that  they  are  good  models  of  astrocytes  normally 
found  in  the  brain  in  vivo^"^’^^  and  that  astrocytes  in  the  brain 
are  functionally  coupled  to  endothelial  cells  and  hence  the 
functions  of  the  blood-brain  barrier. 

Because  of  the  aforementioned  considerations,  we 
hypothesized  that  silicon  dioxide  nanoparticles  induce 
cytotoxicity  in  U87  cells  by  disturbing  mitochondrial  function 
and  by  lowering  cell  survival  via  decreasing  cell  survival 
signaling.  To  investigate  our  hypothesis,  we  determined 
the  effects  of  treatment  with  various  concentrations  of 
silicon  dioxide  nanoparticles  on  the  activities  of  two  key 
mitochondrial  enzymes,  ie,  citrate  synthase  and  malate 
dehydrogenase,  and  expression  of  the  mitochondrial  DNA- 
encoded  proteins,  cytochrome  oxidase  subunit  II  and  NADH 
dehydrogenase  subunit  6,  and  the  cell  survival  signaling  path¬ 
way  protein  ERK  and  phosphorylated  ERK  in  U87  cells. 

Materials  and  methods 

Materials 

Silicon  dioxide  nanoparticles  (size  12  nm)  were  purchased 
from  STREM  Chemicals,  Newburyport,  MA.  Dulbecco’s 
modified  Eagle’s  medium  (DMEM)  and  other  chemicals  were 
purchased  from  Sigma- Aldrich  (St.  Louis,  MO).  U87  cells 
were  obtained  from  American  Type  Culture  Collection 
(Manassas,  VA). 

Cell  culture 

Human  U87  astrocytoma  cells  were  cultured  using  DMEM 
supplemented  with  10%  (v/v)  fetal  bovine  serum  and 
antimycotic  solution.  The  cells  were  maintained  in  a  75  cm^ 
flask  containing  20  mL  medium,  incubated  at  37°C  in  a  CO^ 
incubator.  When  the  cells  reached  70%-80%  confluency, 
they  were  harvested  either  by  scrapping  or  trypsinization 
and  transferred  to  other  flasks. 

Preparation  of  stock  suspension 
of  silicon  dioxide  nanoparticles 

The  silicon  dioxide  nanoparticles  stock  suspension  was 
first  prepared  by  suspending  50  mg  of  silicon  dioxide 
nanoparticles  in  a  100  mL  conical  flask  containing  sterile 
phosphate-buffered  saline.  The  suspension  was  then  placed 
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in  a  magnetic  stirrer  to  allow  the  mixture  to  stir  continuously 
at  room  temperature  before  further  dilutions  were  made 
from  the  stock  (which  was  being  continuously  stirred)  to  be 
used  at  specified  concentrations  and  then  mixed  for  use  in 
treating  cells. 

MTT  assay  to  assess  cell  viability 

Cells  were  seeded  (2000  cells/well)  onto  a  96-well  plate  and 
allowed  to  attach  to  the  bottom  of  each  well  (inner  diameter 
0.6  cm)  for  an  hour.  Silicon  dioxide  nanoparticles  were 
then  added  at  specified  concentrations  (0.1-100  pg/mL)  to 
each  well  containing  0.2  mL  with  the  cells  attached  at  the 
bottom  and  mixed.  The  plates  so  prepared  were  incubated 
for  48  hours  at  37°C.  MTT  dye  was  then  added  to  each  well 
and  the  plate  incubated  for  another  four  hours  at  37°C.  The 
purple  crystals  formed  in  cells  were  dissolved  using  dimethyl 
sulfoxide  and  the  absorbance  of  the  resultant  material  in  the 
wells  was  measured  at  567  nm  using  the  microplate  reader 
as  described  previously. 

Determination  of  mitochondrial 
enzyme  activity 

The  U87  cells  were  cultured  in  DMEM  in  75  cm^  flasks. 
When  the  cells  were  70%-80%  confluent,  silicon  dioxide 
nanoparticle  treatments  were  initiated.  The  mitochondrial 
function  of  the  untreated  and  treated  U87  cells  was  assessed 
by  measuring  activities  of  two  tricarboxylic  acid  cycle 
enzymes,  citrate  synthase  and  malate  dehydrogenase,  in 
U87  cells  treated  with  silicon  dioxide  nanoparticles  at  0, 25, 
50,  or  100  pg/mL  by  previously  published  methods. The 
untreated  U87  cells  served  as  the  control.  Citrate  synthase 
and  malate  dehydrogenase  activity  in  cell  homogenates  was 
measured  at  412  nm  and  340  nm,  respectively,  using  an 
ultraviolet- VIS  spectrophotometer. 

Western  blot  analysis 

Expression  of  the  mitochondrial  DNA-encoded  proteins, 
NADPH  dehydrogenase  subunit  6  and  cytochrome  C 
oxidase  subunit  II,  and  the  cell  signaling  proteins  ERK 
and  phosphorylated  ERK  were  determined  by  Western  blot 
analysis.  The  U87  cells  treated  with  or  without  (ie,  control) 
silicon  dioxide  nanoparticles  were  collected  and  homogenized 
in  a  buffer  containing  5  mM  HEPES  and  250  mM  sucrose, 
along  with  protease  inhibitors  as  described  previously.  Pro¬ 
tein  content  of  the  homogenates  was  then  determined  using 
the  bicinchoninic  acid  technique  with  a  microplate  reader. 
Briefly,  equal  amounts  of  protein  from  the  samples  were  loaded 
onto  the  lanes  of  the  gels,  and  the  proteins  were  separated 


by  polyacrylamide  gel  electrophoresis  and  transferred  to  a 
polyvinylidene  fluoride  membrane. Monoclonal  antibodies 
against  the  respective  proteins  were  then  used  to  probe  the 
proteins  of  interest.  The  polyvinylidene  fluoride  membrane 
containing  the  target  protein  was  then  developed  using  the 
chemiluminescence  technique  on  an  X-ray  film  to  assess  the 
extent  of  expression  of  respective  proteins. 

Assessment  of  cellular  morphology 

The  morphology  of  the  U87  cells,  treated  with  silicon 
dioxide  nanoparticles  for  48  hours  at  37°C  using  specified 
concentrations,  were  compared  with  that  of  the  control  or 
untreated  U87  cells  by  using  bright  field  light  microscopy. 
The  images  were  obtained  using  a  Leica  light  microscope  at 
400  X  magnification  (Leica  DM  IRB;  Leica,  Bannockburn,  IE) 
equipped  with  a  digital  camera  (Leica  DEC  300FX;  Leica). 

Statistical  analysis 

Data  analysis  was  performed  employing  one  way  ANOVA 
followed  by  Dunnett’s  post  hoc  test  using  SPSS  software 
(SPSS  Inc.,  Chicago,  IE).  All  data  reported  are  mean  ±  SEM 
of  three  individual  experiments.  Statistical  significance  was 
set  ditP  <  0.05. 

Results 

Effect  of  nanoparticles  on  human  U87 
astrocytoma  cell  survival 

To  determine  the  effect  of  silicon  dioxide  nanoparticles 
on  cell  survival,  U87  cells  were  exposed  to  silicon  dioxide 
nanoparticles  for  48  hours  at  concentrations  ranging  from  0. 1 
to  100  pg/mL.  At  lower  treatment  concentrations,  from  0.1 
to  10  pg/mL,  the  nanoparticles  did  not  affect  viability  of  the 
U87  cells  (Figure  1).  However,  at  treatment  concentrations  of 
25  pg/mL  and  higher,  silicon  dioxide  nanoparticles  induced 
concentration-related  decreases  in  survival  of  U87  cells. 


MTT  assay 


Figure  I  Effect  of  treatment  with  silicon  dioxide  nanoparticles  on  survival  of  human 
astrocytoma  U87  cells.  U87  cells  were  treated  at  specified  concentrations  of  silicon 
dioxide  nanoparticles  for  48  hours.  Values  were  the  mean  ±  SEM  of  at  least  three 
separate  experiments;  CTRL  represented  the  untreated  (ie,  control)  U87  cells; 
*P  <  0.05  versus  control  cells. 
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At  the  highest  treatment  level  of  100  jig  /mL,  less  than  30% 
of  the  cells  survived  (Figure  1). 

Effect  on  mitochondrial  function 
in  human  U87  astrocytoma  cells 

Because  cell  survival  critically  depends  on  mitochondrial 
functions  being  maintained  at  a  normal  physiologic  level, 
we  determined  the  effect  of  silicon  dioxide  nanoparticles 
on  mitochondrial  function  in  U87  cells  by  monitoring  the 
activities  of  citrate  synthase  and  malate  dehydrogenase.^^ 
Both  enzymes  are  nuclear  DNA-encoded;  these  enzyme 
proteins  are  synthesized  in  the  endoplasmic  reticulum  and 
then  imported  into  the  mitochondrial  matrix  compartment. 

At  treatment  concentrations  of  25-100  jag/mL  for 
48  hours,  silicon  dioxide  nanoparticles  induced  dose-related 
increases  in  citrate  synthase  activities  in  U87  cells  (Figure  2). 
On  the  other  hand,  although  at  the  same  concentrations  the 
nanoparticles  also  induced  significantly  increased  activity 
in  malate  dehydrogenase  in  U87  cells,  the  increases  were 
not  dose-related  (Figure  3).  Using  the  same  nanoparticle 
concentrations  for  treatment  of  U87  cells,  there  was  a  dose- 
related  decrease  in  cell  survival  (Figure  1),  and  it  is  likely 
that  the  remaining  surviving  U87  cells  were  compensating  by 
upregulation  of  citrate  synthase  and,  to  a  less  extent,  malate 
dehydrogenase,  so  as  to  maintain  their  energy  production  via 
tricarboxylic  acid  cycle  metabolism  for  survival. 

Effects  of  nanoparticles  on  mitochondrial 
DNA-encoded  and  cell  signaling  protein 
expression 

Because  silicon  dioxide  nanoparticles  induced  dose-related 
decreases  in  survival  of  U87  cells  at  concentrations  of 
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Figure  2  Effect  of  treatment  with  silicon  dioxide  nanoparticles  on  specific  activities 
of  citrate  synthase  in  human  astrocytoma  U87  cells.  U87  cells  were  treated  at 
specified  concentrations  of  silicon  dioxide  nanoparticles  for  48  hours.  Then  the 
activities  of  citrate  synthase  in  the  homogenates  of  treated  and  untreated  (ie, 
control,  Ctrl)  U87  cells  were  determined  as  described  in  Materials  and  methods; 
the  activities  of  citrate  synthase  were  expressed  per  mg  of  homogenate  protein  as 
specific  activities.  The  specific  activities  values  were  the  mean  ±  SEM  of  at  least  three 
separate  experiments;  Ctrl  represented  the  value  in  untreated  U87  cell  homogenate; 
*P  <  0.05  versus  that  of  control  cells. 
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Figure  3  Effect  of  treatment  with  silicon  dioxide  nanoparticles  on  specific  activities 
of  malate  dehydrogenase  in  human  astrocytoma  U87  cells.  U87  cells  were  treated 
at  specified  concentrations  of  silicon  dioxide  nanoparticles  for  48  hours.  Then  the 
activities  of  malate  dehydrogenase  in  the  homogenates  of  treated  and  untreated  (ie, 
control,  Ctrl)  U87  cells  were  determined  as  described  in  Materials  and  methods;  the 
activities  of  malate  dehydrogenase  were  expressed  per  mg  of  homogenate  protein  as 
specific  activities.  The  specific  activity  values  were  the  mean  ±  SEM  of  at  least  three 
separate  experiments;  Ctrl  represented  the  value  in  untreated  U87  cell  homogenate; 
*P  <  0.05  versus  that  of  control  cells. 


25-100  jig  /mL  over  48  hours  (Figure  1),  we  investigated  the 
possibility  that  these  decreases  in  survival  can  be  attributed 
to  the  nanoparticle-induced  alterations  in  expression  of 
mitochondrial  DNA-encoded  and  cell  signaling  proteins 
(Figures  4-6). 

At  treatment  concentrations  of  25-100  |ig/mL  for 
48  hours,  silicon  dioxide  nanoparticles  induced  dose-related 
decreases  in  the  expression  of  cytochrome  C  oxidase  subunit 
II  and  NADH  dehydrogenase  subunit  6  (two  mitochondrial 
DNA-encoded  peptides)  in  U87  cells  (Figures  4  and  5). 
These  results  strongly  suggested  treatment  with  silicon 
dioxide  nanoparticles  altered  the  normal  functioning  of  the 
mitochondrial  genome  in  U87  cells.  A  likely  consequence 
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Figure  4  Effect  of  treatment  with  silicon  dioxide  nanoparticles  on  expression  of 
cytochrome  oxidase  subunit  II  in  human  astrocytoma  U87  cells.  U87  cells  were 
treated  at  specified  concentrations  of  silicon  dioxide  nanoparticles  for  48  hours. 
Then  cell  lysates  of  treated  and  untreated  (ie,  control)  U87  cells  were  prepared 
as  described  in  Materials  and  methods.  The  expression  of  cytochrome  oxidase 
subunit  II,  encoded  by  mitochondrial  DNA,  was  determined  by  Western  blot 
analysis  using  P-actin  as  the  loading  control:  Lane  I,  lysate  of  untreated  or  control 
U87  cells;  lane  2,  lysate  of  U87  cells  treated  with  silicon  dioxide  nanoparticles  at 
25  |ig/mL;  lane  3,  lysate  of  U87  cells  treated  with  silicon  dioxide  nanoparticles  at 
50  |ig/mL;  lane  4,  lysate  of  U87  cells  treated  with  silicon  dioxide  nanoparticles 
at  1 00  |ig/mL.  The  blots  were  from  a  typical  experiment.  Two  other  experiments 
yielded  essentially  the  same  trend  of  results. 
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Figure  5  Effect  of  treatment  with  silicon  dioxide  nanoparticles  on  expression  of 
nicotinamide  adenine  dinucleotide  (NADH)  dehydrogenase  subunit  6  in  human 
astrocytoma  U87  cells.  U87  cells  were  treated  at  specified  concentrations  of  silicon 
dioxide  nanoparticles  for  48  hours.  Then  cell  lysates  of  treated  and  untreated 
(ie,  control)  U87  cells  were  prepared  as  described  in  Materials  and  methods.  The 
expression  of  NADH  dehydrogenase  subunit  6,  encoded  by  mitochondrial  DNA, 
was  determined  by  Western  blot  analysis  using  P-actin  as  the  loading  control:  Lane 
I,  lysate  of  untreated  or  control  U87  cells;  lane  2,  lysate  of  U87  cells  treated  with 
silicon  dioxide  nanoparticles  at  25  |ig/mL;  lane  3,  lysate  of  U87  cells  treated  with  silicon 
dioxide  nanoparticles  at  50  |ig/mL;  lane  4,  lysate  of  U87  cells  treated  with  silicon 
dioxide  nanoparticles  at  1 00  pg/mL.  The  blots  were  from  a  typical  experiment.  Two 
other  experiments  yielded  essentially  the  same  trend  of  results. 


of  this  effect  is  impairment  in  the  mitochondrial  electron 
transport  chain  in  U87  cells.  Indeed,  the  nanoparticle-induced 
disruption  of  mitochondrial  respiratory  chain  structure  and 
function  may  be  one  cause  of  energy  failure  that  ultimately 
led  to  the  death  of  U87  cells. 
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Figure  6  Effect  of  treatment  with  silicon  dioxide  nanoparticles  on  expression  of 
extracellular  signal  regulated  kinase  (ERK)  and  phosphorylated  ERK  (p-ERK)  in 
human  astrocytoma  U87  cells.  U87  cells  were  treated  at  specified  concentrations  of 
silicon  dioxide  nanoparticles  for  48  hours.  Then  cell  lysates  of  treated  and  untreated 
(ie,  control)  U87  cells  were  prepared  as  described  in  Materials  and  methods.  The 
expression  of  ERK  and  phosphorylated  ERK  was  determined  by  Western  blot 
analysis  using  P-actin  as  the  loading  control:  Lane  marked  C,  lysate  of  untreated 
or  control  U87  cells;  lane  marked  I,  lysate  of  U87  cells  treated  with  silicon  dioxide 
nanoparticles  at  I  |ig/mL;  lane  marked  10,  lysate  of  U87  cells  treated  with  silicon 
dioxide  nanoparticles  at  10  |ig/mL;  lane  marked  50,  lysate  of  U87  cells  treated  with 
silicon  dioxide  nanoparticles  at  50  |ig/mL.  The  blots  were  from  a  typical  experiment. 
Two  other  experiments  yielded  essentially  the  same  trend  of  results. 


Other  than  their  effect  of  depressing  the  mitochondrial 
respiratory  chain,  thereby  decreasing  oxidative  phos¬ 
phorylation,  treatment  of  U87  cells  with  silicon  dioxide 
nanoparticles  could  also  lower  survival  of  U87  cells  through 
altering  cell  signaling  pathway(s)  that  regulate(s)  cell 
survival  and  proliferation.^®  We  therefore  investigated  this 
possibility  by  examining  the  effect  of  these  nanoparticles 
on  expression  of  ERK  and  phosphorylated  ERK  proteins. 
We  observed  that  when  U87  cells  were  treated  with  silicon 
dioxide  nanoparticles  1-50  pg/mL  for  48  hours,  the  protein 
expression  of  phosphorylated  ERK  showed  a  dose-related 
decrease,  while  that  of  ERK  protein  remained  essentially 
unchanged  (Figure  6),  suggesting  that  a  lowering  of  this  cell 
survival/proliferation  signaling  mechanism  could,  at  least 
in  part,  account  for  the  dose-related  decrease  in  U87  cell 
survival  induced  by  these  nanoparticles. 

Effect  on  morphology  of  U87  cells 

To  ascertain  whether  or  not  treatment  of  U87  cells  with 
silicon  dioxide  nanoparticles  led  to  any  gross  changes  in 
their  morphology,  we  examined  the  cells  under  bright  field 
light  microscopy  (Figure  7).  We  observed  that  as  we  exposed 
U87  cells  to  increasing  concentrations  of  silicon  dioxide 
nanoparticles  higher  than  25  pg/mL,  the  cells  became  more 
and  more  enlarged  and  swollen,  suggesting  that  they  assumed 
a  pathologic  appearance  (Figure  7). 

Discussion 

Few,  if  any,  recent  studies  have  addressed  the  cytotoxic 
effects  of  silicon  dioxide  nanoparticles  in  neural  cells. 
As  far  as  we  are  aware,  ours  is  the  first  to  report  the 
cytotoxic  effects  of  silicon  dioxide  nanoparticles  on 
human  astrocytoma  U87  cells  and  some  of  the  underlying 
subcellular  mechanisms.  Consistent  with  our  hypothesis 
that  silicon  dioxide  nanoparticles  induce  cytotoxicity  in 
U87  cells  by  disturbing  mitochondrial  function  and  by 
lowering  cell  survival  via  decreasing  cell  survival  signaling, 
we  found  that  treatment  with  silicon  dioxide  nanoparticles 
induced  concentration-related  lowering  of  protein  expression 
of  the  mitochondrial  DNA-encoded  cytochrome  C  oxidase 
subunit  II  and  NADH  dehydrogenase  subunit  6,  two  key 
components  of  the  mitochondrial  respiratory  chain,  and 
phosphorylated  ERK,  a  key  cell  survival/proliferation 
signaling  molecule  in  U87  cells.  It  is  noteworthy  that  we 
found  those  changes  in  protein  expression  at  concentrations 
of  silicon  dioxide  nanoparticles  that  correlated  with  those 
inducing  concentration-related  decreases  in  survival  of 
U87  cells. 
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Figure  7  Effect  of  treatment  with  silicon  dioxide  nanoparticles  on  the  morphology  of  human  astrocytoma  U87  cells.  U87  cells  were  treated  at  specified  concentrations 
of  silicon  dioxide  nanoparticles  for  48  hours.  Then  the  morphology  of  treated  and  untreated  (ie,  control)  U87  cells  were  assessed  using  bright  field  light  microscopy  at 
400  X  magnification  as  described  in  Materials  and  methods.  The  photomicrographs  shown  were  representative  of  those  obtained  in  several  studies. 


As  emphasized  earlier,  the  initial  rationale  for  focusing 
our  studies  on  U87  cells  was  that  few  studies  have  addressed 
the  putative  cytotoxic  effects  of  silicon  dioxide  nanopar¬ 
ticles  on  neural  cells,  especially  those  from  the  human 
brain.  More  importantly,  not  only  do  astrocytes  have  many 
physiologic  roles  (eg,  metabolic  trafficking,  neurotrans¬ 
mitter  cycling,  protecting  neurons  from  pathophysiologic 
assaults), they  also  play  pathophysiologic  roles  in 
disease  states  (eg,  neuroinflammation  in  neurodegenera- 
tive  diseases  such  as  Alzheimer’s  disease  and  Parkinson’s 
disease). Furthermore,  it  is  relevant  to  note  that  although 
U87  are  neurotumor  cells,  they  possess  many  of  the  “nor¬ 
mal”  physiologic  characteristics  of  astrocytes  detected  in 
primary  cultures  of  astrocytes  and  astrocytes  in  the  brain 
in  vivo.^"^’^^  Thus,  U87  cells  constitute  a  good  model  system 
in  vitro  for  brain  astrocytes.  Consequently,  we  have 


employed  U87  cells  as  a  model  system  to  elucidate  the 
putative  cytotoxicity  of  nanoparticles  on  neural  cells  in  a 
systematic  manner. 

One  neurotoxic  effect  of  a  neurotoxicant,  such  as 
manganese,  is  via  a  lowering  of  cell  survival/prolifera¬ 
tion  signaling  molecule  expression,  leading  ultimately  to 
death  of  neural  cells. Consistent  with  this  observation  is 
our  finding  in  this  study  that  treatment  of  U87  cells  with 
increasing  concentrations  of  silicon  dioxide  nanoparticles 
induced  a  dose-related  decrease  in  protein  expression  of 
phosphorylated  ERK  (Figure  6),  one  important  cell  survival/ 
proliferation  signaling  molecule.^®  This  effect  correlated 
quite  well  with  the  dose-related  decrease  in  survival  of 
these  cells  (Figure  1)  and  alterations  in  their  morphology 
(Figure  7)  induced  by  the  nanoparticles.  Moreover,  we  also 
found  that  in  U87  cells  treated  in  the  same  nanoparticle  dose 
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range,  there  was  a  concentration-related  decrease  in  protein 
expression  of  mitochondrial  DNA-encoded  cytochrome  C 
oxidase  subunit  II  and  NADH  dehydrogenase  subunit  6 
(Figures  4  and  5). 

Our  present  findings  that  exposure  of  human  astrocy¬ 
toma  U87  cells  to  silicon  dioxide  induced  dose-related 
decreases  in  cell  survival  and  alteration  of  their  mitochondrial 
structure  and  function  (Figures  1-6)  are  similar  to  those  of 
Chen  et  aP^  who  demonstrated  that  exposure  of  human  brain 
microvascular  endothelial  cells  to  aluminum  oxide  nanopar¬ 
ticles  induced  decreased  viability  of  those  cells,  alteration 
in  their  mitochondrial  membrane  potential,  and  a  lowering 
of  their  tight  junction  protein  expression.  Consequently, 
in  this  context,  our  finding  that  silicon  dioxide  nanopar¬ 
ticles  induced  a  dose-related  lowering  of  the  expression  of 
cytochrome  C  oxidase  subunit  II  and  NADH  dehydrogenase 
subunit  6  is  of  pathophysiologic  importance  and  interest  in 
several  respects.  Because  these  two  peptides  are  structural 
components  of  the  mitochondrial  respiratory  chain  com¬ 
plexes  IV  and  I,  respectively,  and  have  key  functional  roles 
in  that  respiratory  chain,^"^  decreased  expression  of  these 
peptides  induced  by  the  nanoparticles  likely  results  in  dys¬ 
function  in  the  mitochondrial  respiratory  chain  and  oxidative 
phosphorylation,  leading  ultimately  to  decreased  adenosine 
triphosphate  synthesis.  Consequently,  the  decreased  expres¬ 
sion  of  the  two  mitochondrial  DNA-encoded  peptides  could 
likely  contribute  to  decreasing  U87  cell  survival  induced 
by  silicon  dioxide  nanoparticles  through  necrotic  cell  death 
as  a  result  of  energy  failure. This  conclusion  is  certainly 
consistent  with  our  observation  that  the  U87  cells  assumed 
an  increasingly  swollen  appearance,  a  hallmark  of  necrosis, 
as  we  increased  their  treatment  levels  of  silicon  dioxide 
nanoparticles  (Figure  7).  The  decreased  expression  of  cyto¬ 
chrome  C  oxidase  subunit  II  and  NADH  dehydrogenase 
subunit  6  peptides  induced  by  the  nanoparticles  could  reflect 
the  effect  of  the  nanoparticles  on  altering  communication 
between  the  mitochondrial  genome  and  the  nuclear  genome, 
decreasing  mitochondrial  peptide  synthesis,  disruption  of 
protein  targeting  to  mitochondria,  and/or  a  combination 
of  these  mechanisms.  The  nanoparticle-induced  decrease 
in  protein  expression  of  the  two  peptides  could  also  result 
from  the  overall  effect  of  the  nanoparticles  on  survival/ 
proliferation  signaling  in  U87  cells.  Clearly,  these  are  novel 
but  mechanistically  relevant  possibilities  that  deserve  further 
investigation. 

Unlike  the  downregulation  of  the  protein  expression 
of  mitochondrial  DNA-encoded  cytochrome  C  oxidase 
subunit  II  and  NADH  dehydrogenase  subunit  6,  and  the 


survival/proliferation  signaling  molecule  phosphorylated 
ERK,  treatment  of  U87  cells  with  silicon  dioxide  nano¬ 
particles  induced  concentration-related  increases  in  the 
activity  of  citrate  synthase  and  malate  dehydrogenase, 
both  of  which  are  located  in  the  mitochondrial  matrix 
(Figures  2  and  3).  Because  the  increases  in  citrate  synthase 
and  malate  dehydrogenase  activity  were  observed  at 
nanoparticle  concentrations  that  also  induced  dose-related 
decreases  in  U87  cell  survival  (Figure  1),  one  possible,  and 
likely,  explanation  for  the  increased  citrate  synthase  and 
malate  dehydrogenase  activity  is  that  the  surviving  cells 
were  showing  compensatory/adaptive  mechanisms  involv¬ 
ing  upregulation  of  tricarboxylic  acid  cycle  enzymes  in  the 
mitochondrial  matrix  of  surviving  or  dying  cells,  or  both,  in 
the  face  of  downregulation  of  mitochondrial  DNA-encoded 
respiratory  chain  components,  such  as  cytochrome  C 
oxidase  subunit  II  and  NADH  dehydrogenase  subunit  6. 
Consequently,  this  upregulation  of  tricarboxylic  acid  cycle 
enzymes  may  offset  (or  compensate  for)  the  effect  on 
mitochondrial  energetics  through  the  downregulation  of 
respiratory  chain  components  induced  by  the  nanoparticles. 
Only  future  studies  can  elucidate  whether  this  mechanistic 
possibility  is  tenable  because  they  are  beyond  the  scope  of 
the  present  study. 

Because  ours  is  the  first  study  to  report  on  the  cytotoxic 
effects  of  silicon  dioxide  nanoparticles  on  human  neural 
cells,  only  a  few  comparisons  can  be  made  with  the  effects 
of  silicon  dioxide  nanoparticles  on  neural  and  peripheral 
cell  types  because  the  literature  in  this  area  of  research  is 
rather  scant.  For  example,  Napierska  et  aF  demonstrated 
exposure  of  human  endothelial  cells  to  amorphous  spherical 
silicon  dioxide  nanoparticles  induced  decreases  in  their 
viability  and  this  effect  was  apparently  dependent  on  their 
particle  size.  Several  groups  had  also  shown  that  silicon 
dioxide  nanoparticles  decreased  viability  of  some  peripheral 
human  and  other  mammalian  cell  types. Thus,  recent 
reports,^’^’^^’^^  as  well  as  the  findings  of  this  study,  are  in 
accord  in  emphasizing  that  silicon  dioxide  nanoparticles 
induces  decreased  viability  of  a  variety  of  human  and  other 
mammalian  cell  types.  Nevertheless,  more  systematic  stud¬ 
ies  are  required  to  elucidate  fully  the  molecular  mechanisms 
underlying  the  cytotoxicity  of  these  nanoparticles. 

As  we  discussed  previously,  one  early  study  indicated 
that  when  silicon  nanoparticles  were  introduced  directly  into 
the  brains  of  rats  and  mice,  they  induced  an  inflammatory 
response  in  brain  astrocytes.^  Furthermore,  silicon  was 
found  in  senile  plaque  cores  and  in  lipofuscin  granules  in 
the  cortex  of  patients  who  died  of  Alzheimer’s  disease. 


International  Journal  of  Nanomedicine  2010:5 


submit  your  manuscript  |  www.dovepress.com 

Dovepress 


721 


Lai  et  al 


Dovepress 


In  view  of  these  earlier  findings, because  astrocytes 
play  important  roles  in  neuroinflammation, and  U87  cells 
constitute  a  good  cell  model  for  astrocytes,  the  results 
of  this  study  may  have  pathophysiologic  implications  in 
the  inflammation  in  astrocytes  in  Alzheimer’s  disease  in 
particular  and  in  neuroinflammation  in  general.  Thus,  the 
mechanistic  connection  between  the  inflammatory  response 
in  Alzheimer’s  disease,  neuroinflammation,  and  the  cytotoxic 
effects  of  silicon  dioxide  nanoparticles  in  neural  cells  merits 
further  investigation. 

Conclusion 

This  study  is  the  first  to  report  on  the  cytotoxic  effects 
of  silicon  dioxide  nanoparticles  on  human  astrocytoma 
U87  cells,  and  some  of  the  underlying  subcellular 
mechanisms.  Consistent  with  our  hypothesis,  we  found 
that  treatment  with  silicon  dioxide  nanoparticles  induced 
concentration-related  lowering  of  protein  expression  in 
the  mitochondrial  DNA-encoded  cytochrome  C  oxidase 
subunit  II  and  NADH  dehydrogenase  subunit  6,  two  key 
components  of  the  mitochondrial  respiratory  chain,  and 
phosphorylated  ERK,  a  key  cell  survival/proliferation  sig¬ 
naling  molecule  in  U87  cells.  We  also  noted  those  changes 
in  protein  expression  induced  by  silicon  dioxide  nanopar¬ 
ticles  correlated  with  concentration-related  decreases  in 
survival  of  U87  cells  induced  by  the  nanoparticles.  On  the 
other  hand,  we  observed  upregulation  of  citrate  synthase 
and  malate  dehydrogenase,  two  key  tricarboxylic  acid 
cycle  enzymes.  Those  changes  were  likely  compensatory/ 
adaptive  mechanism  of  dying  and/or  surviving  U87  cells. 
Thus,  our  findings  may  assume  pathophysiologic  impor¬ 
tance  in  neuroinflammation  and  Alzheimer’s  disease  and 
in  the  environmental  health  impact  of  human  exposure  to 
these  nanoparticles.  This  is  obviously  a  worthwhile  area 
for  further  study. 
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A  Cell  Culture  Model  for  Diabetic  Neuropathy  Studies 


Abstract : 

Diabetic  neuropathy  is  one  of  the  most  severe  complications  of  chronic  diabetes. 
Though  several  theories  exist,  the  pathophysiology  of  the  disease  is  poorly  understood. 
We  have  therefore  developed  an  in  vitro  model  to  elucidate  its  underlying 
pathophysiologic  mechanisms.  We  believe  our  model  allows  us  to  gain  new  insights  into 
such  mechanisms.  Moreover,  our  model  improves  on  existing  primary  culture  models 
because  the  latter  change  with  passage  number  and  have  limited  life-span.  We 
hypothesize  that  high  glucose  treatment  induces  oxidative  stress  and  decreases  GSH 
level,  ultimately  leading  to  apoptosis  in  dorsal  root  ganglion  (DRG)  neurons  and 
Schwann  cells.  Results  of  our  ongoing  studies  suggest  exposure  of  DRG  neurons  to 
high  levels  of  glucose  (e.g.,  45  &  60  mM),  conditions  that  favor  increased  ROS 
generation,  decrease  their  survival,  eventually  leading  to  cell  death  whereas  in  co¬ 
culture,  Schwann  cells  help  protect  DRG  neurons  and  enhance  their  survival.  Other 
studies  are  in  progress  to  further  characterize  our  cell  model.  Thus,  results  of  our 
ongoing  studies  are  consistent  with  the  notion  that  our  cell  model  is  appropriate  for 
investigation  of  diabetic  neuropathy. 

Keywords:  Cell  Culture  Model,  Diabetic  Neuropathy,  Neurodegeneration 

Introduction: 

Diabetes  is  the  disease  of  high  blood  glucose  and  according  to  the  American 
Diabetic  Association,  23.6  million  people  (8%  of  United  States  populations)  have 
diabetes.  Diabetic  neuropathy  is  one  of  the  most  severe  complications  of  diabetes,  an 


inflammatory  condition  in  which  the  nerves  in  the  extremities  of  the  body  become 
damaged,  ultimately  resulting  in  death  of  nerve  cells  (Brownlee  2001,  Figueroa-Romero 
et  al.  2008,  Leinninger  et  al.  2006).  It  affects  more  that  60%  of  diabetic  population 
(Figueroa-Romero  et  al.  2008).  Some  of  the  serious  complications  of  nerve  damage  as 
a  result  of  diabetes  include  loss  of  sensation  or  pain  in  limbs,  adverse  effects  on 
digestion,  decreased  sexual  response,  and  urinary  tract  infection.  Half  of  the  foot 
amputations  in  the  United  States  constitute  the  consequence  of  diabetic  neuropathy. 
There  is  little  advancement  in  the  management  and  treatment  of  diabetic  neuropathy 
because  it  is  very  difficult  to  predict  and  monitor  nerve  cell  damage. 

Various  in  vivo  and  in  vitro  models  mimicking  closely  or  approximately  the 
diabetic  pathologies  in  humans  have  been  devised  to  investigate  pathophysiological 
mechanisms  of  the  disease.  Each  model  has  its  own  advantages  and  limitations.  In  vivo 
models  are  preferred  in  elucidating  the  etiology  of  the  disease  and  for  testing  the 
efficacy  of  potential  therapies.  However,  limitations  of  in  vivo  models  include  inability  to 
tightly  control  their  glycemic  status  and  the  fact  that  these  models  do  not  lend 
themselves  readily  for  use  in  investigating  the  pathophysiology  of  the  disease  at  the 
cellular  and  molecular  levels  (Apfel  2006). 

Unlike  in  vivo  models,  in  vitro  models  of  diabetes  in  general  and  diabetic 
neuropathy  in  particular  allow  investigations  of  pathophysiological/pathogenic 
mechanisms  at  the  cellular  and  molecular  levels  (Sango  et  al.  2006).  For  example, 
these  models  permit  the  examination  of  effects  of  high  glucose  on  neurons  in  a 
controlled  environment  (Sango  et  al.  2006).  Nevertheless,  there  is  no  in  vitro  cell  model 
available  whereby  one  could  study  the  long-term  exposure  of  dorsal  root  ganglion 


(DRG)  neurons  and/or  Schwann  cells  to  high  and  pathologic  levels  of  glucose.  To 
address  this  need  for  such  model(s),  we  have  been  systematically  developing  different 
co-culture  models  of  DRG  neurons  and  Schwann  cells  because  the  DRG  neurons  in 
vivo  are  always  surrounded  by  Schwann  cells  and  Schwann  cells  protect  them  from  any 
damage  or  cell  death  (Vincent  et  al.  2005).  We  hypothesize  that  immortalized  cell 
culture  models  using  DRG  neurons,  Schwann  cells  and  their  co-cultures  can  be 
productively  employed  to  elucidate  the  pathophysiological  and/or  pathogenic 
mechanisms  of  diabetic  neuropathy.  This  study  was  initiated  to  investigate  our 
hypothesis. 

Materials  and  Methods: 

Cell  Cultures.  The  immortalized  DRG  neurons  were  a  gift  from  Dr.  Ahmet  Hoke’s 
laboratory  at  Johns  Hopkins  University  (Baltimore,  MD,  USA)  (Chen  et  al.  2007).  The  rat 
Schwann  cell  line  was  obtained  from  ATCC  (Manassas,  VA,  USA).  These  cells  and  their 
co-culture  were  cultured  in  DMEM  (Sigma;  St  Louis,  MO,  USA)  supplemented  with  10% 
(v/v)  fetal  bovine  serum  (FBS),  1%  (w/v)  sodium  pyruvate,  0.292  g/l  L-glutamine,  1.5  g/l 
sodium  bicarbonate,  1%  (v/v)  anti-mycotic  and  various  specified  concentrations  (5-45 
mM)  of  glucose. 

Cell  Survival  (MTT)  Assay.  8000-10000  DRG  neurons  or  Schwann  cells  were  seeded 
per  well  in  a  48-well  plate  in  a  medium  with  a  normal  or  high  glucose  concentration. 
After  incubation  at  37°C  for  48  hours,  50  pi  of  MTT  (5  mg/ml  in  PBS)  reagent  was  added 
to  each  well.  After  incubation  for  another  4  hours,  the  medium  was  removed  gently  and 
the  cellular  reaction  product  was  extracted  in  200  pi  DMSO.  Then  the  optical  density  of 


contents  of  each  well  was  measured  in  a  plate  reader  at  570  nm.  The  absorbance  was 
proportional  to  the  number  of  live  cells  previously  present  in  each  well. 

Reactive  Oxygen  Species  (ROS)  Assay.  Cells  in  a  medium  with  normal  or  high 
glucose  were  incubated  at  37°C  for  48  hours  and  then  200  pi  of  H2DCF  dye  (10  pM  in 
PBS)  was  added  to  each  well.  After  another  45  minutes,  the  medium  was  removed 
gently  and  200  pi  of  PBS  was  added  in  each  well.  The  fluorescence  output  in  each  well 
was  measured  in  the  plate  reader  set  at  489  nm  excitation-521  nm  emission  in  the 
fluorescence  mode.  The  fluorescence  output  corresponded  to  the  ROS  produced  by 
cells  present  in  each  well  and  was  normalized  with  respect  to  cellular  protein,  which  was 
determined  using  the  BCA  Protein  Assay  Kit. 

Glutathione  (GSH)  Assay.  GSH  in  cell  homogenates  was  measured  using  Ellman’s 
reagent  (5,5'-dithiobis-(2-nitrobenzoic  acid)  or  DTNB)  as  described  previously 
(Dukhande  et  al.  2006). 

Co-culture  of  DRG  neurons  and  Schwann  cells.  Our  co-culture  model  closely  mimic 
the  physiological  conditions  of  DRG  neurons  &  Schwann  cells  because  Schwann  cells 
always  surround  DRG  neurons  in  vivo  and  protect  them  from  pathophysiological 
assaults.  DRG  neurons  &  Schwann  cells  were  cultured  at  37°C  and  5%  CO2  in 
Dulbecco’s  Modified  Eagle’s  Medium  supplemented  with  10%  FBS  and  counted  using  a 
Coulter  counter  after  24  hours  or  at  about  60-70  %  confluence.  DRG  neurons  were 
seeded  on  a  Corning  Costar  24-well  plate.  Schwann  cells  were  then  seeded  on  a 
Millipore  hanging  cell  culture  insert  (pore  size  0.4  pm)  on  a  separate  plate  and  then 
introduced  to  a  DRG  neuron-containing  well  after  4  hours  to  achieve  the  co-culture 
condition.  DRG  neurons  (co-cultured  with  Schwann  cells)  were  exposed  to  various 


levels  of  glucose  for  specified  periods  and  their  survival  determined  employing  the  cell 
survival  assay. 

Statistical  anaiysis  of  results.  Statistical  significance  of  experimental  results  was 
analyzed  with  one-way  ANOVA  followed  by  Dunnett’s  post-hoc  test  using  SPSS  17 
software  package,  with  a  minimum  significance  level  set  at  p<  0.05. 

Results  and  Discussion: 

Diabetic  neuropathy  affects  the  peripheral  nervous  system  (PNS)  the  most: 
dorsal  root  ganglion  (DRG)  neurons  in  PNS  are  especially  susceptible  to  high  glucose- 
induced  cell  damage  and/or  death.  Therefore,  we  used  DRG  neurons  to  develop  a  cell 
culture  model  for  diabetic  neuropathy  and  have  begun  to  characterize  it.  When  we 
exposed  DRG  neurons  to  various  glucose  levels,  we  noted  that  these  cells  survived 
best  at  25  mM  of  glucose  (Fig.  1),  a  level  higher  than  the  physiological  level  of  5.5  mM. 
Relevant  to  our  finding  (Fig.  1)  is  the  observation  of  Izawa  et  al.  (2009)  who  found  that 
lactate  produced  by  Schwann  cells  may  be  a  fuel  for  DRG  neuronal  energy  metabolism. 


Fig.  1  Survivai  of  DRG  Neurons  after  24-hour  Exposure  to  Different  Giucose 


Concentrations. 


Fig.  2  Survival  of  DRG  Neurons  after  exposure  to  high  glucose  for  24  hours. 

(*p<0.05  compare  to  25  mM  of  glucose) 

Schwann  cells  usually  surround  DRG  neurons  in  vivo,  provide  them  with 
glycolytic  intermediates  (Miller  et  al.  2002)  and  protect  them  from  pathophysiological 
assaults.  Consistent  with  this  notion  is  our  observation  that  both  cell  types  survived 
better  in  co-culture  than  when  they  were  cultured  alone  (data  not  shown).  Furthermore, 
when  DRG  neurons  are  cultured  alone,  they  need  more  glucose  because  of  the 
absence  of  the  glycolytic  intermediates  normally  supplied  to  them  by  Schwann  cells 
(Miller  et  al.  2002).  Based  on  the  above  considerations  and  our  finding  that  DRG 
neurons  showed  optimal  survival  with  25  mM  glucose  (Figs.  1  and  2),  we  employed  25 
mM  of  glucose  as  a  control  parameter  when  DRG  neurons  and  Schwann  cells  are 
cultured  separately  and  5.5  mM  of  glucose  as  a  physiological  control  when  we  co¬ 
cultured  them. 

Exposure  of  neural  cells  to  high  glucose  increases  reactive  oxygen  species  (ROS) 
production,  a  by-product  of  glucose  metabolism  and  marker  of  diabetic  neuropathy 
(Vincent  et  al.  2005).  Consistent  with  this  notion  is  our  finding  that  ROS  production  by 
DRG  neurons  was  increased  whey  they  were  exposed  to  glucose  level  higher  than  25 


mM  (Fig.  3).  Clearly  the  mechanisms  underlying  the  increased  ROS  production  by  DRG 
neurons  in  high  glucose  merit  further  elucidation. 


Fig.  3  ROS  Production  by  DRG  Neurons  after  Exposures  to  High  Giucose 
Concentrations 


Glucose  treatment  (mM) 


Fig.  4  Changes  in  Glutathione  Level  in  Schwann  Cells  after  Exposure  to  High 
Glucose  for  24  hr  (*p<0.05  compare  to  25  mM  of  glucose) 

Because  glial  cells  in  brain  have  a  protective  role  on  neurons  (Dukhande  et  al. 

2006),  we  investigated  the  possibility  that  under  the  stress  of  exposure  to  high  glucose, 
Schwann  cells  may  produce  less  glutathione  (antioxidant)  thereby  decreasing  their 


ability  to  protect  DRG  neurons.  We  exposed  Schwann  cells  to  high  glucose  and 
measured  their  glutathione  content.  Consistent  with  this  hypothesis  is  our  finding  that 
exposure  to  high  glucose  induced  decreases  in  glutathione  in  Schwann  cells  compared 
to  their  levels  when  treated  with  25  mM  of  glucose  (Fig.  4). 

In  conclusion,  results  from  this  study  strongly  suggest  our  model  is  suitable  for 
systematic  investigation  of  mechanisms  underlying  pathophysiology  and  pathogenesis 
of  diabetic  neuropathy.  Thus,  these  results  (and  those  to  be  obtained  in  our  ongoing 
studies)  provide  additional  insights  into  cellular  and  molecular  mechanisms  relevant  to 
diabetic  neuropathy  and  as  such  may  be  implicated  not  only  in  this  disease  but  also  in 
other  chronic  diseases  such  as  Alzheimer’s  disease  and  Parkinson’s  disease. 
Acknowledgements: 

We  thank  Dr.  Ahmed  Hoke  (Johns  Hopkins  University  School  of  Medicine)  for  his 
generous  gift  of  DRG  neurons.  Our  study  was  supported,  in  part,  by  an  USAMRMC 
Project  Grant  (Contract  #W81XWH-07-2-0078),  and  NIH  Grant  #P20  RR016454  from 
the  Idaho  INBRE  Program  of  the  National  Center  for  Research  Resources. 

References: 

Apfel  SC.  2006.  Diabetic  neuropathy  models:  Are  they  relevant?  Drug  Discovery  Today: 
Disease  Models  3:  397-402. 

Brownlee  M.  2001.  Biochemistry  and  molecular  cell  biology  of  diabetic  complications. 
Nature  414:  813-820. 

Chen  W,  Mi  R,  Haughey  N,  Oz  M,  Hoke  A.  2007.  Immortalization  and  characterization 
of  a  nociceptive  dorsal  root  ganglion  sensory  neuronal  line.  Journal  of  the  Peripheral 
Nervous  System  12:  121-130. 


Dukhande  VV,  Malthankar-Phatak  GH,  Hugus  JJ,  Daniels  CK  &  Lai  JCK  2006. 
Manganese-Induced  Neurotoxicity  is  Differentially  Enhanced  by  Glutathione  Depletion 
in  Astrocytoma  and  Neuroblastoma  Cells.  Neurochemical  Research  31:  1349-1357. 
Figueroa-Romero  C,  Sadidi  M,  Feldman  E.  2008.  Mechanisms  of  disease:  The  oxidative 
stress  theory  of  diabetic  neuropathy.  Reviews  in  Endocrine  &  Metabolic  Disorders  9: 
301-314. 

Izawa  Y,  Takahashi  S,  Suzuki  N.  2009.  Pioglitazone  enhances  pyruvate  and  lactate 
oxidation  in  cultured  neurons  but  not  in  cultured  astroglia.  Brain  Research  1305:  64-73. 
Leinninger  GM,  Edwards  JL,  Upshaw  MJ,  Feldman  EL.  2006.  Mechanisms  of  Disease: 
mitochondria  as  new  therapeutic  targets  in  diabetic  neuropathy.  Nat  Clin  Pract  Neuro  2: 
620-628. 

Miller  KE,  Richards  BA,  Kriebel  RM.  2002.  Glutamine-,  glutamine  synthetase-, 
glutamate  dehydrogenase-  and  pyruvate  carboxylase-immunoreactivities  in  the  rat 
dorsal  root  ganglion  and  peripheral  nerve.  Brain  Research  945:  202-211. 

Sango  K,  Saito  H,  Takano  M,  Tokashiki  A,  Inoue  S,  Horie  H.  2006.  Cultured  Adult 
Animal  Neurons  and  Schwann  Cells  Give  Us  New  Insights  into  Diabetic  Neuropathy. 
Current  Diabetes  Reviews  2:  169-183. 

Vincent  AM,  McLean  LL,  Backus  C,  Feldman  EL.  2005.  Short-term  hyperglycemia 
produces  oxidative  damage  and  apoptosis  in  neurons.  FASEB  J  19(6):  638-640. 


Further  Elucidation  of  Neuroprotective  Properties  of  Astrocytoma  (Astrocytes-like) 
Ceiis 

Yin  Yin  Wendy  Wong\  Ashvin  R.  Jaiswal^,  Alok  Bhushan^,  Solomon  W.  Leung^,  and 
James  C.K.  Lai'^ 

Presenting  author:  Department  of  Biomedical  &  Pharmaceutical  Sciences,  College  of 
Pharmacy,  and  Biomedical  Research  Institute,  Idaho  State  University,  Pocatello,  ID 
83209,  USA 

^Department  of  Biomedical  &  Pharmaceutical  Sciences,  College  of  Pharmacy,  and 
Biomedical  Research  Institute,  Idaho  State  University,  Pocatello,  ID  83209,  USA 

^Department  of  Civil  and  Environmental  Engineering,  College  of  Engineering,  and 
Biomedical  Research  Institute,  Idaho  State  University,  Pocatello,  ID  83209,  USA 

"^Corresponding  author:  Department  of  Biomedical  and  Pharmaceutical  Sciences, 
College  of  Pharmacy,  and  Biomedical  Research  Institute,  Idaho  State  University, 
Pocatello,  ID  83209,  USA  Fax:  208-282-4305;  Tel:  208-282-2275;  email: 
lai@pharmacv.isu.edu 


1 


Further  Elucidation  of  Neuroprotective  Properties  of  Astrocytoma  (Astrocytes-like) 
Ceiis 

Abstract: 

Astrocytes  protect  neurons  against  various  assaults  although  the  underlying 
pathophysiological  and  molecular  mechanisms  are  poorly  understood.  Therefore,  we 
have  continued  to  develop  cell  models  in  vitro  to  further  investigate  the  putative 
neuroprotective  properties  of  astrocyte-like  astrocytoma  cells.  We  hypothesized  that 
different  stress  factors  can  elicit  and/or  enhance  the  neuroprotective  effects  of 
astrocytes  through  the  activation  of  astrocytic  survival  signaling  and  alteration  of 
astroglial  function.  Employing  cell  models  involving  astrocytes-like  U87  astrocytoma  and 
neurons-like  SK-N-SH  cells,  results  of  our  previous  and  ongoing  studies  suggest  that 
U87  cells  protect  SK-N-SH  cells  against  cytotoxicity  due  to  oxidative  stress.  Other 
ongoing  studies  target  the  putative  neuroprotective  effect(s)  of  U87  cells  due  to 
alterations  of  cell  signaling  and/or  other  astroglial  function(s).  Thus,  our  results  may 
have  implications  for  the  pathophysiology  of  neuroprotection. 

Keywords:  Astrocytes;  neuroprotection;  astroglial  function;  U87  astrocytes-like 
astrocytoma  cells;  SK-N-SH  neurons-like  neuroblastoma  cells 

Introduction: 

Astrocytes  (non-neuronal,  glial  cells)  in  the  brain  are  known  to  play  important 
roles  in  protecting  neurons  (nerve  cells)  against  various  assaults  although  the 
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underlying  mechanisms  are  incompletely  understood  (Sofroniew  et  al.  2010).  Well 
known  chronic  neurodegenerative  diseases,  such  as  Alzheimer’s  disease  (AD)  and 
Parkinson’s  disease  (PD),  are  correlated  with  neuronal  cell  death,  which  involves  many 
factors  alone  or  in  combination  (Przedborski  et  al.  2003).  Among  all  neurodegenerative 
diseases,  significant  attention  has  been  given  to  Alzheimer’s  disease  (AD),  following  by 
Parkinson’s  disease  (PD)  (Przedborski  et  al.  2003).  While  the  signs  and  symptoms  of 
AD  affect  such  patients’  quality  of  life,  the  conditions  that  lead  to  memory  loss  and  death 
of  neurons  in  this  disease  state  are  not  yet  defined.  AD  remains  one  of  the  top  ten 
leading  causes  of  death  in  the  elderly  population  in  the  United  States  and  it  is  referred 
as  the  progressive  and  irreversible  neurodegenerative  disorder  in  human  brain  (Chung, 
2009).  Current  therapy  predominantly  treats  AD  symptoms  and,  at  best,  helps  the 
disease  from  worsening  as  there  is  no  known  cure  available  for  AD.  Hence,  there  is  an 
urgent  need  to  better  understand  how  astrocytes  exert  their  protective  effects  on 
neurons.  Once  the  mechanisms  for  astrocyte-mediated  neuronal  protection  are 
elucidated,  one  can  design  treatment  strategies  to  prevent  the  occurrence  of 
accelerated  neuronal  loss  in  neurodegenerative  diseases  such  as  AD  and  PD. 

Our  project  seeks  to  examine  the  underlying  neuroprotective  properties  offered 
by  astrocytes  to  protect  neurons  employing  a  cell  model  system  in  vitro.  We  have 
therefore  developed  cell  model  systems  to  investigate  cytotoxic  and  inflammatory 
mechanisms  associated  with  induction  of  neuronal  cell  damage  and  cell  death 
(Malthankar  et  al.  2004,  Dukhande  et  al.  2006,  Wang  et  al.  2008).  We  have  previously 
shown  that  U87  astrocytoma  and  SK-N-SH  neuroblastoma  cells  constitute  good  model 
systems  for  astrocytes  and  neurons,  respectively,  in  vitro  because  of  their  close 
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functional  resemblance  to  normal  astrocytes  and  neurons  and  that  U87  cells  protect  SK- 
N-SH  cells  from  several  pathological  assaults  (Malthankar  et  al.  2004,  Dukhande  et  al. 
2006).  We  therefore  hypothesized  that  different  stress  factors  (e.g.  oxidative  stress  and 
nutrient  depletion)  can  elicit  and/or  enhance  the  neuroprotective  effects  of  astrocytes 
through  the  activation  of  astrocytic  signaling  and  alteration  of  astroglial  function.  In  this 
study,  we  have  investigated  this  hypothesis  further. 

Materials  and  Methods: 

Cell  culture 

The  human  astrocytoma  (U87)  and  neuroblastoma  (SK-N-SH)  cell  lines  were 
obtained  from  (ATCC;  Manassas,  VA,  USA)  and  cultured  in  Minimum  Essential  Medium 
(MEM)  supplemented  with  10%  (v/v)  fetal  bovine  serum  (Atlanta  Biologicals; 
Lawrenceville,  GA),  1%  (w/v)  sodium  pyruvate  (Sigma  Aldrich;  St  Louis,  MO),  0.292  g/L 
L-glutamine  (Sigma),  1.5g/L  sodium  bicarbonate  (Sigma)  and  1%  (v/v)  antimycotic 
(Atlanta  Biologicals).  Cells  were  maintained  at  37°C  and  5%  (v/v)  CO2  as  described 
previously  (Malthankar  et  al.  2004,  Dukhande  et  al.  2006). 

Treatment  of  U87  cells 

The  U87  cells  were  cultured  in  T-75  tissue  culture  flasks  until  ~50%  confluent  in 
20  ml  of  10%  FBS  MEM  medium.  Then  the  medium  was  discarded  and  changed  with 
20  ml  of  5%  FBS-MEM  medium  and  the  cells  incubated  for  24  hours.  After  that,  the 
medium  was  replaced  with  20  ml  of  medium  without  FBS  and  the  cells  incubated  for  an 
additional  24  hours.  Cells  were  treated  with  5mM  L-sulfoximine  buthionine  (BSO),  or 
20nM  pioglitazone  (PZ)  or  a  combination  of  both  frugs  at  the  same  concentrations.  At 
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the  end  of  another  24  hours  of  incubation,  the  media  were  first  removed  and  frozen  with 
liquid  nitrogen  immediately.  The  cells  were  collected  subsequently  and  both  cells  and 
media  collected  were  kept  at  -80°C  until  used  for  experiments. 

Cell  Survival  (MTT)  assay 

The  neuroprotective  properties  of  U87  cells  on  SK-N-SH  cells  were  determined  in 
different  combinations  of  regular  media  (RM)  and  conditioned  media  (CM)  collected 
from  U87  cells  cultured  (see  above)  with  RC/CM  ratios  of  100/0,  70/30,  50/50,  40/60, 
30/70,  and  0/100.  5000  SK-N-SH  cells  were  seeded  per  well  in  a  48-well  plate.  After 
48  hours  of  incubation  at  37°C,  50  pi  thiazolyl  blue  tetrazolium  bromide  (MTT)  (5  mg/ml 
in  PBS)  reagent  was  added  to  each  well.  The  medium  in  each  well  was  removed  after  4 
hours  at  37°C  and  the  purple  formazan  crystals  formed  were  solubilized  using  DMSO. 
Optical  densities  (OD)  of  the  contents  of  the  wells  were  read  in  a  plate  reader  at  570  nm; 
the  OD  corresponded  to  the  proportion  of  live  cells  in  each  well  (Dukhande  et  al.  2006). 
Western  Blot  Analysis 

Western  blot  analysis  was  used  to  assess  protein  expression  in  cell  lysates  to 
determine  the  effects  of  media,  BSO  and  PZ.  10%  SDS-PAGE  gel  electrophoresis  was 
performed  as  described  by  Dukhande  et  al.  (2006).  The  separated  proteins  were  probed 
with  anti-glutamine  synthetase  and  anti-glial  fibrillary  acidic  protein  antibodies  and  then 
visualized  using  chemiluminesence  detection  kit  with  (3-actin  as  the  loading  control. 
Statistical  Analysis  of  Data 

Statistical  significance  of  experimental  results  was  analyzed  with  one-way 
ANOVA  followed  by  Tukey’s  post-hoc  test  with  a  minimum  significance  level  set  at  p  < 
0.05  using  Kaleidagraph  4.0  software  package. 
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Results  and  Discussion: 


Being  a  selective  inhibitor  of  glutathione  (a  naturally-occurring  antioxidant) 
synthesis,  L-buthionine  sulfoximine  (BSO)  is  used  to  induce  oxidative  stress  in  cells. 
Pioglitazone  (PZ),  a  peroxisome  proliferator  activated  receptor  gamma  (PPARy)  agonist, 
is  used  to  block  the  inflammation  which  is  usually  unregulated  in  AD  (Yamagishi  2000, 
Syversen  et  al.  2009).  Consequently,  we  designed  studies  whereby  we  could  use  BSO 
and  PZ  to  further  elucidate  the  putative  protective  mechanism(s)  on  neurons-like  SK-N- 
SH  cells  derived  from  conditioned  media  in  which  astrocytes-like  U87  cells  had  been 
exposed  to  BSO  or  PZ  or  a  combination  of  both  drugs. 

Serum  depletion  and  drug  treatment  for  U87  cell  cultures  were  prepared  as 
shown  the  flow  chart  below  (Fig.  1).  U87  cells  cultured  in  medium  containing  10%  FBS 
were  used  as  control  (not  shown  in  Fig.  1).  Medium  containing  0%  FBS  were  defined 
as  serum  free  (SF)  medium. 


U-87  cells  in 
10%  FBS 
Medium 


r 


u-87  cells  in  SF 
Medium 


U-87  cells  in 
5%  FBS 
Medium 


I  I 


II  n  I II  III  I  Mu  II  III  I 
Medium  Medium 

+  BSO  H  +PZ 


U-87  cells  in  SF 
Medium 

+  BSO  +PZ 


Figure  1 .  Experimental  design  of  U87  cells  treated  with  BSO,  PZ  or  in  combination. 

Because  oxidative  and  other  environmental  stresses  can  induce  morphological 
and  function  changes/adaption  in  astrocytes  in  vivo  and  in  culture,  we  employed  light 
microscopy  (by  taking  photomicrographs  at  lOOx  magnification)  to  examine  the  effects 
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of  BSO  treatment  and  FBS  depletion  to  induce  oxidative  and  environmental  stress, 
respectively,  on  U87  cells  and  assess  the  effects  of  PZ  treatment  thereon. 
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'  : 
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Figure. 2  Treatment-induced  cellular  morphology  changes  in  U87  cells  (100X  magnification). 


In  Figure  2,  the  top  panel  of  photomicrographs  shows  U87  cells  cultured  in  10% 
FBS  medium  treated  with  or  without  drug  or  drug  combination  while  those  of  the  bottom 
panel  represents  U87  cells  cultured  in  serum-deprived  (SF)  medium  treated  with  or 
without  drug  or  drug  combination.  In  general,  the  photomicrographs  revealed  that 
treatment  with  SF  medium  induced  U87  cells  to  extend  multipolar  processes.  Moreover, 
treatment  of  U87  cells  with  or  without  drug  treatment  led  to  further  changes  in  cellular 
morphology  (e.g.,  extension  of  processes  and  shape  changes)  in  addition  to  that  noted 
in  the  U87  cells  cultured  in  SF  medium.  Clearly,  these  observations  raise  interesting 
mechanistic  questions  that  need  to  be  addressed  further:  we  were  able  to  address  two 
of  these  issues  (see  below)  while  others  are  beyond  the  scope  of  this  study. 

GFAP  is  an  established  marker  for  astrocytes:  its  altered  expression  is 
associated  with  changes  in  astroglial  morphology.  Thus,  we  employed  Western  blot  to 
determine  if  the  morphological  changes  in  U87  cells  exposed  to  SF  medium  with  and 
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without  BSO/PZ  treatment  were  also  associated  with  changes  in  glial  fibrillary  acid 
protein  (GFAP)  expression.  GFAP  expression  was  increased  when  U87  cells  were 
cultured  in  SF  medium  compared  to  those  cultured  in  10%  FBS  medium,  suggesting  a 
correlation  between  changes  its  expression  and  cellular  morphology  (data  not  shown). 

A  key  detoxification  enzyme  in  astrocytes,  glutamine  synthetase  (GS)  can 
detoxify  the  exitotoxins  glutamate  and  ammonia  and  its  expression  is  modulated  by 
changes  in  the  surroundings  of  astrocytes.  However,  employing  Western  blot  analysis 
we  found  little,  if  any,  changes  of  GS  expression  in  U87  cells  exposed  to  the  conditions 
employed  (data  not  shown). 

Growth  factors  and  neuronal  survival  enhancers  are  putatively  released  into  the 
medium  by  astrocytes  to  protect  their  surrounding  neurons.  To  further  investigate  this 
neuroprotective  mechanism,  we  collected  media  in  which  we  grew  U87  cells  under  the 
conditions  specified  in  Figure  1  above  and  assessed  their  ability  to  influence  survival  of 
SK-N-SH  cells  employing  the  MTT  cell  survival  assay  (Fig.  3).  Our  results  suggested 
that  exposure  of  SK-N-SH  cells  to  various  combinations  of  SF  media  allowed  them  to 
survive  better  than  when  cultured  in  10%  FBS  medium  (control  condition)  alone  (Fig.  3). 
Specifically,  we  found  that  exposure  to  PZ  enhanced  this  protective  effect,  even  under 
conditions  of  oxidative  stress. 

In  conclusion,  results  from  this  study  suggest  changes  in  cell  morphology  of 
astrocytes-like  U87  cells  in  various  environmental  conditions  (e.g.,  serum  deprivation  & 
oxidative  stress)  can  be  correlated  with  up-regulation  of  GFAP  in  U87  cells. 
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The  Effect  of  Different  Ratio  of  Regular  lledia  and  Conditioned  lledia  on 
SK-N-SH  cells  with  and  without  BSO,  PZ,  and  BSO  +  PZ  in  24  hrs 
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Figure  3.  Treatment  effects  on  SK-N-SH  cell  survival. 

Our  findings  also  suggest  that  conditioned  medium  has  the  ability  to  enhance  the 
survival  of  neurons-like  SK-N-SH  cells  and  PZ  treatment  modulates  this  effect.  Thus, 
our  results  provide  additional  evidence  that  our  cell  model  can  be  productively 
employed  to  further  elucidate  the  putative  neuroprotective  mechanisms  of  astrocytes. 
As  such  they  assume  pathophysiological  importance  in  neuronal  survival/death 
mechanisms  in  neurodegenerative  diseases  such  as  AD  and  PD.  Clearly,  this  is  an  area 
that  merits  further  study. 
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Differential  Cytotoxic  Effects  of  Magnesium  oxide  Nanoparticles  on  Cisplatin 

Sensitive  and  Cisplatin  Resistant  Leukemia  Cancer  Cells 

Abstract: 

Magnesium  oxide  (MgO)  has  many  applications  in  pharmaceutical,  cosmetic  and 
food  industry.  It  has  been  extensively  used  in  these  industries  for  decades.  Magnesium 
oxide  is  used  in  preparation  of  antacid,  laxatives  and  mineral  supplements.  It  is  also 
used  in  cosmetics  in  preparation  of  sunscreens,  toothpastes  and  dental  cements. 

Earlier  studies  from  our  laboratory  have  characterized  the  effects  of  different  metal 
oxide  nanoparticles  on  normal  fibroblast  cells  and  cancer  cells.  In  this  study,  we 
compared  the  cytotoxicity  of  magnesium  oxide  nanoparticles  on  murine  leukemia  cells 
(L1210)  and  cisplatin  resistant  sub  line  (L1210/DDP).  We  found  that  magnesium  oxide 
nanoparticles  exhibit  differential  cytotoxicity  in  L1210  and  L1210/DDP  leukemia  cells. 
Our  results  also  suggested  that  cisplatin  resistant  cancer  cells  were  cross  resistant  to 
MgO  nanoparticles.  These  findings  may  assume  pathophysiologic  importance  in 
elucidation  of  mechanisms  underlying  anti-cancer  drug  resistance  and  may  aid  future 
discovery  of  anti-cancer  drugs. 

Key  Words:  cancer,  resistance,  nanoparticles,  leukemia 

Introduction: 

Approaches  to  treat  cancers  include  surgery,  chemotherapy  and  radiation  therapy. 
Conventional  chemotherapeutic  agents  like  cisplatin,  methotrexate,  and  5-flurouracil  are 
used  extensively  in  the  treatment  of  a  variety  of  cancers.  One  major  reason  for  the 
failure  of  chemotherapy  is  resistance  to  primary  chemotherapeutic  agents  used  in 
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treatment  (Gottesman  et  al.  2002).  Certain  cancers,  which  develop  resistance  to 
primary  cancer  chemotherapeutic  agent(s),  also  develop  cross  resistance  to  other 
unrelated  chemotherapeutic  agents  (Bhushan  etal.  1999). 

Several  mechanisms  contribute  to  the  development  of  resistance  in  cancers.  Some 
of  the  mechanisms  include  increased  efflux  of  the  drug  out  of  the  cancer  cell,  decreased 
influx  of  into  the  cancer  cell,  and  increase  in  altered  cellular  targets  (Siddik  et  al.  2003, 
Liu  etal.  2009).  Other  studies  implicate  the  involvement  of  altered  cellular  signaling  in 
the  development  of  resistance  to  chemotherapy  in  cancer  cells. 

Overcoming  cancer  drug  resistance  is  a  major  hindrance  in  effective  use  of 
chemotherapeutic  drugs  to  treat  cancers.  Development  of  resistance  in  cancer  cells  is 
the  major  cause  of  failure  of  chemotherapy  in  treatment  of  cancer  (Giaccone  et  al. 

1996).  Better  understanding  of  the  drug  resistance  mechanisms  is  necessary  so  that 
novel  strategies  can  be  devised  for  more  effective  treatment  of  cancer.  In  this  study,  we 
use  a  novel  approach  to  target  resistance  in  cancer  by  using  metal-based 
nanomaterials. 

Metallic  nanoparticles  are  a  subtype  of  nanoparticles  which  comprise  of 
nanoparticles  made  from  metals  and  their  compounds  (e.g.,  titanium  dioxide,  zinc  oxide, 
MgO,  gold,  silver).  The  use  of  nanomaterials  provides  new  technology  and  approaches 
to  develop  drugs  for  treatment  of  diseases.  The  metallic  nanoparticles  differ  from  their 
bulk  counterparts  in  several  properties  like  magnetic,  surface  electric,  and  their  optical 
properties  owing  to  their  small  size.  These  properties  make  metallic  nanoparticles 
suitable  candidates  for  developing  treatment  therapies  and  diagnostic  and  imaging 
agents  (Bhattacharya  et  al.  2008). 
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Work  in  our  laboratory  emphasizes  the  biological  and  toxicological  effects  of 
nanomaterials.  Previous  studies  from  our  laboratory  have  examined  the  effects  of 
different  metallic  nanoparticles  on  neurotumor  cells  and  normal  human  fibroblasts.  We 
found  while  zinc  oxide  and  titanium  oxide  nanoparticles  induced  high  cytotoxicity  in 
normal  fibroblasts,  magnesium  oxide  nanoparticles  exhibited  comparatively  low 
cytotoxicity  on  these  cells  even  at  high  concentrations  (Lai  et  al.  2008).  Because  MgO 
nanoparticles  exhibited  low  cytotoxicity  on  normal  fibroblasts,  we  selected  them  to 
determine  if  they  could  be  used  to  overcome  drug  resistance  in  cisplatin  resistant 
leukemia  cancer  cells.  If  resistant  cells  are  susceptible  to  nanoparticles  in  influencing 
their  proliferation,  we  can  exploit  this  putative  effect  to  develop  novel  ways  to  overcome 
anti-cancer  drug  resistance. 

Materials  and  Methods:  MgO  nanopowder  (Sigma-Aldrich  Cat  no:  549649,  50  nm 
particle  size  nanopowder)  was  dispersed  in  100  ml  of  sterile  saline  in  a  sealed  conical 
flask  and  stirred  at  ambient  temperature  for  four  hours  prior  to  be  diluted  to  the  specified 
concentrations  for  treatment  of  cells.  McCoy’s  5A  medium  was  purchased  from  Sigma- 
Aldrich.  Mouse  polyclonal  antibodis  for  Akt  and  Erk,  respectively,  were  obtained  from 
Santa  Cruz  Biotechnology. 

Cells  and  Culture  Conditions:  LI 210  murine  leukemia  cells  were  purchased  from 
Sigma-Aldrich  and  maintained  under  sterile  conditions  at  37°C  and  5  %  CO2  in  McCoy’s 
5A  supplemented  with  10%  (v/v)  horse  serum.  The  L1210/DDP  murine  leukemia  cells 
were  obtained  as  a  subline  of  LI 210  cells  resistant  to  cisplatin  and  were  maintained 
under  sterile  conditions  at  37°C  and  5%  CO2  in  McCoy’s  5A  supplemented  with  10% 
(v/v)  fetal  bovine  serum. 
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Dose  Response  Assay:  L1210  and  L1210/DDP  cells  were  split  at  equal  density  in 
each  well  of  24-well  plates.  Cells  in  each  well  were  treated  with  specified  concentrations 
of  MgO  nanoparticles  (ranging  from  0.1  pg/ml  to  100  pg/ml)  for  72  hours  at  37°C.  After 
72  hours,  an  aliquot  was  used  for  counting  using  a  Z2  Beckman  coulter  counter. 
Western  Blot  Analysis:  LI 210  cells  were  treated  with  various  concentrations  of  MgO 
nanoparticles  (10,  25,  50,  or  100  pg/ml)  for  72  hours.  After  treating  the  cells  with  MgO 
nanoparticles,  cell  lysates  were  prepared  using  the  lysis  buffer  (1%  (v/v)  Triron  X-100, 
10  mM  Tris  base  pH  7.6,  5  mM  EDTA,  50  mM  sodium  chloride,  30  mM  sodium 
pyrophosphate,  50  mM  sofium  fluoride,  0.1%  (w/v)  sodium  azide,  50  mM  phenyl  methyl 
sulphonyl  fluoride,  0.5  mg/ml  aprotinin,  2.5  mg/ml  leupeptin,  and  100  mM  sodium 
orthovanadate  in  distilled  water,  pH  7.6).  BioRad  reagents  (Bradford  assay)  were  used 
to  determine  the  protein  concentration.  25  pg  of  protein  sample  was  loaded  onto  the 
wells  in  the  sodium  dodecyl  sulphate  polyacrylamide  gel.  The  proteins  separated  by  gel 
electrolysis  were  transferred  to  polyvinylidene  fluoride  membrane  (PVDF),  blocked  (5% 
(w/v)  Tris  buffered  saline  with  0.01%  (v/v)  Tween  or  TBST  in  no-fat  powdered  milk). 
After  washing,  the  blots  were  incubated  in  1:500  primary  antibody  solution  prepared  in 
5%  bovine  serum  albumin  (BSA)  in  distilled  water.  Membranes  were  washed  and 
treated  with  the  secondary  antibody  and  developed  using  chemiluminescence  kit 
(Pierce  biotechnology,  Rockford,  Illinois),  as  recommended  by  the  manufacturer.  The 
blots  were  analyzed  for  the  levels  of  Akt,  pAkt,  Erk  and  pErk.  The  scans  were  digitized 
suing  Unscan-it-gel  6.1  software 
Results: 
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Dose  Response  Studies:  L1210  and  L1210/DDP  cells  were  treated  with  different 
concentrations  of  magnesium  oxide  nanoparticles  for  72  hours.  The  dose  response 
studies  were  performed  following  the  procedure  described  above. 


L1210/DDP  treated  with  MgO  nanoparticles 


Control  0.1  5  25  50  100 

Concentration  of  MgO  nanoparticles  in  pg/ml 


■  L1210/DDP 
treated  with 
MgO 

nanoparticles 


Figure  1 :  Dose  response  assay  of  L1210/DDP  cells  treated  with  MgO  nanoparticles 
after  72  hours. 


The  results  revealed  that  at  the  concentrations  employed,  MgO  nanoparticles  did  not 
exert  any  cytotoxic  effect  on  L1210/DDP  cells  after  72  hours  treatment  (Figure  1).  By 
contrast,  MgO  nanoparticles  did  exert  some  cytotoxic  effects  on  L1210  cells  after  72 
hours  treatment  (Figure  2).  When  the  effects  of  MgO  nanoparticles  on  the  two  cell  lines 
were  compared  (Figure  3),  it  was  evident  that  the  resistant  L1210/DDP  cells  was  not 
susceptible  to  the  cytotoxicity  of  the  nanoparticles  at  the  concentrations  used  while  the 
sensitive  L1210  cells  showed  dose-related  decrease  in  survival  upon  treatment  with  the 
nanoparticles. 
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L1210  treated  with  IVIgO  nanoparticles 


Figure  2:  Dose  response  assay  of  L1210  cells  treated  with  MgO  nanoparticles 
after  72  hours. 


LlZlOand  L1210/DDP  ccells  treated  with  MgO  nanoparticles 


QJ 

U 

> 

TO 

^  I 

Q. 


•L1210/DDP 


■L1210 


Control  0.1  5  25  50  100 

Concentration  of  MgO  nanoparticles  in  pg/ml 

Figure  3:  Dose  response  assays  of  L1210  and  L1210/DDP  cells  after  72  hours  treatment. 


Akt  and  Erk  expression:  We  performed  western  blot  analysis  to  assess  the  change  in 
expression  of  cell  signaling  elements  like  Akt,  pAkt,  Erk  and  pErk  in  L1210  cells  after 
MgO  nanoparticles  treatment  using  a  procedure  described  above.  Our  results  showed 
that  the  expression  of  pAkt  and  pErk  in  these  cells  decreases  when  treated  with 
increasing  concentrations  of  MgO  nanoparticles  (Figure  4). 
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Figure  4:  Western  Blot  Analysis  of  the  effect  of  MgO  nanoparticels  on  expression  of  AKT, 
pAKT,  Erk  and  pErk  in  L1210  cells.  In  the  above  figure  1,2,3,4  and  5  represent  the 
protein  expression  levels  at  control,  10  pg/ml,  25  pg/ml,  50  pg/ml  and  100  pg/ml 
treatment  of  MgO  nanoparticles. 

In  future  we  will  examine  the  effects  of  these  nanoparticles  on  expression  of 
other  cell  signaling  proteins  like  multiple  drug  resistance  associated  protein. 
Discussion:  The  major  reason  for  the  failure  of  cancer  chemotherapy  is  the 
development  of  resistance  to  chemotherapy  in  cancer  cells.  Few  drug  resistance 
mechanisms  for  cisplatin,  which  contribute  to  cisplatin  resistance,  include  increase  in 
intracellular  glutathione,  increase  in  MRP  protein  expression,  and  increase  in  DNA 
repair  mechanisms.  Despite  these  suggested  mechanisms,  a  definitive  mechanism  for 
cisplatin  drug  resistance  remains  to  be  demonstrated.  In  our  laboratory,  we  are 
developing  a  novel  approach  towards  using  metal-based  nanoparticles  in  overcoming 
cancer  drug  resistance. 

Although  magnesium  oxide  nanoparticles  did  not  overcome  drug  resistance  in 
L1210/DDP  cells,  our  results  from  the  dose-response  studies  showed  that  the  cisplatin 
resistant  L1210/DDP  leukemia  cancer  cells  are  cross  resistant  to  MgO  nanoparticles. 
We  also  observe  that  cisplatin  sensitive  leukemia  cells  are  sensitive  to  MgO 
nanoparticles.  These  observations  suggest  that  L1210/DDP  may  have  similar 
mechanisms  of  drug  resistance  for  cisplatin  and  for  MgO  nanoparticles. 
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Altered  expression  of  signal  transduction  pathways  are  known  to  play  a  role  in 
drug  resistance.  Our  analysis  of  cell  signaling  proteins  like  Akt,  pAkt,  Erk  and  pErk  by 
western  blot  analysis  showed  that  the  MgO  nanoparticles  decreased  the  expression  of 
phosphorylated  forms  of  Akt  and  Erk  in  the  sensitive  cell  line.  The  decrease  in  the  levels 
of  phosphorylated  forms  of  Akt  and  Erk  with  increasing  concentrations  of  MgO 
nanoparticles  in  L1210  cells  is  highly  suggestive  of  down-regulation  of  pathways  leading 
to  cellular  proliferation  and  other  processes  critical  for  cancer  progression.  Clearly,  this 
is  an  important  area  that  merits  further  investigation. 
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Abstract  Use  of  nanoparticles  in  cancer  diagnosis,  detection,  and  therapy  is  rapidly  gaining 
impetus.  This  review  focuses  on  the  recent  advances  in  the  applications  of  metallic  nanoparticles 
in  cancer  imaging  and  therapy.  In  particular,  we  discuss  the  uses  of  iron  oxide  nanoparticles, 
gadolinium-based  nanoparticles,  and  multimodal  metallic  nanoparticles  in  cancer  imaging  and 
detection.  Subsequently,  we  discuss  the  applications  of  several  types  of  cancer  therapies  based 
on  the  use  of  metallic  nanoparticles.  The  latter  applications  include:  metallic  nanoparticles  in 
photodynamic  therapy,  in  hyperthermia  therapy,  and  in  neutron  capture  therapy  as  well  as 
surface-modified  metallic  nanoparticles  in  cancer  therapy.  Despite  the  possibility  that  advances 
in  biomedical  applications  of  such  nanoparticles  may  ultimately  lessen  the  suffering  of  cancer 
patients  and  improve  their  prospects  for  survival,  we  raise  a  strong  note  of  caution  regarding  the 
safety  of  clinical  use  of  metallic  nanoparticles  because  of  their  putative  or  demonstrated  toxicity. 


Key  Words:  Metallic  nanoparticles;  cancer  imaging;  cancer  therapy 

1.  Introduction 

The  diverse  applications  of  nanotechnology  in  biomedical  research  and  development  have 
escalated  exponentially  in  the  last  decade.  This  generalization  is  particularly  pertinent  when  one 
considers  the  use  of  nanomaterials  in  the  development  of  targeted  drug  delivery  systems  [1].  In 
light  of  growing  interests  in  this  and  related  areas,  this  review  aims  to  highlight  and  discuss  the 
recent  and  current  advances  of  applications  of  one  class  of  nanoparticles,  namely  metallic 
nanoparticles,  in  cancer  imaging  and  therapy. 
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2.  Applications  of  Metallic  Nanoparticles  in  Cancer  Imaging 

Although  various  other  techniques  (e.g.,  X-ray  imaging,  CT-Scans,  ultrasound  imaging)  exist, 
this  review  focuses  on  the  current  use  of  metallic  nanoparticles  (including  iron  oxide 
nanoparticles  such  as  nanoparticles  of  super  paramagnetic  iron  oxides  (SPIO)  and  ultrasmall 
superparamagnetic  iron  oxides  (USPIO),  gadolinium  nanoparticles,  and  manganese 
nanoparticles)  in  magnetic  resonance  imaging  (MRI)  in  the  detection  and  staging  of  cancer  [2], 

2.1  Iron  Oxide  Nanoparticles 

Two  subtypes  of  iron  oxide  nanoparticles  are  employed  in  the  MRI  applications  —  colloidal  iron 
oxide  nanoparticles  and  USPIO. 

Colloidal  Iron  Oxide  Nanoparticles 

Colloidal  iron  oxides,  also  called  superparamagnetic  iron  oxide  (SPIO)  nanoparticles  constitute 
the  first  generation  iron  oxide  nanoparticles  and  are  comprised  of  colloidal  iron  oxides.  Prepared 
by  one-step  alkaline  precipitation  of  iron  oxides  (average  size  ~75  nm),  they  are  stabilized  by 
addition  of  polymers  [3,  4]. 

Blood  half  life  of  SPIO  nanoparticles  is  short  because  they  are  rapidly  phagocytozed  by 
mononuclear  phagocyte  system  (MPS),  leading  to  their  accumulation  in  normal  tissues  but  not  in 
tumors  [5].  This  differential  localization  of  phagocytozed  SPIO  nanoparticles  facilitates  the 
noninvasive  and  easy  detection  of  tumors  in  the  body  by  MRI. 

SPIO  nanoparticles  have  been  successfully  administered  orally  for  imaging  of  the 
gastrointestinal  tract  [6].  Ferumoxsil  (Lumirem)  (i.e.,  SPIO  nanoparticles  coated  with  silicone)  is 
approved  for  detecting  cancer  metastasis  to  the  liver  [7].  SPIO  nanoparticles-enhanced  MRI  is 
superior  to  helical  CT  to  detect  liver  metastases  in  candidates  for  hepatic  resection  [8]  and 
superior  to  ultrasound  and  CT  in  detecting  focal  hepatic  lesions  and  suspected  cancer  lesions  [9]. 
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Additionally,  SPIO  nanoparticles-enhanced  MRI  scans  proved  to  be  beneficial  in  planning 
surgeries  of  squamous  cell  carcinoma  of  head  and  neck  [10]. 

Ferucorbotran  (Resovist),  another  SPIO  formulation,  is  currently  under  Phase  III  clinical  trials  in 
USA  for  detection  of  liver  neoplasms.  Ferumoxide  (Endorem,  Feridex)  is  an  FDA-approved  MRI 
contrasting  agent  for  detection  of  neoplastic  lesions  in  liver  neoplasms. 

Ultrasmall  Superparamagnetic  Iron  Oxide  (USPIO)  Nanoparticles 

The  second  generation  iron  oxide  nanoparticles,  USPIO  nanoparticles  are  smaller  in  size  (<50 
nm):  consequently,  their  circulating  half  life  is  increased,  thereby  enabling  them  to  permeate 
through  the  vascular  endothelium  and  reach  the  interstitium  and  the  lymph  nodes  [11].  In  the 
lymph  nodes,  USPIO  nanoparticles  are  rapidly  phagocytosed  by  lymphocytes:  their  differential 
accumulation  in  lymph  nodes  gives  rise  to  a  contrast  in  the  imaging  of  normal  versus  metastatic 
lymph  tissues  using  MRI. 

Staging  of  cancer  is  essential  for  planning  its  treatment.  In  contrast  to  the  current  less  precise 
techniques  of  CT  and  ultrasound,  MRI  using  ferumoxtran-10  can  identify  the  spread  of  cancer  to 
lymph  nodes  with  better  sensitivity  and  specificity  [12].  MRI  using  USPIO  nanoparticles  helps 
identify  patients  requiring  salvage  radiation  therapy  after  prostatectomy  [13].  USPIO 
nanoparticles  (i.e.,  ferumoxytol-10)-enhanced  MRI  potentially  can  detect  brain  tumors  [14]. 

2.2  Gadolinium 

For  some  time,  gadolinium  chelates  have  been  used  as  a  MRI  contrast  agent  [15].  Recently 
gadolinium-based  nanparticles  have  been  introduced  into  these  MRI  applications.  Gadolinium 
oxide  nanoparticles  with  fluorescence  probes  have  been  synthesized  for  use  as  contrast  agents  for 
MRI  and  fluorescence  imaging  [16].  Silica  nanoparticles  loaded  with  gadolinium  have  been  used 
to  detect  nasopharyngeal  cancer  in  nude  mice  [17].  Gadolinium  dendrimers  are  being  researched 
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for  their  efficiency  as  MRI  contrast  agents:  the  efficiency  of  gadolinium  delivery  depends  upon 
the  type  of  dendrimer  used.  Comparative  study  of  gadolinium  delivery  to  lymph  nodes  using 
polyamidoamine  (PM  AM)  and  diaminobutane  (DAB)  dendrimers  showed  that  PM  AM 
dendrimers  were  the  more  efficient  in  delivering  gadolinium  to  the  lymph  nodes  [18],  thereby 
demonstrating  their  potential  use  in  detecting  lymph  node  involvement  of  tumors  by  MRI 
imaging  [19].  However,  the  drawback  associated  with  the  use  of  PM  AM  dendrimers  labeled  with 
gadolinium  is  the  intrinsic  toxicity  associated  with  PM  AM  and  gadolinium  [20,  21]. 

2.3  Multimodal  Metallic  Nanoparticles 

Multi-modal  imaging  is  sensitive,  specific  and  yields  more  information  than  single-probe 
imaging.  Multimodal  metallic  nanoparticles  consist  of  magnetic  nanoparticles  as  the  core  to 
which  different  functional  moieties  are  tagged.  The  functional  moieties  can  be  fluorescence 
probes  for  fluorescence  image  analysis,  antibodies  for  targeting  a  particular  group  of  cells,  or 
biomarker  and  radionucleotides  for  PET  imaging  [22].  For  example,  polysialic  acid  (PSA)  is  a 
cancer  biomarker  for  neuroblastoma.  HmenBl  antibody  tagged  with  magnetic  iron  oxide 
nanoparticles  having  a  dye  doped  silica  core  (for  fluorescence  imaging)  can  target  PSA,  thereby 
facilitating  the  detection  of  neuroblastoma  in  rats  [23].  Similarly,  iron  oxide  nanoparticles  tagged 
with  a  fluorescence  probe  have  been  investigated  for  breast  cancer  detection  in  nude  mice  [24]. 

It  is  important  to  note  that  the  current  research  trend  on  applications  of  metallic  nanoparticles  in 
cancer  imaging  strongly  suggests  that  such  applications  can  be  coupled  to  or  employed  in 
conjunction  with  applications  of  metallic  nanoparticles  in  cancer  therapy. 

3.  Application  of  Metallic  Nanoparticles  in  Cancer  Therapy 

Conventional  cancer  therapies  include  chemotherapy,  radiation  therapy,  and  surgery.  These 

therapies  have  limitations  that  decrease  their  efficacy:  anti-cancer  drugs  exhibit  adverse  effects 
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on  normal  cells  and  cross-resistance  to  other  anti-cancer  drugs  [25]  and  radiation  therapy  also 
show  deleterious  side  effects  [26].  Thus,  improved  cancer  therapies  are  needed.  Metallic 
nanoparticles  have  demonstrated  potential  in  several  experimental  cancer  therapies,  including 
photodynamic  therapy  (PDT),  hyperthermia  therapy  (HT),  neutron  capture  therapy  (NCT),  and 
surface-modified  metallic  nanoparticles  for  drug  delivery  or  anti-proliferative  activity  [27]. 

3.1  Metallic  Nanoparticles  in  Photodynamic  Therapy 

Photodynamic  therapy  (PDT)  generally  exploits  a  photosensitive  compound  that  is  subsequently 
activated  using  an  external  light  source  to  kill  the  cancer  cells  [28].  When  photons  from  the  light 
source  are  incident  upon  the  photosensitive  material,  the  photosensitive  drug  is  excited  and 
produces  reactive  oxygen  species  that  damage  the  cancer  cells.  Choice  of  the  photosensitive 
compound  depends  upon  the  location  of  the  tumor  in  the  body  [29,30]. 

Gold  nanoparticles  conjugated  with  epidermal  growth  factor  receptor  (EGFR)  antibodies  can 
induce  cancer  cell  death  after  irradiation  with  light  in  the  near-infrared  (NIR)  range.  The 
conjugation  of  anti-EGFR  antibodies  to  spherical  gold  nanoparticles  facilitates  their  selective 
accumulation  in  cancer  cells  that  over-express  EGFR  receptors  [30].  The  temperatures  achieved 
upon  NIR  irradiation  of  gold  nanoparticles  in  vitro  were  IQp  -  80*^  C  [31]. 

A  comparison  of  the  photothermal  destruction  of  malignant  cancer  cells  using  gold  nanoparticles 
with  different  surface  dimensions  and  core  material  revealed  that  the  efficiency  of  gold 
nanoparticles  was  dependent  on  the  photothermal  conversion  efficiency  and  dimensions  of 
nanoparticles  [32].  Moreover,  gold  nanoshells  can  be  used  effectively  for  photodynamic  therapy 
in  cancer  [33]  and  Au-Ag  nanorods  functionalized  with  aptamer  exhibit  specificity  of  these 
nanorods  and  their  use  for  PDT  in  treating  cancer  [34]. 
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The  advantages  of  PDT  include:  1)  it  is  a  noninvasive  technique  for  killing  cancer  cells;  2)  it 
induces  tumor  regression  prior  to  surgery;  and  3)  it  can  target  tumors  located  at  inoperable  areas 
(e.g.,  trachea).  The  main  disadvantages  of  PDT  therapy  include,  but  are  not  limited  to:  1)  it  uses 
near-IR  light  of  limited  power;  2)  it  does  not  penetrate  more  than  1  cm  deep  into  the  tissue;  and 
3)  PDT  therapy  induces  reddening  or  inflammation  of  the  target  tissue. 

3.2  Metallic  nanoparticles  in  Hyperthermia  Therapy 

Hyperthermia  therapy  (HT)  is  effected  by  exposing  the  cancerous  tissues  to  high  temperatures  of 
up  to  42-43°C  leading  to  damage  or  killing  of  cancer  cells.  Unlike  PDT,  where  a  light  source  is 
used  to  induce  rise  in  target  temperatures,  HT  utilizes  radiofrequency,  ultrasound,  or  microwave 
for  raising  the  target  temperatures  [35].  HT  is  a  conjugate  therapy  employed  when  the  tumors  are 
nonresponsive  to  chemotherapy  and  radiation  therapy. 

Conventional  HT  employing  heating  sources  like  microwave,  radiofrequency  or  ultrasound  is 
non-specific  [36].  Metallic  nanoparticles  can  help  overcome  this  drawback:  thus,  the  use  of 
magnetic  nanoparticles  in  HT  was  proposed  [37].  Therapeutic  potentials  of  iron  oxide 
nanoparticulate  formulations  are  being  actively  assessed  in  HT  [38]. 

Use  of  magnetic  iron  oxide  nanoparticles  for  HT  is  called  “Magnetic  Fluid  Hyperthermia” 
(MFH)  [39].  When  iron  oxide  nanoparticles  (dimensions  <  10  nm)  are  subjected  to  an  alternating 
external  magnetic  field,  the  heat  so  generated  ultimately  damages  cancer  cells.  An  in  vitro  and  in 
vivo  study  demonstrated  this  MFH  effect  of  Fe203  nanoparticles  in  cultured  liver  cancer  cells  and 
in  xenograph  liver  cancers  [40].  Similarly,  MFH  effect  of  dextran  coated  iron  oxide  and  that  of 
silane-coated  nanoparticles  were  studied  in  normal  and  cancerous  human  cells  in  vitro:  the 
consequent  hyperthermia  induced  cytotoxicity  in  cancer  cells  [41].  Furthermore,  conjugating 
iron  oxide  nanoparticles  with  folate,  which  binds  to  its  receptors  expressed  by  cancer  cells,  is 
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effective  in  inducing  hyperthermia  within  the  cancer  cells  [42],  MFH  effect  of  Fe203,  in 
combination  with  arsenic  trioxide,  was  noted  in  human  cervical  cancer  cells  [43]  and  Au 
nanoparticles  produced  marked  hyperthermia  in  gastrointestinal  cancer  cells  in  vitro  [44], 

Despite  their  utility  in  inducing  hyperthermia,  a  major  drawback  of  this  application  is  that  the 
temperature  generated  thus  inside  cells  is  difficult  to  control.  A  new  class  of  magnetic 
nanoparticles,  manganite  perovskites  show  promise  to  overcome  this  limitation.  The  curie 
temperatures  (42*^-  43‘^C)  of  silver-doped  manganite  pervoskites  enable  isothermal  heating  [45]. 
3.3  Metallic  Nanoparticles  in  Neutron  Capture  Therapy 

Neutron  capture  therapy  utilizes  a  stable  nuclide  delivered  to  the  tumor  cells.  Upon  irradiation 
with  neutrons,  the  stable  nucleus  produces  ionizing  radiations  [46].  Boron  Neutron  capture 
therapy  (BNCT)  is  a  form  of  radiotherapy  which  utilizes  neutron  beam  and  boron-10:  irradiation 
with  neutron  rays  induces  boron  to  form  lithium  and  alpha  rays.  Although  BNCT  using  boron- 10 
was  investigated  for  treating  glioblastoma  multiforme  [47],  progress  of  BCNT  in  cancer 
treatment  has  been  slow  because  few  tumor-selective  boron-containing  drugs  exist  and  the 
neutron  beams  employed  are  of  the  low-energy  type  [48,  49]. 

Use  of  gadolinium  for  NCT  was  recognized  over  two  decades  ago.  Gadolinium  emits  gamma 
rays  when  irradiated  with  neutrons  [50].  Currently,  gadolinium  nanoparticles  (Gd-NP)  are  being 
invesgated  for  their  application  in  NCT  [51].  A  comparison  of  Gd-NP  and  gadolinium  solution 
revealed  that  Gd-NP  showed  significant  accumulation  and  tumor  growth  suppression  in  cancer 
cells  as  compared  to  gadolinium  solution  [52].  Gd-NP  can  also  target  cancer  cells  by  attaching  to 
Gd-NP  ligands  or  antibodies  specific  to  the  cancer  cells.  By  attaching  folate  to  the  surface  of  Gd- 
NP,  the  uptake  of  Gd-NP  into  cancer  cells  in  vitro  and  in  vivo  is  enhanced  [46,  53]. 
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3.4  Surface-modified  metallic  nanoparticles  in  cancer  therapy 

Another  type  of  application  of  metallic  nanoparticles  in  cancer  therapy  exploits  the  intrinsic 
properties  of  the  nanoparticles.  That  silver  has  been  extensively  commercialized  in  applications 
as  anti-microbial  agents  [54]  prompted  investigations  of  anti-proliferative  effect  of  silver 
nanoparticles  on  human  glioblastoma  cells  [55].  Though  the  underlying  mechanisms  are 
incompletely  understood,  some  researchers  believe  this  anti-proliferative  effect  is  attributable  to 
oxidative  stress  induced  by  Ag  nanoparticles  [56].  Radioactive  gold  nanoparticles  coated  with 
gum  arabica  glycoprotein  show  promising  results  in  targeting  and  treating  prostate  cancer:  the 
nanoparticles  passed  through  tumor  vasculature  to  induce  decrease  in  tumor  volume  [57]. 

One  adverse  effect  of  radiation  therapy  is  its  deleterious  effects  on  normal  cells.  Cerium  oxide 
nanoparticles  have  demonstrated  selective  radio-protective  effect  on  normal  cells  [58].  For 
example,  UV  exposure  of  normal  and  tumor  breast  cells  pretreated  with  cerium  oxide 
nanoparticles  induced  more  deaths  in  cancer  cells  compared  to  normal  cells.  Although  the  radio 
protective  effect  of  nanoceria  in  normal  cells  is  not  understood,  some  researchers  hypothesize 
this  effect  is  due  to  superoxide  dismutase  enzyme  mimetic  activity  of  nanoceria  [59]. 

Gadolium  endohederal  metallofullerenol  nanoparticles  have  exhibited  high  anti-tumor  activity  in 
mice  bearing  liver  tumors  [60].  Gadolinium  endohederal  metallofullerenol  nanoparticles  owe 
their  anti -tumor  activity  to  their  ability  to  scavenger  reactive  oxygen  species  [61,  62].  Metallic 
nanoparticles  of  motexafin  gadolinium  also  have  similar  antioxidant  properties.  Clinical  studies 
have  indicated  that  they  can  prevent  metastasis  of  cancer  to  brain  when  administered  to  patients 
in  early  stages  of  non-small  cell  lung  cancer  (NSCLC)  [63,  64]. 

Metallic  nanoparticles  have  improved  the  delivery  of  chemotherapeutic  drugs,  specifically  at  the 
tumor  site.  Metallic  nanoparticles  like  iron  oxide  nanoparticles  which  have  magnetic  properties 
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can  be  targeted  to  the  tumor  site  under  the  influence  of  external  magnetic  field  [65].  For 
example,  employing  iron  oxide  nanoparticles  as  carriers  for  chemotherapeutic  drugs  such  as 
doxorubicin  and  camptothecan  resulted  in  improved  therapeutic  efficacy  of  these  drugs  in 
decreasing  tumor  size  in  rat  cancer  xenograft  model  [66]. 

4.  Conclusions  and  Future  Directions 

The  current  rapid  and  explosive  advances  of  nanotechnology  herald  a  new  age  in  cancer 
diagnosis  and  therapy.  In  this  review,  we  have  only  highlighted  the  seminal  roles  of  metallic 
nanoparticles  in  cancer  imaging  and  therapy.  Clearly  one  should  appreciate  the  advances  we 
have  discussed  above  constitute  only  a  small  fraction  of  the  applications  of  nanotechnology  in 
cancer  imaging  and  therapy.  However,  limitation  of  space  does  not  allow  us  to  even  mention 
other  important  advances  unrelated  to  the  use  of  metallic  nanoparticles. 

Although  mortality  rates  due  to  cancer  have  shown  decreases  in  the  recent  two  decades,  cancer  is 
still  the  leading  cause  of  disease-related  deaths  in  USA.  The  advances  in  development  of  newer 
cancer  imaging  and  therapies  based  on  metallic  nanoparticles  may  help  in  early  detection  of 
cancer  and  thus  contribute  to  decreasing  deaths  due  to  cancer.  Various  cancer  imaging  and 
therapies  based  on  use  of  metallic  nanoparticles  are  at  different  stages  of  preclinical  and  clinical 
development.  Iron  oxide  nanoparticles,  zinc  oxide  nanoparticles,  gold  nanoparticles,  silver 
nanoparticles,  and  cerium  oxide  nanoparticles  have  tremendous  potentials  to  be  developed  as 
novel  diagnostic  and  therapeutic  agents  in  cancer. 

Enhanced  cancer  biomarker  and  genetic  mutation  detection  techniques  would  help  in  identifying 
individuals  at  high  risk  for  developing  cancer.  In  this  context,  multi-functional  metallic 
nanoparticles  show  exciting  therapeutic  potentials  and  these  are  currently  under  development  for 
cancer  therapy  to  be  clinically  applied  in  the  near  future.  Metallic  nanoparticles  can  be 
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engineered  to  enhance  the  efficacy  of  current  diagnostic  and  imaging  techniques  in  cancer. 
Furthermore,  cancer  therapies  utilizing  metallic  nanoparticles  as  targeting  vehicles  for  drug 
delivery,  and  other  allied  therapies  using  metallic  nanoparticles  would  also  play  key  roles  in 
clinical  management  of  cancer  in  the  next  decade. 

Understandably,  the  advances  of  the  biomedical  applications  of  metallic  nanoparticles  discussed 
above  strongly  suggest  that  the  clinical  applications  of  such  nanoparticles  may  ultimately  lessen 
the  suffering  of  cancer  patients  and  improve  their  prospects  for  survival.  Nevertheless,  we  cannot 
help  but  inject  a  strong  note  of  caution  here.  As  the  ubiquitous  and  diverse  applications  of 
nanotechnology  have  become  almost  uncontrollable  phenomena,  humans  are  increasing  exposed 
to  nanoparticles  and  other  nanomaterials  although  the  health  effects  and  environmental  impact  of 
their  exposure  have  not  been  systematically  assessed  and  are  therefore  largely  unknown  [67]. 
Moreover,  recent  advances  in  understanding  the  putative  toxicity  of  nanoparticles  and  other 
nanomaterials  [67-72]  indicate  that  in  developing  metallic  nanoparticles  for  cancer  imaging  and 
therapy,  one  needs  to  consider,  and  fully  investigate  in  parallel,  the  putative  toxicity  of  such 
nanoparticles  prior  to  even  adopting  them  for  pre-clinical  trial. 

References 

1.  Arruebo  M,  Fernandez -Pacheco  R,  Ibarra  MR,  Santamaria  J.  Magnetic  nanoparticles  for  drug 
delivery.  Nanotoday  2007;3:22-32. 

2.  Bonnemain  B.  Superparamagnetic  agents  in  magnetic  resonanceimaging:  physicochemical 
characteristics  and  clinical  applications.  J  Drug  Target  1998;  6:167-174. 

3.  Qiu  J,  Yang  R,  Li  M,  Jiang.  Preparation  and  characterization  of  porous  ultrafine 
Fe203  particles.  N  Mater  Res  Bull  2005;  40:1968-1975. 


11 


4.  Babes  L,  Denizot  B,  Tanguy  G,  Le  Jeune  JJ,  Jallet  P.  Synthesis  of  Iron  Oxide  Nanoparticles 
Used  as  MRI  Contrast  Agents:  A  Parametric  Study.  J  Colloid  Interface  Sci  1999;212:474-482. 

5.  Pouliquen  D,  Le  Jeune,  JJ,  Perdrisot  R,  Ermias  A,  Jallet  P.  Iron  oxide  nanoparticles  for  use  as 
an  MRI  contrast  agent:  pharmacokinetics  and  metabolism.  Magn  Reson  Imaging  1991;  9:  275- 
255. 

6.  Rubin  D.L.,  Muller  HH,  Young  SW,  Hunke  WA,  Gorman  WG.  Optimization  of  an  oral 
gastrointestinal  contrast  agent  for  magnetic  resonance  imaging.  Invest  Radiol  1994;29:  81-86. 

7.  Kubaska  S,  Sahani  DV,  Hahn  PF,  Halpem  E.  Dual  contrast  enhanced  magnetic  resonance 
imaging  of  liver  with  superparamagnetic  iron  oxide  followed  by  gadolinium  for  lesion  detection 
and  characterization.  Clin  Radiol  2001;56:410-415. 

8.  Ward  J,  Robinson  PJ,  Guthrie,  JA,  Downing  S,  Wilson  D.  Liver  metastases  in  candidates  for 
hepatic  recesction:  comparison  of  helical  CT  and  gadolinium-  and  SPIOs  -  enhanced  MR 
imaging.  Radiol  2005;237:170-180. 

9.  Shah  AJ,  Parsons  B,  Pope  I,  Callaway  M,  Finch-Jones  MD,  Thomas  MG.  The  clinical  impoact 
of  magnetic  resonance  imaging  in  diagnosing  focal  hepatic  lesions  and  suspected  cancer.  Clin 
Imaging  2009;33:209-212. 

10.  Mack  MG,  Balzer  JO,  Straub  R,  Eichler  K,  Vogl  TJ,  Superparamagnetic  iron  oxide  enhanced 
MR  imaging  of  head  and  neck  lymphnodes.  Radiology  2002;222:239-244. 

11.  lannone  A,  Magin  RL,  Walczak  T,  Fedrico  M,  Swartz  HM,  Tomasi  A.  Blood  clearance  of 
dextran  magnetite  particles  determined  by  a  noninvasive  in  vivo  ESR  method.  Magn  Reson  Med 
1991;22:435-442. 


12 


12.  Tatsumi  Y,  Tanigawa  N,  Nishimura  H,  Nomura  E,  Mabuchi  H,  Matsuki  M,  Narabayashi  I. 
Preoperative  diagnosis  of  lymph  node  metastasis  in  gastric  cancer  by  magnetic  resonance 
imaging  with  ferumoxtran-10.  Gastric  Cancer  2006;9:120-128. 

13.  Ross  RW.,  Zietman  AL,  Xie  W,  Coen  JJ,  Dahl  DM,  Shipley  WU,  Kaufman  DS,  Islam 
T,  Guimaraes  AR,  Weissleder  R,  Harisinghani  M.  Lymphotropic  nanoparticle-enhanced 
magnetic  resonance  imaging  (LNMRI)  identifies  occult  lymph  node  metastases  in  prostate 
cancer  patients  prior  to  salvage  radiation  therapy.  Clin  Imaging  2009;  33:301-305. 

14.  Neuwelt  EA,  Varallyay  CG,  Manninser  S,  Solymosi  D,  Haluska  M,  Hunt  MA.  The  potential 
of  ferumox54ol  nanoparticle  magnetic  resonance  imaging,  perfusion,  and  angiography  in  central 
nervous  system  malignancy:  A  pilot  study.  Neurosurgery  2007;  60:601-612. 

15.  Sitharaman  B,  Kissell  KR,  Hartman  KB,  Tran  LA,  Baikalov  A,  Rusakova  I,  Sun  Y,  Khant 
HA,  Ludtke  SJ,  Chiu  W,  Laus  S,  Toth  E,  Helm  L,  Merbach  AE,  Wilson  LJ.  Superparamagnetic 
gadonanotubes  are  high-performance  MRI  contrast  agents.  Chem  Commun 
(Camb)  2005;31:3915-3917. 

16.  Bridot  JL,  Eaure  AC,  Laurent  S,  Riviere  C,  Billotey  C,  Hiba  B,  Janier  M,  Josserand  V,  Coll 
JL,  Elst  LV,  Muller  R,  Roux  S,  Perriat  P,  Tillement  O.  Hybrid  gadolinium  oxide  nanoparticles: 
multimodal  contrast  agents  for  in  vivo  imaging.  J  Am  Chem  Soc  2007;129:5076-5084. 

17.  Liu  LZ,  Guo  GJ,  Zeng  MS,  Lu  YC,  Liu  XW,  Cui  CY,  Wu  PH,  Li  L.  [Gadolinium-loaded 
nanoparticle  as  a  novel  molecular  imaging  contrast  agent  for  magnetic  resonance  imaging] 
Zhonghua  Yi  Xue  Za  Zhi.  2007;87:240-243. 

18.  Kobayashi  H,  Kawamoto  S,  Bernardo  M,  Brechbiel  MW,  Knopp  MV,  Choyke  PL.  Delivery 
of  gadolinium-labeled  nanoparticles  to  the  sentinel  lymph  node:  Comparison  of  the  sentinel  node 


13 


visualization  and  estimations  of  intra-nodal  gadolinium  concentration  by  the  magnetic  resonance 
imaging.  J  Controlled  Release  2006;  111  ;343-35 1 . 

19.  Kobayashi  H,  Kawamoto  S,  Sakai  Y,  Choyke  PL,  Star  RA,  Brechbiel  MW,  Sato  N,  Tagaya 
Y,  Morris  JC,  Waldmann  TA.  Lymphatic  drainage  imaging  of  breast  cancer  in  mice  by  micro- 
magnetic  resonance  lymphangiography  using  a  nano-size  paramagnetic  contrast  agent.  J  Natl 
Cancer  Inst  2004;96:703-708. 

20.  Xu  R,  Wang  Y,  Wang  X,  Jeong  EK,  Parker  DL,  Lu  ZR.  In  Vivo  evaluation  of  a  PAMAM- 
cystamine-(Gd-D03A)  conjugate  as  a  biodegradable  macromolecular  MRI  contrast  agent.  Exp 
Biol  Med  (Maywood)  2007;232:1081-1089. 

21.  Perazella  MA.  Gadolinium-contrast  toxicity  in  patients  with  kidney  disease:  nephrotoxicity 
and  nephrogenic  systemic  fibrosis.  Curr  Drug  Saf  2008;3:67-75. 

22.  Cheon  J,  Lee  JH.  Synergistically  integrated  nanoparticles  as  multimodal  probes  for 
nanobiotechnology.  Acc  Chem  Res  2008;41:1630-1640. 

23.  Lee  JH,  Jun  YW,  Yeon  SI,  Shin  JS,  Cheon  J.  Dual-mode  nanoparticle  probes  for  high- 
performance  magnetic  resonance  and  fluorescence  imaging  of  neuroblastoma.  Angew  Chem  Int 
Ed  Engl  2006;45:8160-8162. 

24.  Shan  L,  Wang  S,  Sridhar  R,  Bhujwalla  ZM,  Wang  PC.  Dual  Probe  with  Fluorescent  and 
Magnetic  Properties  for  Imaging  Solid  Tumor  Xenografts.  Mol  Imaging  2007;6:85-95. 

25.  Assaraf  YG.  The  role  of  multidrug  resistance  efflux  transporters  in  antifolate  resistance  and 
folate  homeostasis.  Drug  Resist  Updat  2006;9:227-246. 

26.  Al-Mefty  O,  Kersh  JE,  Routh  A,  Smith  RR.  The  long-term  side  effects  of  radiation  therapy 
for  benign  brain  tumors  in  adults.  J  Neurosurg  1990;73:502-512. 


14 


27.  Liang  S,  Wang  Y,  Yu  J,  Zhang  C,  Xia  J,  Yin  D.  Surface  modified  superparamagnetic  iron 
oxide  nanoparticles:  as  a  new  carrier  for  bio-magnetically  targeted  therapy.  J  Mater  Sci  Mater 
Med  2007;18:2297-2302. 

28.  Dolmans  D,  Fukumara  D,  Jain  RK.  Photodynamic  therapy  for  cancer.  Nature  Rev  Cancer 
2003;3:380-387. 

29.  Wilson  BC.  Photodynamic  therapy  for  cancer:  Principles.  Can.  J.  Gastroenterol  2002;  16:393- 
396. 

30.  Huang  X,  El-Sayed,  IH,  Qian  W,  El-Sayed  MA.  Cancer  cell  imaging  and  photothermal 
therapy  in  near  IR  region  by  using  gold  nanorods.  J  Am  Chem  Soc  2006;  128:21 15-2120. 

31.  Huang  X,  Jain  PK,  El-Sayed  IH,  El-Sayed  MA.  Determination  of  the  minimum  temperature 
required  for  selective  photothermal  destruction  of  cancer  cells  with  the  use  of  immunotargeted 
gold  nanoparticles.  Photochem  Photobiol  2006;  82:412-417. 

32.  Pong,  YC,  Chen  TC,  Chen  SY.  Comparative  efficiencies  of  photothermal  destruction  of 
malignant  cells  using  antibody  cells  using  antibody-coated  silica®  Au  nanoshells,  hollow  Au/Ag 
nanospheres  and  Au  nanorods.  Nanotechnology  2009;20:425104. 

33.  Gobin  AM,  Lee  MH,  Halas  NJ,  James  WD,  Drezek  RA,  West  JL.  Near-Infrared  resonant 
nanoshells  for  combined  optical  imaging  and  photothermal  cancer  therapy.  Nano  Lett 
2007;7:1929-1934. 

34.  Huang  YE,  Sefah  K,  Bamrungsap  S,  Chang  HT,  Tan  W.  Selective  photothermal  therapy  for 
mixed  cancer  cells  using  aptamer-conjugated  nanorods.  Langmuir  2008 ;24: 11860-11865. 

35.  Diederich  CV.  Thermal  ablation  and  high-temperature  thermal  therapy:  overview  of 
technology  and  clinical  implementation.  Int  J  Hyperthermia  2005;21(8):745-753. 


15 


36.  Kong  G,  Braun  RD,  Dewhirst  MW.  Hyperthermia  enables  tumor-specific  nanoparticle 
delivery:  effect  of  particle  size.  Cancer  Res  2000;60:4440-4445. 

37.  Gilchrist  R  K.  Selective  Inductive  Heating  of  Lymph.  Ann  Surg  1957;  146(4):  596-606. 

38.  Xie  J,  Huang  J,  Li  X,  Sun  S,  Chen  X.  Iron  oxide  nanoparticle  platform  for  biomedical 
applications.  CurrMed  Chem.  2009;16(10):  1278-1294. 

39.  Latorre  M,  Rinaldi  C.  Applications  of  magnetic  nanoparticles  in  medicine:  magnetic  fluid 
hyperthermia.  P  R  Health  Sci  J  2009;28:227-238. 

40.  Therapeutic  effect  of  Fe203  nanoparticles  combined  with  magnetic  fluid  hyperthermia  on 
cultured  liver  cancer  cells  and  xenograft  liver  cancers.  J  Nanosci  Nanotechnol  2005;5:1185- 
1192. 

41.  Jordan  A,  Scholz  R,  Wust  P,  Schirra  H,  Schiestel  T,  Schmidt  H,  Felix  R.  Endocytosis  of 
dextran  and  silan-coated  magnetite  nanoparticles  and  the  effect  of  intracellular  hyperthermia  on 
human  mammary  carcinoma  cells  in  vitro.  J  Magnetism  and  Magnetic  Materials  1999;  94:185- 
196. 

42.  Sonvico  F,  Mornet  S,  Vasseur  S,  Dubernet  C.  Folate-conjugated  iron  oxide  nanoparticles  for 
solid  tumor  targeting  as  potential  specific  magnetic  hyperthermia  mediators:  synthesis, 
physicochemical  characterization  and,  in  vitro  experiments.  Bioconjugate  Chem  2005;16:1181- 
1188. 

43.  Du  Y,  Zhang  D,  Liu  H,  Lai  R.  Thermochemotherapy  effect  of  nanosized  As203/Fe304 
complex  on  experimental  mouse  tumors  and  its  influence  on  the  expression  of  CD44v6,  VEGF-C 
and  MMP-9.  BMC  Biotechnol  2009;  9:84. 


16 


44.  Ganon  CJ,  Patra  CR,  Bhattacharya  R,  Mukherjee  P,  Curley  SA.  Intracellular  gold 
nanoparticles  enhance  non-invasive  radiofrequency  thermal  destruction  of  human  gastrointestinal 
cancer  cells.  J  Nanobiotechnol  2008;6:2. 

45.  Melnikov  OV,  Gorbenko  Y,  Markelova  MN,  Kaul  AR,  Atsarkin  VA.  Ag-doped  manganite 
nanoparticles:  New  materials  for  temperature-controlled  medical  hyperthermia.  J  Biomed  Mater 
Res  A  2008;91(4);1048-1055. 

46.  Oyewumi  MO,  Mumper  RJ.  Engineering  tumor-targetted  gadolinium  hexanedione 
nanoparticles  for  potential  application  in  neutron  capture  therapy.  Bioconjugate  Chem 
2002;13:1328-1335. 

47.  Yamamoto  T,  Nakai  K,  Matsumura  A.  Boron  neutron  capture  therapy  for  glioblastoma. 
Cancer  Lett  2008 ;262(2):  143-152. 

48.  Barth,  RF.  Boron  neutron  capture  therapy  at  the  crossroads:  challenges  and  opportunities. 
Appl  Radiat  Isot  2009;67(7-8  Suppl):S3-S6. 

49.  Barth  RF.  A  critical  assessment  of  boron  neutron  capture  therapy:  an  overview.  J  Neuro- 
Oncol  2003;62:1-5. 

50.  Martin  RF,  D'Cunha  G,  Pardee  M,  Allen  BJ.  Induction  of  DNA  double-strand  breaks  by 
157Gd  neutron  capture.  Pigment  Cell  Res  1989;2:330-332. 

51.  Tokumitsu  H,  Ichikawa  H,  Fukumori  Y.  Chitosan-gadopentetic  acid  complex  nanoparticles 
for  gadolinium  neutron-capture  therapy  of  cancer:  preparation  by  novel  emulsion-droplet 
coalescence  technique  and  characterization.  Pharm  Res  1999;16:1830-1835. 

52.  Shikata  F,  Tokumitsu  H,  Ichikawa  H,  Fukumori  Y.  In  vitro  cellular  accumulation  of 
gadolinium  incorporation  into  chitosan  nanoparticles  designed  for  neutron-capture  therapy  of 
cancer.  Eur  J  BioPharm  2002;53:57-63. 


17 


53.  Oyewumi  MO,  Yokel  RA,  Coakley  T,  Mumper  RJ.  Comparison  of  cell  uptake, 
biodistribution  and  tumor  retention  of  folate  and  PEG-coated  gadolinium  nanoparticles  in  tumor 
bearing  mice.  J  Control  Release  2004;95:613-626. 

54.  Percival  SL,  Bowler  P.G.,  Dolman  J.  Antimicrobial  activity  of  silver  containing  dressing  on 
wound  microorganisms  using  in  vitro  biofilm  model.  Int  Wound  J.  2007 ;4 
:186-191. 

55.  Rahman  ME,  Wang  J,  Patterson  TA,  Saini  UT,  Robinson  BE,  Newport  GD,  Murdock  R.C, 
Schlager  JJ,  Hussain  SM,  Ali  SE.  Expression  of  genes  related  to  oxidative  stress  in  the  mouse 
brain  after  exposure  to  silver  nanoparticles.  Toxicol  Lett  2009;187:15-21. 

56.  AshaRani  PV,  Hande  MP,  Valiyaveettil  S.  Anti-proliferative  activity  of  silver  nanoparticles. 
BMC  Cell  Biology  2009;  10:65. 

57.  Chanda  N,  Kan  P,  Watkinson  LD,  Shukla  R,  Zambre  A.  et  al.  Radioactive  gold  nanoparticles 
in  cancer  therapy:  therapeutic  efficacy  studies  of  GA-198AuNP  nanoconstruct  in  prostate  tumor¬ 
bearing  mice.  Nanomed  2010;6(2):201-209. 

58.  Tarnuzzer  RW,  Colon  J,  Patil  S,  Seal  S.  Vacancy  Engineered  Ceria  Nanostructures  for 
protection  from  Radiation-Induced  cellular  damage.  Nano  Lett  2005;5:2573-2577. 

59.  Heckert  EG,  Karakoti  AS,  Seal  Sudipta,  Self  WT.  The  role  of  cerium  redox  state  in  the  SOD 
mimetic  activity  of  nanoceria.  Biomaterials  2008;29:2705-2709. 

60.  Chen  C,  Xing  G,  Wang  J,  Zhao  Y,  Li  B,  Tang  J,  Jia  G,  Wang  T,  Sun  J,  Xing  L,  Yuan  H,  Gao 
Y,  Meng  H,  Chen  Z,  Zhao  E,  Chai  Z,  Eang  X.  Multihydroxylated  [Gd@C82(OH)22]n 
nanoparticles:  antineoplastic  activity  of  high  efficiency  and  low  toxicity.  Nano  Lett  2005;5:2050- 
2057. 


18 


61.  Wang  J,  Chen  C,  Li  B,  Yu  H,  Zhao  Y,  Sun  J,  Li  Y,  Xing  G,  Yuan  H.,  Tang  J,  Chen  Z,  Meng 
H,  Gao  Y,  Ye  C,  Chai  Z,  Zhu  C.,  Ma  B,  Fang  X,  Wan  L.  Anti-oxidative  function  and 
biodistribution  of  [Gd@C82(OH)22]n  nanoparticles  in  tumor-bearing  mice.  Biochem  Pharmacol 
2006;7 1:872-881. 

62.  Yin  JJ,  Lao  F,  Meng  J,  Fu  PP,  Zhao  Y,  Xing  G,  Gao  X,  Sun  B,  Wang  PC,  Chen  C,  Liang  XJ. 
Inhibition  of  tumor  growth  by  endohedral  metallofullerenol  nanoparticles  optimized  as  reactive 
oxygen  species  scavenger.  Mol  Pharmacol  2008;74:1132-1140. 

63.  Thomas  SR,  Khuntia  D.  Motexafin  gadolinium  injection  for  the  treatment  of  brain  metastases 
in  patients  with  non-small  cell  lung  cancer.  Int  J  Nanomed  2007;2:79-87. 

64.  Mehta  MP,  Shapiro  WR,  Phan  SC,  Gervais  R,  Carrie  C,  Chabot  P,  Patchell  RA.  Motexafin 
gadolinium  combined  with  prompt  whole  brain  radiotherapy  prolongs  time  to  neurologic 
progression  in  non-small-cell  lung  cancer  patients  with  brain  metastases:  results  of  a  phase  III 
trial.  Int  J  Radiat  Oncol  Biol  Phys  2009;73:1069-1076. 

65.  C.  Alexiou,  Jurgons  R.,  Schmid  R,  Hilpert  A,  Bergemann  C,  Parak  F,  Iro  H  In  vitro  and  in 
vivo  investigations  of  targeted  chemotherapy  with  magnetic  nanoparticles.  Journal  of  Magnetism 
and  Magnetic  Materials  2005;293:389-393. 

66.  Munnier  E,  Cohen- Jonathan  S,  Linassier  C,  Douziech-Eyrolles  L,  Marchais  H,  Souce  M, 
Herve  K,  Dubois  P,  Chourpa  1.  Novel  method  of  doxorubicin-SPION  reversible  association  for 
magnetic  drug  targeting.  Int  J  Pharm  2008;363:170-176. 

67.  Lai  JCK,  Schoen  MP,  Perez  Gracia  A,  Naidu  DS  &  Leung  SW.  Prosthetic  devices: 
challenges  and  implications  of  robotic  implants  and  biological  interfaces:  In:  Proc  I  Mech  E,  Vol 
221  Part  H,  J  Engineering  in  Medicine,  Special  Issue  entitled:  “Micro  and  Nano  Technologies  in 
Medicine”;  2007,  p  173-183. 


19 


68.  Aghargar  VA,  Bhushan  A,  Lai  JCK,  Daniels  CK.  C5^otoxic  Effects  of  Short  Multiwall  Caron 
Nanotubes:  In:  Technical  Proceedings  of  the  2008  Nanotechnology  Conference  and  Trade  Show, 
Volume  2,  Chapter  2:  Environment,  Health  &  Toxicology;  2008,  p.  122-125. 

69.  Jandhyam  S,  Lai  MB,  DukLande  VV,  Bhushan  A,  Daniels  CK,  Leung  SW,  Lai  JCK.  Silicon 
dioxide  nanoparticles  exert  dissimilar  cytotoxic  effects  on  mammalian  cell  types:  In:  Technical 
Proceedings  of  the  2008  Nanotechnology  Conference  and  Trade  Show,  Volume  2,  Chapter  2: 
Environment,  Health  &  Toxicology;  2008,  p.  126-129. 

70.  Lai  MB,  Jandhyam  S,  Dukhande  VV,  Bhushan  A,  Daniels  CK,  Leung  SW,  Lai  JCK. 
Differential  cytotoxicity  of  metallic  oxide  nanoparticles  in  mammalian  cells:  In:  Technical 
Proceedings  of  the  2008  Nanotechnology  Conference  and  Trade  Show,  Volume  2,  Chapter  2: 
Environment,  Health  &  Toxicology;  2008,  p.  130-133. 

71.  Lai  JCK,  Lai  MB,  Jandhyam  S,  Dukhande  VV,  Bhushan  A,  Daniels  CK,  Leung  SW. 
Exposure  to  titanium  dioxide  and  other  metallic  oxide  nanoparticels  induce  cytotoxicity  on 
human  neural  cells  and  fibroblasts.  Int  J  Nanomed  2008;3:533-545. 

72.  Lai  JCK,  Ananthakrishnan  G,  Jandhyam  S,  Dukhande  VV,  Bhushan  A,  Gokhale  M,  Daniels 
CK,  Leung  SW.  Treatment  of  human  astrocytoma  U87  cells  with  silicon  dioxide  nanoparticles 
lowers  their  survival  and  alters  their  expression  of  mitochondrial  and  cell  signaling  proteins.  Int  J 
Nanomed  2010;5:715-723. 


20 


A  Noncontact  Co-Culture  Model  of  Peripheral  Neural  Cells  for  Nanotoxicity,  Tissue 

Engineering  and  Pathophysiological  Studies 

A.R.  Jaiswaf ,  Yin  Yin  W.  Wong",  Alok  Bhushan*",  Christopher  K.  Daniels""  and  James  C.K.  Lai""* 

*Department  of  Biomedical  and  Pharmaceutical  Sciences,  College  of  Pharmacy,  and  Biomedical  Research 
Institute,  Idaho  State  University,  Pocatello,  ID  83209,  USA  Fax:  208-282-4305;  Tel:  208-705-2447 

Department  of  Biomedical  &  Pharmaceutical  Sciences,  College  of  Pharmacy,  and  Biomedical  Research 
Institute,  Idaho  State  University,  Pocatello,  ID  83209,  USA  Fax:  208-282-4305;  Tel:  469-463-5139, 

email:  wongvin@pharmacv.isu.edu 

***Department  of  Biomedical  &  Pharmaceutical  Sciences,  College  of  Pharmacy,  and  Biomedical  Research 
Institute,  Idaho  State  University,  Pocatello,  ID  83209,  USA  Fax:  208-282-4305;  Tel:  208-282-4408, 

email:  abhushan@pharmacv.isu.edu 

Department  of  Biomedical  &  Pharmaceutical  Sciences,  College  of  Pharmacy,  and  Biomedical 
Research  Institute,  Idaho  State  University,  Pocatello,  ID  83209,  USA  Fax:  208-282-4305;  Tel:  208-282- 

3324,  email:  cdaniels@pharmacv.isu.edu 

*****Corresponding  author:  Department  of  Biomedical  &  Pharmaceutical  Sciences,  College  of  Pharmacy, 
and  Biomedical  Research  Institute,  Idaho  State  University,  Pocatello,  ID  83209,  USA  Fax:  208-282- 
4305;  Tel:  208-282-2275,  E-mail:  lai @pharmacv.isu.edu 


ABSTRACT 

Cell  culture  models  in  vitro  have  long  served  as  tools  for 
the  elucidation  of  cellular  and  molecular  mechanisms  of 
diseases.  Recently  these  versatile  models  have  gained  wide 
acceptance  in  toxicology  and  tissue  engineering  research. 
Although  these  models  are  not  exactly  the  same  as  the 
models  in  vivo,  they  facilitate  mechanistic  insights 
pertaining  to  a  particular  cell  type.  Nevertheless,  co¬ 
cultures  of  two  different  but  functionally  complementary 
cell  types  provide  structural  and  functional  perspectives 
single-cell-type  models  do  not.  We  have  initiated  a 
systematic  development  of  this  model  type  employing 
dorsal  root  ganglion  (DRG)  neurons  and  Schwann  cells. 
Our  first  model  involves  non-contact  co-cultures  of 
Schwann  cells  and  DRG  neurons  employing  the  hanging 
cell  culture  insert.  The  results  from  our  studies  to  date 
demonstrate  that  our  non-contact  co-culture  model  is 
suitable  for  both  high  throughput  and  mechanistic  studies  in 
nanotoxicological  and  pathophysiological  research. 

Keywords'.  Co-culture  model,  DRG  neurons,  Schwann  cells, 
nanotoxicology,  tissue  engineering,  pathophysiology. 
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1  INTRODUCTION 

The  aim  of  our  studies  is  to  systematically  develop  and 
characterize  cell  culture  models  of  neural  cells  of  the 
peripheral  nervous  system  in  vitro  for  nanotoxicological 
and  pathophysiological  research.  Once  such  models  are 
developed,  they  may  have  wide  applications  in  tissue 
engineering  research.  The  need  for  such  models  is  derived 
from  the  fact  that  the  peripheral  nervous  system  is  most 
susceptible  for  the  development  of  neuropathy.  Some 
examples  of  peripheral  neuropathies  include  drug- 
(chemotherapy)  induced  neuropathy  [1],  disease-induced 
neuropathy  (e.g.,  diabetes)  [2],  immune  and  inflammatory 
neuropathies,  inherited  and  genetic  neuropathies,  and  other 
neuropathies  induced  by  toxicity. 

The  applications  of  nanomaterials,  including 
nanoparticles,  have  been  increasing  exponentially  in  the  last 
decade  and  have  infiltrated  diverse  fields.  Once  they  enter 
the  body  by  inhalation  or  other  routes,  nanoparticles  may  be 
toxic  to  one  or  more  organ  systems  [3].  However,  the 
toxicity  of  nanoparticles  in  mammals,  especially  humans, 
has  not  been  systematically  studied  although  there  is 
increasing  concern  about  the  environmental  and  health 
impact  of  exposure  to  nanoparticles  of  different  types  [4]. 


Consequently,  we  have  systematically  initiated  a  series  of 
studies  to  elucidate  the  putative  cytotoxicity  of 
nanoparticles  in  various  mammalian  cell  types  [4].  For 
example,  once  recent  study  of  ours  noted  that  several  metal 
oxide  (including  titanium  and  zinc  oxides)  nanoparticles 
exert  differential  cytotoxic  effects  on  human  neural  cells  in 
cell  model  systems  in  vitro  [4]  . 

There  have  been,  however,  extremely  few  cell  model 
systems  developed  employing  peripheral  neural  cell  types 
for  nanotoxicological  and  tissue  engineering  studies.  We 
have  therefore  initiated  a  systematic  development  of  this 
type  of  models  employing  Schwann  cells  and  dorsal  root 
ganglion  (DRG)  neurons.  The  first  model  we  have 
developed  involved  a  non-contact  co-culture  model  of 
Schwann  cells  and  DRG  neurons  using  the  hanging  cell 
culture  insert.  Thus,  this  type  of  co-culture  cell  systems, 
consisting  of  two  distinctly  different  but  functionally 
complementary  cell  types,  provide  structural  and  functional 
perspectives  that  single-cell-type  models  do  not. 

We  hypothesized  that  non-contact  co-culture  model  of 
Schwann  cells  and  DRG  neurons  can  be  useful  in 
elucidating  the  putative  toxic  effects  of  various 
nanoparticles  on  the  peripheral  nervous  system. 
Furthermore,  the  putative  cytotoxic  effects  of  nanoparticles 
could  also  influence/disrupt  the  cell-to-cell  communications 
between  the  two  cell  types.  To  test  our  hypothesis,  we  have 
initially  characterized  the  Schwann  cells  the  DRG  neurons 
in  monotypic  or  single-cell-type  cultures.  In  our  ongoing 
studies,  employing  our  new  co-culture,  non-contact  model, 
we  have  recently  demonstrated  that  the  survival  of  DRG 
neurons  is  increased  when  co-cultured  with  Schwann  cells 
in  this  construct.  In  this  study,  we  compare  the  putative 
cytotoxic  effects  of  Si02  and  Ti02  nanoparticles  on  dorsal 
root  ganglion  (DRG)  neurons  and  Schwann  cells  employing 
established  cytotoxicity  testing  [5-8].  Furthermore,  we  are 
investigating  the  putative  toxic  effect  of  these  nanoparticles 
on  interaction(s)  between  DRG  neurons  and  Schwann  cells 
in  non-contact  co-culture. 


2  MATERIALS  AND  METHODS 

2.1  Cells  and  Culture  Conditions 

The  immortalized  DRG  neurons  were  a  gift  from 
Dr.  Ahmet  Hoke’s  Laboratory  at  Johns  Hopkins  University 
(Baltimore,  MD,  USA)[9].  The  rat  Schwann  cell  line  was 
obtained  from  ATCC  (Manassas,  VA,  USA).  These  cells 
and  their  co-culture  were  cultured  in  DMEM  (Sigma;  St 
Louis,  MO,  USA)  supplemented  with  10%  (v/v)  fetal 
bovine  serum  (FBS),  1%  (w/v)  sodium  pyruvate,  0.292  g/1 
L-glutamine,  1.5  g/1  sodium  bicarbonate,  1%  (v/v)  anti¬ 
mycotic  and  various  specified  concentrations  (5-45  mM)  of 
glucose. 

2.2  Co-culture  Model  System 


DRG  neurons  were  cultured  on  a  Corning  Costar 
24-well  plate.  Schwann  cells  were  then  seeded  on  a 
Millipore  hanging  cell  culture  insert  (pore  size  0.4  pm)  on  a 
separate  plate  and  then  introduced  to  a  DRG  neuron- 
containing  well  after  4  hours  to  achieve  the  co -culture 
condition  [7].  DRG  neurons  (co-cultured  with  Schwann 
cells)  were  exposed  to  various  concentrations  of  Si02 
nanoparticles  for  specified  periods  and  their  survival 
determined  employing  the  cell  survival  assay. 


2.3  Cell  Survival  (MTT)  Assay 

DRG  neurons  or  Schwann  cells  were  seeded  per 
well  in  a  48 -well  plate  in  DMEM  with  specified 
concentrations  of  Si02  nanoparticles.  After  incubation  at 
37°C  for  24  or  48  hours,  50  pi  of  MTT  (5  mg/ml  in  PBS) 
reagent  was  added  to  each  well.  After  incubation  for 
another  4  hours,  the  medium  was  removed  gently  and  the 
cellular  reaction  product  was  solubilized  in  200  pi  DMSO. 
Then  the  optical  density  of  the  contents  of  each  well  was 
measured  in  a  plate  reader  at  570  nm  [4].  The  absorbance 
corresponds  to  live  cells  present  in  each  well  [4] . 


Figure  1 :  Co-cultures  of  DRG  neurons  and  Schwann  cells 
using  hanging  cell  culture  inserts  (non-contact  co-culture). 
Values  are  mean  ±  SEM  of  2-3  determinations.  DRG 
neurons  cells  treated  with  Si02  nanoparticles  for  24  hours 
are  arked  with  blue  line  and  those  treated  for  48  hrs  are 
marked  with  red  line. 


2.4  Cellular  morphology 

DRG  neurons,  Schwann  cells  and  their  co-culture 
was  treated  with  Si02  specified  concentration  for  24  and  48 
hours  at  37^  C  as  described  above  and  bright  field  images 
were  acquired  by  using  a  Leica  light  microscope  (Leica  DM 
IRB,  Bannockburn,  IL,  USA)  equipped  with  a  digital 
camera  (Leica  DEC  300FX)  [4]. 


2.5  Statistical  analysis  of  results 

Statistical  significance  of  experimental  results  was 
analyzed  with  one-way  ANOVA  followed  by  Dunnett’s 
post-hoc  test  with  a  minimum  significance  level  set  at  p< 
0.05  using  the  SPSS  17  software  package. 


3  RESULTS  AND  DISCUSSION 

We  are  the  first  to  employ  dorsal  root  ganglion  (DRG) 
neurons  and  Schwann  cells  to  develop  co-culture  models  in 
vitro  because  DRG  neurons  are  the  most  susceptible  nerve 
cells  to  developing  pathologies  in  peripheral  neuropathy. 
We  have  characterized  the  two  cell  types  individually  with 
respect  to  their  optimum  glucose  requirement  and  activities 
of  enzymes  important  in  modulation  of  glutamate- 
glutamine  cycling  (e.g.,  glutamine  synthetase)  that  is  part  of 
the  metabolic  and  functional  inter-dependence  between 
DRG  neurons  and  Schwann  cells  known  to  occur  in  vivo 
(data  not  shown).  We  have  also  studied  the  protein 
expression  of  various  apoptosis-related  proteins  such  as 
BCL-2,  BCL-XL,  BAX  and  cytohrome  C  in  the  two  cell 
types  (data  not  shown). 


Figure  2:  Effects  of  Si02  nanoparticles  on  DRG  neurons 
and  Schwann  cells.  Values  are  mean  ±  SEM  of  12 
determinations  and  replicate  experiments  show  the  same 
trend.  DRG  neurons  and  Schwann  cells  treated  with  Si02 
nanoparticles  for  24  hours  are  marked  red  and  blue, 
respectively,  treated  with  Si02  nanoparticles  for  24  hrs  are 
marked  with  blue  line. 

To  our  knowledge,  we  are  the  first  to  determine,  in  this 
study,  the  putative  cytotoxic  effects  of  Si02  and  Ti02 
nanoparticles  on  neural  cells  of  the  peripheral  nervous 
system  (i.e.,  DRG  neurons  and  Schwann  cells). 


As  shown  in  Figure  2,  treatment  of  DRG  neurons  or 
Schwann  cells  for  24  hours  with  Si02  induced  a  dose- 
related  decreases  in  survival  of  those  cells  when  we 
progressively  increased  the  concentrations  of  the 
nanopartcles  from  1  to  200  pM,  with  IC50  values  of  --ISO 
pM  (Figure  2).  At  the  highest  concentration  employed,  less 
than  40%  of  the  cells  survived  (Figure  2). 

Because  we  had  previously  noted  that  Ti02 
nanoparticles  exerted  differential  cytotoxic  effects  on 
central  nervous  system  neural  cells  [4],  we  have 
investigated  the  possibility  that  these  nanoparticles  may 
also  exert  cytotoxic  effects  on  neural  cells  from  the 
peripheral  nervous  system.  As  shown  in  Figure  3,  our  on¬ 
going  studies  indicate  that  treatment  with  Ti02 
nanoparticles  in  the  dose  range  so  far  employed  (0.1  to  20 
pM)  appeared  to  lower  the  survival  of  both  DRG  neurons 
and  Schwann  cells:  the  effects  seemed  somewhat  dose- 
related.  Moreover,  the  Schwann  cells  appeared  to  be  more 
susceptible  to  the  effect  of  Ti02  nanoparticles,  suggesting 
they  may  exert  differential  effects  on  the  neural  cells  of  the 
peripheral  nervous  system. 

We  have  also  employed  light  microscopy  to  examine 
the  effects  of  nanoparticles  on  DRG  neurons  and  Schwann 
cells  and  assess  the  effects  of  Si02  and  Ti02  nanoparticles 
thereon  (data  not  shown).  In  general,  the  photomicrographs 
revealed  that  treatment  with  the  nanparticles  induced  dose- 
related  changes  in  cellular  morphology  consistent  with  the 
nanoparticle-induced  progressive  decrease  in  cell  viability 
(Figures  2  and  3). 

As  we  have  previous  noted,  treatment  with  Ti02 
nanoparticles  induced  dose-related  increases  in  cell  death  of 
human  central  neural  cells,  marked  by  apoptosis,  and 
necrosis,  and  an  as  yet  uncharacterized  cell  death 
mechanism  that  appeared  to  be  a  mixture  of  apoptosis  and 
necrosis  [4].  Thus,  the  results  of  our  ongoing  studies  with 
the  peripheral  nervous  system  neural  cells  such  as  DRG 
neurons  and  Schwann  cells  appear  to  show  some  similarity 
to  those  we  obtained  with  central  neural  cells  [4] .  The  DRG 
neurons  and  Schwann  cells  appear  also  to  be  susceptible  to 
the  cytotoxic  effects  of  Si02  and  Ti02  nanoparticles.  As  we 
have  indicated  earlier,  we  are  also  determining  the  cell 
death  mechanisms  underlying  the  cytotoxic  effects  of  Si02 
and  Ti02  nanoparticles  on  DRG  neurons  and  Schwann 
cells.  Clearly,  this  is  an  important  area  that  merits  further 
study. 


4  CONCLUSITIONS 

Thus,  the  results  from  our  studies  to  date  as  well  as 
those  from  our  ongoing  studies  demonstrate  that  our  non- 
contact  co-culture  model  is  highly  suitable  for  both  high 
throughput  and  mechanistic  studies  in  nanotoxicological 
and  tissue  engineering  research.  Moreover,  this  model  is 
also  relevant  for  the  investigation  of  mechanistic  issues 
associated  with  peripheral  diabetic  neuropathy  and  other 
disease  states  of  the  peripheral  nervous  system. 
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Figure  3:  Effects  of  Ti02  nanoparticles  on  DRG  neurons  or 
Schwann  cells.  Values  are  mean  ±  SEM  of  12 
determinations  and  replicate  experiments  show  the  same 
trend.  DRG  neurons  and  Schwann  cells  treated  with  Ti02 
nanoparticles  for  24  hours  are  marked  red  and  blue, 
respectively. 


Results  of  our  present  and  ongoing  studies  have 
confirmed  that  neural  cells  of  the  peripheral  nervous 
system,  similar  to  their  counter  parts  in  the  central  nervous 
system,  are  also  susceptible  to  the  cytotoxicity  of  Si02  and 
Ti02  nanoparticles.  Thus,  these  results  are  consistent  with 
our  hypothesis  that  our  non-contact  co-culture  model  of 
Schwann  cells  and  DRG  neurons  can  be  useful  to  study 
toxic  effects  of  various  nanoparticles  on  peripheral  nervous 
system. 

The  results  of  this  and  our  ongoing  studies  suggest  that 
nanoparticles  may  exert  differential  cytotoxic  effects  on 
neural  cell  types  of  the  peripheral  nervous  system.  As  such, 
our  results  may  assume  pathophysiological  importance  in 
the  environmental  health  impact  of  nanoparticles. 
Obviously,  the  is  an  important  area  that  deserves  further 
study. 
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ABSTRACT 

Evidence  is  accumulating  that  cell  culture  models  in 
vitro  facilitate  high  throughput  and  mechanistic  studies  in 
tissue  engineering.  Astrocytes  are  known  to  protect  neurons 
against  pathophysiological  assaults  in  vivo  and  in  vitro 
although  the  underlying  mechanisms  are  not  fully 
understood.  Previously,  we  investigate  several  of  the 
putative  neuroprotective  properties  of  astrocytes  in  cell 
culture  model.  Those  studies  led  us  to  hypothesize  that 
different  stress  factors  can  elicit  and/or  enhance  the 
neuroprotective  effects  of  astrocytes  through  the  activation 
of  astrocytic  signaling  and  alteration  of  astroglial  function. 
The  results  of  this  study  suggest  that  U87  (astrocytes -like) 
astrocytoma  cells  exert  some  protective  effects  on  SK-N-SH 
(neurons-like)  neuroblastoma  cells  against  pathophysiolo¬ 
gical  assaults  (e.g.,  oxidative  stress)  under  several  sets  of 
culture  conditions  not  previously  studied.  Thus,  our  results 
may  have  pathophysiological  implications  in  neuroprotection 


and  implications  and  applications  in  tissue  engineering  and 
nanotoxicological  research. 

Key  Words:  Cell  culture  models;  human  neural  cells;  U87 
astrocytes-like  astrocytoma  cells;  neuroprotection;  tissue 
engineering;  nanotoxicology 

Topic  Area: 

1.  INTRODUCTION 

There  is  increasing  evidence  that  cell  model  systems  in 
vitro  play  vital  roles  in  recent  tissue  engineering  research. 
The  additional  structural  and  functional  perspectives  of  co- 
culture  cell  systems  in  vitro  start  to  gain  prominence  over 


single  cell  type  cell  systems  because  unlike  the  latter,  the 
former  more  closely  resemble  cell  types  in  a  tissue/organ  in 
vivo. 

Astrocytes  (non-nerve,  glial  cells)  in  the  brain  play 
important  roles  in  protecting  neurons  (nerve  cells)  against 
various  assaults;  yet,  the  cellular  and  molecular  mechanisms 
underlying  this  protection  is  far  more  being  understood  [1]. 
Among  the  research  on  further  elucidating  such  mechanisms, 
more  efforts  appear  to  center  on  commonly  known 
neurodegenerative  diseases  such  as  Alzheimer’s  disease 
(AD),  followed  by  Parkinson’s  disease  (PD)  [2].  AD  is  a 
progressive  and  irreversible  neurodegenerative  disorder  in 
human  brain  leading  to  key  symptoms  of  memory  loss  [3]. 
No  known  cure  is  available  for  AD  as  current  therapy 
primarily  treats  AD  symptoms  and  presents  them  from 
worsening.  Thus,  there  is  an  urgent  need  to  better  understand 
how  astrocytes  exert  their  protective  effects  on  neurons  in  a 
co-culture  cell  system  in  vitro.  Once  this  protection  is 
elucidated,  then  one  could  design  treatment  strategies  and/or 
tissue  engineering  application  to  prevent  the  occurrence  of 
accelerated  neuronal  loss  in  neurodegenerative  diseases  such 
as  AD  and  PD. 

Our  project  seeks  to  examine  the  underlying 
neuroprotective  properties  offered  by  astrocytes  to  protect 
neurons,  employing  a  co-culture  cell  model  system  in  vitro. 
We  have  been  developing  several  model  systems  to 
investigate  putative  cytotoxic  and  inflammatory  mechanisms 
associated  with  induction  of  neuronal  cell  damage  and  cell 
death  [4-6].  Our  previously  data  have  shown  that  U87 
astrocytoma  and  SK-N-SH  neuroblastoma  cells  constitute 
good  co-culture  model  systems  for  astrocytes  and  neurons, 
respectively,  in  vitro  because  of  their  close  functional 
resemblance  to  normal  astrocytes  and  neurons  and  that  U87 
cells  protect  SK-N-SH  cells  from  several  pathological 
assaults  [4-5].  We  therefore  hypothesized  that  different 
stress  factors  can  elicit  and/or  enhance  the  neuroprotective 
effects  of  astrocytes  through  the  activation  of  astrocytic 
signaling  and  alteration  of  astroglial  function.  In  this  study, 
we  have  investigated  this  hypothesis  further. 

2.  MATERIALS  AND  METHODS 

2.1  Cell  culture  of  U87  and  SK-N-SH  cells 

The  human  astrocytoma  (U87)  and  neuroblastoma 
(SK-N-SH)  cell  lines  were  obtained  from  (ATCC;  Manassas, 
VA,  USA)  and  cultured  in  MEM  supplemented  with  10% 
(v/v)  fetal  bovine  serum  (Atlanta  Biologicals;  Lawrenceville, 
GA),  1%  (w/v)  sodium  pyruvate  (Sigma  Aldrich;  St  Louis, 
MO),  0.292  g/L  L-glutamine  (Sigma),  1.5g/L  sodium 
bicarbonate  (Sigma)  and  1%  (v/v)  antimycotic  (Atlanta 
Biologicals;  Lawrenceville,  GA).  Cells  were  maintained  at 
37°C  and  5%  (v/v)  CO2  as  described  previously  [4-5]. 

2.2  Treatment  of  U87  cells 


The  U87  cells  were  cultured  in  T-75  tissue  culture 
flasks  to  '-50%  confluent  in  20  ml  of  10%  LBS -containing 
MEM  medium.  Then  the  medium  was  discarded  and 
changed  to  20  ml  of  5%  LBS -containing  medium  and  the 
cells  incubated  for  24  hours.  After  that,  the  medium  was 
replaced  with  20  ml  of  medium  containing  0%  LBS  and  the 
cells  incubated  for  an  additional  24  hours.  Cells  were  treated 
L-sulfoximine  buthionine  (BSO),  or  pioglitazone  (PZ)  or  a 
combination  of  both.  At  the  end  of  another  24  hours  of 
incubation,  the  media  were  removed  and  frozen  with  liquid 
nitrogen  immediately.  The  cell  pellet  was  collected  and  both 
cell  pellet  and  media  collected  were  kept  at  -80°C  until  used 
for  experiments. 

2.3  Cell  Survival  (MTT)  assay 

The  neuroprotective  properties  of  U87  cells  on  SK- 
N-SH  cells  were  determined  in  different  combinations  of 
regular  medium  (RM)  and  conditioned  medium  (CM) 
collected  from  U87  cells  cultured  under  various  conditions 
(see  above).  RC/CM  ratio  of  100/0,  70/30,  50/50,  40/60, 
30/70,  and  0/100  were  used.  SK-N-SH  cell  survival  after  the 
treatments  was  assessed  employing  the  MTT  assay  [5]. 

2.4  Western  Blot  Analysis 

Western  blot  analysis  was  employed  to  assess 
protein  expression  in  cell  lysates  to  determine  the  effects  of 
media,  BSO  and  PZ.  SDS-PAGE  electrophoresis  was 
performed  as  previously  described  [7].  The  separated 
proteins  were  visualized  using  chemiluminesence  detection 
kit  while  p-actin  was  the  loading  control. 


3.  RESULTS  AND  DISCUSSION 

Our  culture  model  consists  of  U87  (astrocytes-like) 
cells  and  medium  collected  from  U87  cells  cultured  under 
specified  conditions  to  grow  SK-N-SH  (neurons-like)  cells. 
This  is  a  new  modified  co-culture  strategy  to  allow  the 
characterization  of  putative  “protective  factors”  secreted  by 
U87  cells  to  protect  SK-N-SH  cells  in  a  non-contact  cell 
culture  setup.  In  addition,  we  can  characterize  the  putative 
structural  and  functional  properties  of  U87  cells  under  the 
different  specified  conditions. 

A  selective  inhibitor  of  glutathione  (naturally- 
occurring  antioxidant)  synthesis,  L-buthionine  sulfoximine 
(BSO),  is  used  to  induce  oxidative  stress  in  cells.  A 
peroxisome  proliferator  activated  receptor  gamma  (PPARy) 
agonist,  Pioglitazone  (PZ),  is  used  to  block  the  inflammation 
which  is  usually  unregulated  in  AD  [8,9].  We  have  designed 
studies  whereby  we  could  utilize  BSO  and  PZ  in  addition  to 
serum  depletion  to  further  elucidate  the  putative  protective 
mechanism(s)  of  U87  cells  on  neurons-like  SK-N-SH  cells. 
Serum  depletion  and  drug  treatment  for  U87  cell  cultures 
were  prepared  as  shown  in  the  flow  chart  below  (Pig.  1). 


U87  cells  cultured  in  medium  containing  10%  FBS  were 
used  as  control  (not  shown  in  Fig.  1).  Medium  containing 
0%  FBS  were  defined  as  serum  free  (SF)  medium. 
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Figure  1.  Experimental  design  of  U87  cells  treated  with  BSO, 
PZ  or  in  combination.  The  U87  cells  were  grown  to  '-50% 
confluent  in  10%-FBS  containing  medium  and  subsequently 
discarded  and  changed  to  5%  FBS -containing  medium  and 
incubated  for  24  hours.  After  that,  the  medium  was  replaced 
with  medium  containing  0%  FBS  and  incubated  for  an 
additional  24  hours.  Cells  were  treated  BSO  or  PZ  or  a 
combination  of  both  for  another  24  hours  of  incubation. 

Morphological  and  functional  changes/adaption  in 
astrocytes  in  vivo  and  in  vitro  is  known  to  associate  with 
oxidative  and  other  environmental  stresses.  We  employed 
light  microscopy  to  examine  the  effects  of  BSO  treatment 
and  FBS  depletion  to  induce  oxidative  and  environmental 
stress,  respectively,  on  U87  cells  and  assess  the  effects  of  PZ 
treatment  thereon. 


employed  western  blot  to  determine  if  the  morphological 
changes  in  U87  cells  exposed  to  SF  medium  with  and 
without  BSO/PZ  treatment  were  seen  also  associated  with 
changes  in  GFAP  expression.  An  increased  GFAP 
expression  was  observed  when  U87  cells  were  cultured  in  SF 
medium  compared  to  those  cultured  in  10%  FBS  medium 
(data  not  shown),  suggesting  a  correlation  between  changes 
in  cellular  morphology  and  GFAP  expression. 

Growth  factors  and  neuronal  survival  enhancers  are 
putatively  released  into  the  medium  by  astrocytes  to  protect 
their  surrounding  neurons.  To  investigate  this  possibility, 
we  collected  media  in  which  we  grew  U87  cells  under  the 
conditions  specified  in  Figure  1  above  and  assessed  their 
ability  to  influence  survival  of  SK-N-SH  cells.  Our  results 
suggested  that  exposure  of  SK-N-SH  cells  to  various 
combinations  of  SF  media  allowed  them  to  survive  better 
than  when  cultured  in  10%  FBS  medium  (control  condition) 
alone  (Fig.  3).  Moreover,  exposure  to  PZ  enhanced  this 
protective  effect,  even  under  conditions  of  oxidative  stress. 


4.  CONCLUSIONS 

When  taken  together,  our  results  suggest  astrocytes¬ 
like  U87  cells  changed  their  cell  shape  and  morphology 
when  cultured  under  serum-free  media  with  and  without 
drug  treatment.  Those  morphological  changes  correlated 
with  upregulation  of  GFAP  in  such  cells. 


10% 


10%+BSO 


SF 


SF+BSO 


Treatment  with  SF  medium  induced  U87  cells  to 
put  out  multipolar  processes  and  the  other  treatments 
accentuated  this  effect  (Fig.  2).  Clearly,  these  observations 
raise  interesting  mechanistic  questions  that  need  to  be 
addressed  further  (see  below). 

Glial  fibrillary  acid  protein  (GFAP)  is  a  well-known 
and  classical  marker  for  astrocytes:  its  altered  expression  is 
associated  with  changes  in  astroglial  morphology.  Thus,  we 


Figure.  2  Treatment-induced 
cellular  morphology  changes 
in  U87  cells  (lOOX 
magnification).  Top  panel  of 
photomicrographs  represents 
U87  cells  cultured  in  10% 
FBS  medium  treated  with  or 
without  drug  or  drug 
combination  while  those  of 
the  bottom  panel  represents 
U87  cells  cultured  in  serum- 
deprived  (SF)  medium 
treated  with  or  without  drug 
or  drug  combination. 


Moreover,  exposure  of  SK-N-SH  cells  to  various 
combinations  of  SF  media  allowed  them  to  survive  better 
than  when  cultured  in  10%  FBS  medium  (control  condition) 
alone  and  exposure  to  PZ  enhanced  this  protective  effect, 
even  under  conditions  of  oxidative  stress.  Thus,  our  results 
provide  additional  evidence  that  our  cell  model  can  be 
productively  employed  to  further  elucidate  the  putative 
neuroprotective  mechanisms  of  astrocytes.  As  such  they 
assume  pathophysiological  importance  in  neuronal 


survival/death  mechanisms  in  AD  and  PD.  Clearly,  this  is  an 
area  that  merits  further  study,  especially  in  tissue 
engineering  and  nanotoxicological  research  and  applications. 
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The  Effect  of  Different  Ratio  of  Regular  Ueclia  and  Conditioned  Media  on 
SK-N-SH  cells  with  and  without  BSO,  PZ,  and  BSO  PZ  in  24  hrs 
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Ligure  3.  Treatment  effects  on  SK-N-SH  cell  survival  with  different  regular/conditioned  media  combination  (see  Pig.  1).  SK-N- 
SH  cells  cultured  in  10%  PBS  served  as  the  control. 

Values  are  expressed  as  %  of  the  control  and  are  given  as  mean  ±  SEM  of  separate  determinations.  *p<0.05  versus  control. 
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ABSTRACT 

Chitosan  exhibits  antimicrobial  activities  through  its 
interaction(s)  with  microbial  cell  surface  thereby  altering  their 
gene  expression  and  cellular  function,  leading  to  cell  death. 
Nanometal  particles  exert  many  effects  not  previously 
expected  on  biological  systems  and  thus  can  be  explored  for 
diverse  biomedical  applications.  Our  previous  and  on-going 
studies  indicate  that  U87  cells  cultured  on  chitosan 
film/membrane  exhibited  significantly  slower  growth  and 
proliferation  kinetics  compared  to  U87  cells  cultured  alone.  In 
this  study  we  tested  the  hypothesis  that  the  inhibitory  effect  of 
chitosan  is  enhanced  if  combined  with  nanometals  and 
adriamycin,  a  common  anticancer  durg.  Our  results  showed 
that  combinations  of  metal  nanoparticles,  adriamycin  and 
chitosan  induced  decreased  survival  of  U87  glioma  cells  at 
different  rates,  more  marked  than  those  with  chitosan  alone. 
Thus,  our  results  have  pathophysiological  implications  in 
inhibiting  human  brain  glioma  invasion  and  migration. 

Key  words:  Chitosan,  nanoparticles,  adriamycin,  cancer 
therapy,  U87  cells 

1  INTRODUCTION 

Chitosan,  a  polysaccharide  biopolymer  that  combines  a 
unique  set  of  physicochemical  and  biological  properties  has 
increasingly  gained  popularity  in  biomedical  applications  [1, 
2].  Our  previous  and  on-going  studies  indicate  that  U87  cells 
(human  brain  glioblastoma  cell  line)  cultured  on  chitosan 
film/membrane  exhibite  significantly  slower  growth  and 
proliferation  kinetics  compared  to  U87  cells  cultured  in  the 
absence  of  chitosan  film/membrane  [3].  Chitosan  exhibits 
antimicrobial  activities  through  its  interaction(s)  with 
microbial  cell  surface  thereby  altering  their  gene  expression 
and  cellular  function  and  leading  to  cell  death  [4] . 


Nanometal  particles,  such  as  nanosilver,  nanogold,  are 
important  material  being  utilized  frequently.  Recent  studies  of 
nanometal  particles  have  revealed  many  properties  that  were 
not  previously  expected  in  biological  systems  and  thus  can  be 
explored  for  various  applications  in  biomedicine,  such  as 
tissue  engineering  [5]  and  wound  dressing  [6]. 

In  this  study,  we  hypothesized  that  the  inhibitory  effect  of 
chitosan  would  be  greatly  modulated  if  we  combine  chitosan 
with  nanometals  and  adriamycin,  a  common  drug  for  cancer 
therapy.  Similar  treatments  with  a  different  cancer  (PANC-1, 
human  pancreatic  cancer  cell  line)  and  normal  cells  (BJ, 
human  fibroblast  cell  line)  were  also  used  to  investigate  this 
hypothesis. 

2  MATERIALS  AND  METHODS 

2.1  Materials 

Human  astrocytoma  (astrocytes -like)  U87  cells,  human 
pancreatic  PANC-1  cells  and  human  fibroblast  BJ  cells  were 
obtained  from  ATCC  (Manassas,VA,  USA).  Chitosan  (from 
crab  shells,  minimum  85%  deacetylated),  thiazolyl  blue 
tetrazolium  bromide  (MTT),  dimethyl  sulfoxide  (DMSO)  and 
adriamycin  were  purchased  from  Sigma-Aldrich  (St  Louis, 
MO,  USA).  Fetal  bovine  serum  (FBS)  was  obtained  from 
Atlanta  Biologicals  (Lawrenceville,  GA,  USA), 
tetrachloroauric  (III)  acid  (HAuCl4*3H20),  trisodium  citrate 
(C6H5Na307*2H20)  and  silver  nitrate  (AgNOa)  were 
purchased  from  Fisher  Scientific  (Pittsburgh,  PA,  USA). 
Other  chemicals  were  of  analytical  grade  and  were  usually 
from  Sigma-Aldrich  (St.  Louis,  MO,  USA)  unless  otherwise 
stated. 

2.2  The  Preparation  of  Nanosilver,  Nanogold 
Particles 


To  prepare  nanosilver,  AgNOs  and  C6H5Na307 *21120 
solutions  were  filtered  through  a  0.22  pm  microporous 
membrane  filter,  and  nanosilver  was  prepared  according  to 
the  literature  [7]  by  adding  C6H5Na307*2H20  solution  to 
boiling  AgN03  aqueous  solution. 

To  prepare  nanogold,  HAuCl4*3H20  and 
C6H5Na307*2H20  solutions  also  need  to  be  filtered  through  a 
0.22  pm  microporous  membrane  filter  prior  to  use.  Nanogold 
was  prepared  according  to  the  literature  [8]  by  adding 
C6H5Na307*2H20  solution  to  boiling  HAuCl4*3H20  aqueous 
solution. 

2.3  Cell  Culture 

Chitosan  membrane  was  prepared  as  described  previously 
[3].  A  certain  amount  of  nanosilver  or  nanogold  solution  was 
added  into  each  well  of  24-well  culture  plates  in  which  a 
sterile  chitosan  membrane  had  already  been  placed.  After  12 
hours,  nanosilver  or  nanogold  solution  was  aspirated  and 
sterile  phosphate-buffered  saline  (PBS)  was  added  into  each 
well  to  wash  the  membrane. 

U87  cells  were  seeded  with  equal  density  in  each  well  of 
the  24-well  plates  and  cultured  in  an  incubator  at  37°  C  and  5 
%  CO2  in  modified  Eagle’s  medium  (MEM)  supplemented 
with  10%  fetal  bovine  serum  (EBS).  Adriamycin  with  a  final 
concentration  of  0.1  pm  was  added  after  cells  were  seeded. 
Culture  of  PANC-1  cells  and  BJ  cells  were  similar  with  U87 
cells  whereas  PANC-1  cells  were  grown  in  the  RPMI  1640 
medium. 

2.4  MTT  Assay 


absorbance  of  the  content  of  each  well  was  measured  at  570 
nm  using  a  Bio-Tek  Synergy  HT  Plate  Reader  (Winooski, 
VT,  USA)  [10]. 

2.5  Statistical  Analysis  of  Data 

Results  are  presented  as  mean  ±  standard  error  of  the 
mean  (S.E.M.)  of  6  determinations  in  each  experiment. 

3  RESULTS  AND  DISCUSSION 

As  shown  in  Eigure  1,  all  the  treatments  induced 
decrease  in  cell  survival  of  U87  cells.  There  were  apparent 
differences  in  the  effects  exerted  by  different  treatments. 
After  being  treated  for  14  days,  chitosan  with  naosilver  and 
0.1  pm  adriamycin  was  the  most  effective.  This  may  enable 
lower  doses  of  adriamycin  to  be  used,  with  reduced  toxicity. 
Chitosan  with  nanogold  and  0.1pm  adriamycin  was  the 
second  most  effective;  chitosan  alone  was  the  least  effective. 
Chitosan  with  nanosilver  showed  greater  effect  than  chitosan 
with  nanogold.  Therefore,  these  results  provided  some 
support  for  our  hypothesis  that  a  combination  of  chitosan  with 
nanometals  and  adriamycin  was  more  effective  than  chitosan 
or  adriamycin  alone  or  chitosan  with  nanometals. 

As  shown  in  Eigure  2,  all  the  treatments  showed  an 
inhibitory  effect  on  cell  survival  of  PANC-1  cells.  Similarly, 
after  being  treated  for  14  days,  chitosan  with  nanosilver  and 
0.1  pm  adriamycin  was  the  most  effective;  chitosan  alone  was 
the  least  effective.  However,  the  effect  was  stronger  on 
PANC-1  cells  than  on  U87  cells.  Compared  with  U87  cells, 
PANC-1  cells  were  considerably  more  sensitive  to  the  effects 
of  adriamycin  alone. 


Cell  survival  and  growth  was  determined  using  the  MTT 
assay  [9].  Cells  (U87,  PANC-1,  and  BJ)  were  cultured  in  24- 
well  plates  as  described  in  the  preceding  subsection.  At  the 
end  of  the  incubation  period  (4,  7,  10,  or  14  days),  MTT  dye 
(0.5%,  w/v,  in  PBS)  was  added  to  each  well  and  the  plates 
were  incubated  for  an  additional  4  hours  at  37 °C.  The  purple- 
colored  insoluble  formazan  crystals  in  viable  cells  were 
dissolved  using  dimethyl  sulfoxide,  and  the  subsequent 


Eigure  3  showed  the  effect  of  different  treatments  on 
the  survival  of  BJ  cells.  Chitosan  with  nanosilver  and  0.1  pm 
adriamycin  was  the  most  effective,  the  same  as  U87  cells  and 
PANC-1  cells.  By  day  14,  however,  there  was  no  significant 
difference  in  the  survival  rate  of  cells  treated  with  chitosan 
alone  and  chitosan  with  nanogold  and  untreated  (control). 


Eigure  1 :  Effect  of  chitosan,  chitosan/nanosilver, 
chitosan/nanogold  and  adriamycin  on  survival  of 
U87  cells.  Red  circles:  chitosan;  Black  cross 
signs:  chitosan  with  nanogold;  Blue  squares:  0.1 
pm  adriamycin;  Green  squares:  chitosan  with  0.1 
pm  adriamycin;  Red  plus  signs:  chitosan  with 
nanosilver;  Blue  triangles:  chitosan  with 
nanogold  and  adriamycin;  Dark  green  circles: 
chitosan  with  nanosilver  and  0.1  pm  adriamycin. 
At  the  end  of  the  specified  incubation  time,  cell 
survival  and  growth  was  determined  using  the 
MTT  assay.  Values  are  the  mean  ±  SEM. 
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Figure  2:  Effect  of  chitosan,  chitosan/nanosilver, 
chitosan/nanogold  and  adriamycin  on  survival  of 
PANC-1  cells.  Red  circles:  chitosan;  Black  cross 
signs:  chitosan  with  nanogold;  Blue  triangles: 
chitosan  with  nanogold  and  adriamycin;  Green 
squares:  chitosan  with  0.1  qm  adriamycin;  Blue 
squares:  0.1  qm  adriamycin;  Red  plus  signs: 
chitosan  with  nanosilver;  Dark  green  circles: 
chitosan  with  nanosilver  and  0.1  qm  adriamycin. 
At  the  end  of  the  specified  incubation  time,  cell 
survival  and  growth  was  determined  using  the 
MTT  assay.  Values  are  the  mean  ±  SEM. 
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Eigure  3:  Effect  of  chitosan,  chitosan/nanosilver, 
chitosan/nanogold  and  adriamycin  on  survival  of 
BJ  cells.  Red  circles:  chitosan;  Black  cross  signs: 
chitosan  with  nanogold;  Blue  squares:  0.1  qm 
adriamycin;  Blue  triangles:  chitosan  with 
nanogold  and  adriamycin;  Green  squares: 
chitosan  with  0.1  qm  adriamycin;  Red  plus 
signs:  chitosan  with  nanosilver;  Dark  green 
circles:  chitosan  with  nanosilver  and  0.1  qm 
adriamycin.  At  the  end  of  the  specified 
incubation  time,  cell  survival  and  growth  was 
determined  using  the  MTT  assay.  Values  are  the 
mean  ±  SEM. 


Our  previous  and  ongoing  studies 
demonstrate  that  combinations  of  metal 
nanoparticles,  adriamycin  and  chitosan  induced 
cell  death  at  different  rates,  with  reference  to 
U87  cells  cultured  in  the  absence  of  chitosan  and 
with  chitosan  alone.  Chitosan  with  nanosilver 
and  0.1  qm  adriamycin  showed  the  greatest  cell 
survival  reduction  on  all  three  cell  lines. 
Chitosan  with  nanosilver  showed  greater  effect 
than  chitosan  with  nanogold.  Taken  together, 
these  results  suggest  potentials  for 
pathophysiological  applications  in  inhibition  of 
human  brain  glioma  migration  and  invasion  and 
in  treatment  of  pancreatic  cancer. 
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ABSTRACT 

In  our  previous  reports,  we  studied  the  development  of 
biosensor  platform  that  are  capable  of  measuring 
biometabolites  and  environmental  sensitive  species,  such  as 
peroxide  and  nitrate/nitrate,  to  concentration  in  the  order  of 
ppb  (parts  per  billion)  or  lower. 

In  our  more  recent  development,  we  modified  our  platform 
with  dendrimers  to  enhance  its  performance.  Zero  and 
second  generation  of  dendrimers  were  coated  on  the  surface 
of  a  carbon  glassy  platform  electrode  modified  with  GDH 
(glutamate  dehydrogenase)  and  it  was  used  to  measured 
ammonium,  a  common  biometabolite,  at  near  neutral  pH 
that  is  common  for  normal  bioactivities. 

The  resulting  electrode  was  tested  with  ammonium 
concentrations  ranged  from  0.002  to  0.3  pM  with 
satisfactory  results.  Measurements  at  lower  concentrations 
had  better  resolution  than  at  higher  concentrations  and  it  is 
believed  that  the  lower  concentration  limit  can  be  better 
than  the  tested  lower  limit  at  0.002  pM.  Performance  of  the 
modified  carbon  glassy  electrode  was  compared  with  other 
glassy  electrodes  that  were  modified  differently,  and  the 
results  will  be  reported. 

The  biosensor  platform  thus  far  was  proven  to  be  versatile 
and  can  be  used  in  many  biomedical  and  environmental 
applications. 


Key  words:  biosensor,  nanoparticle,  GDH, 
ammonium,  electrode,  PAMAM 

1  INTRODUCTION 


In  the  past  several  years,  our  research  group  has  been 
developing  a  platform  for  biosensor  construction  that  are 
capable  of  detecting  target  species  that  are  in  nano  and 
subnanomolar  levels  [1,2]. 

In  this  study,  we  were  developing  a  biosensor  that  can 
measure  ammonia  at  submicromolar  levels  that  cannot  be 
detected  by  commercial  ammonia  electrodes  or  wet 
chemistry  method  easily. 


1.1  Theory 

As  shown  in  the  following  equation,  glutamate  and 
NAD^  can  be  hydrolyzed  to  form  a-keto  glutarate,  NADH, 
and  ammonium  ion  with  the  enzyme,  glutamate 
dehydrogenase.  The  equilibrium  constant  is  in  favor  of  the 
formation  of  glutamate  and  thus  the  reverse  reaction  is 
faster  kinetically. 
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For  many  biological  reactions,  the  end  product  or 
metabolite  is  ammonium,  accumulation  of  high 
concentration  of  ammonium  is  toxic  to  the  body. 
Environmentally,  ammonium  is  a  byproduct  of  many 
industrial  processes,  uncontrolled  discharges  of  ammonium 
will  lead  to  harmful  consequence  to  the  environment.  Our 
goal  here  was  to  develop  a  sensor  device  that  can  measure 
ammonium  ion  at  the  lowest  concentrations  possible,  its 
utilities  can  be  in  biomedical  or  environmental  applications. 
Hence,  it  is  the  reverse  of  the  reaction  as  shown  above 
(glutamate  formation)  that  we  utilized. 


2  MATERIALS  AND  METHODS 

2.1  Materials 

L-glutamic  dehydrogenase  (from  bovine  liver,  solution 
in  50%  glycerol)  (GDH)  was  purchased  from  Sigma- 
Aldrich  (St.  Louis,  MO,  USA),  the  concentration  of  GDH  is 
28  mg  protein/ml,  and  46  units/mg.  Cysteamine, 
polyamidoamine  dendrimer  generation  0  (PAMAM_0), 
polyamidoamine  dendrimer  generation  2^^  (PAMAM_2^^), 
and  a-keto  glutarate,  AuCl3HCl-4H20  (Au  %>  48%)  and 
Nascitrate  were  purchased  from  Sigma.  All  the  other 
chemicals  were  of  analytical  grade  or  highest  grade 
available.  All  the  experiments  were  carried  out  under 
deoxygenated  condition  in  0. 1  M  phosphate  buffer  solution. 

2.2  Electrode  Preparation 

The  cleaned  glassy  carbon  electrode  was  first  immersed 
in  0.1  M  cysteamine  solution  in  darkness.  The  resulting 
monolayer-modified  electrode  was  rinsed  thoroughly  with 
twice-distilled  water  and  soaked  in  water.  Then,  it  was 
dipped  into  the  colloidal  gold.  The  gold  colloid- 
cysteamine-modified  electrode  was  dipped  into  the  1- 
glutamate  dehydrogenase  (GDH)  solution  (pH  7.4)  (or 
GDH  solution  containing  NADH).  In  such  a  way,  a  GDH 
(/NADH)  gold  colloid-cysteamine-modified  glassy  carbon 
electrode  was  obtained. 

In  case  that  both  cysteamine  and  PAMAM  were  coated 
onto  electrodes,  the  cleaned  glassy  carbon  electrode  was 
first  immersed  in  cysteamine  solution,  the  resulting 
electrode  was  dipped  into  the  PAMAM  solution.  The  gold 
colloid-cysteamine/PAMAM-modified  electrode  was 
dipped  into  the  GDH  solution  (pH  7.4)  (or  GDH  solution 
containing  NADH).  In  such  a  way,  a  GDH  (/NADH)  gold 
colloid-cysteamine/PAMAM-modified  glassy  carbon 
electrode  was  obtained. 

2.3  Nanoparticles  Solution  Preparations 

Nanoparticles  Au  was  prepared  by  reacting  HAuCU 
with  citric  acid  [2]. 

2.4  Detections 

UV-VIS  spectrophotometry  was  carried  out  by  an 
Agilent  diodearray  spectrophotometer;  cyclic  voltammetry 
was  conducted  by  using  a  Gamry  600  Potentiostat. 
Voltammetric  potential  was  measured  against  a  saturated 
chloride  electrode  (SCE). 


Figure  1.  Cysteamine-PAMAM-Au-GDH  coated  on  plastic 
UV-VIS  cell  with  permanent  absorption  peak  at  278  nm. 
Various  lines  indicated  concentration  differences. 


As  shown  in  Figure  1,  PAMAMs  can  be  attached  to 
cysteamine  to  enhance  the  available  sites  for  the  electrons 
transfer  between  reactions,  in  this  case,  ammonium  and  a- 
keto  glutarate,  therefore  increase  the  detection  lower  limit. 


Figure  2.  Cyclic  voltammograms  (i/v)  of  gold  colloid- 
cysteamine/PAMAM_2^^-modified  glassy  carbon  electrode 
measured  from-0.2  to  0.4  V  for  the  measurement  of  NH4^, 
the  lowest  concentration  was  2  nM. 

Figure  2  shows  the  cyclic  voltammograms  of  various 
ammonium  concentrations  measured  by  the  modified  glassy 
carbon  electrode,  the  lowest  concentration  was  2  nM.  As 
indicated  in  the  voltammogram  in  the  reductive  curves 
(upper  lines),  there  was  a  big  gap  (current  difference) 
between  the  blank  (of  buffer  solution)  and  the  first 
reductive  curve  (2  nM).  Therefore,  it  is  possible  that  the 
modified  electrode  can  measure  ammonium  concentrations 
down  to  subnanomolar  levels. 
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3  RESULTS  AND  DISCUSSION 
3.1  Stability  of  Electrodes 


Figure  3.  Performance  differences  of  the  glassy  carbon 
electrode  modified  by  different  materials:  1 .  Modified  with 
cysteamine- Au-GDH/NADH;  2.  Cysteamine  /PAMAM  O- 
Au-GDH/NADH;  3.  P  AM  AMO- Au-GDH/NADH;  4. 
Cysteamine  /PAMAM_2^^- Au-GDH/NADH;  5. 
PAMAM_2^^  -Au-GDH/NADH. 

Figure  3  shows  that  there  were  distinctive  current 
differences  for  the  reaction  of  ammonium  and  a-keto 
glutarate  when  the  electrode  was  modified  by  different 


materials.  From  the  stand  point  of  detection,  within  the  five 
modifications,  sensor  coated  with  second  generation  of 
PAM  AM  would  have  the  highest  sensitivity  (current  vs. 
concentration).  The  results  were  conceivably  due  to  the 
higher  branching  property  of  PAMAM_2^^. 

4  CONCLUSIONS 

We  successfully  modified  our  glassy  carbon  electrode 
biosensor  platform  [2]  for  ammonium  detection;  we  further 
modified  the  sensor  platform  with  PAMAMs  and  the 
detection  lower  limit  was  enhanced.  This  highly  modified 
electrode  can  detect  ammonium  concentrations  down  to  2 
nM,  or  lower.  The  low  detection  limit  of  this  biosensor  is 
far  more  superior  to  most  available  methods,  more  research 
is  needed  for  noise  reduction  and  the  stability  of  the 
electrode. 
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Abstract.  Lifelong  exposure  to  environmental  factors  can  influence  the  risk  of  developing  diseases  according  to  recent  research 
findings.  Environmental  stresses  ultimately  leading  to  neuronal  cell  death  have  been  hypothesized  as  the  causes  of  the  increased 
occurrence  in  developing  Alzheimer’s  and  Parkinson’s  disease.  Our  daily  diet  is  considered  to  be  one  of  the  most  important 
environmental  factors  that  can  seriously  affect  the  development  and  proper  functions  of  the  brain.  Depending  on  the 
concentrations,  metals  and  electrolytes  can  post  some  health  concerns,  especially  for  a  prolonged  consumption  period.  For 
example,  it  was  reported  that  excess  amounts  of  iron,  zinc  and  copper  in  the  human  brain  may  cause  oxidative  damage  and 
protein  aggregation;  the  neurotoxicity  induced  by  these  metals  may  lead  to  cerebral  and/or  cerebellar  degeneration.  Other  reports 
showed  that  there  were  differences  in  concentrations  of  five  different  elements  (aluminum,  zinc,  copper,  manganese,  and  iron) 
between  normal  human  brain  and  brains  of  patients  with  Alzheimer’s  disease.  In  this  study,  we  investigated  30  elements, 
including  electrolytes,  and  how  dietary  intake  on  a  life-time  basis  would  affect  their  concentrations  and  distributions  in  various 
regions  of  the  rat  brain  (hypothalamus,  cerebellum,  pons  and  medulla,  striatum,  mid-brain,  cerebral  cortex,  and  hippocampus) 
and  discussed  their  health  implications.  Information  matrices  of  these  30  different  elements  (mostly  metals)  and  their 
distributions  in  various  regions  of  the  rat  brain  were  analyzed  as  a  function  of  normal  dietary  intake  at  different  ages  during 
development.  Our  results  showed  that  metallomic  distribution  in  various  regions  of  the  rat  brain  is  age-related.  The  results  may 
help  researchers  to  identify  possible  links  between  daily  dietary  intake  of  metals  and  electrolytes  and  diseases  associated  with 
aging  (e.g.,  Alzheimer’s  and  Parkinson’s  disease)  and  suggest  such  metallomic  distributions  may  be  used  as  neurological 
biomarkers  of  exposure  to  heavy  metals. 

Key  words:  Brain;  elements;  metals;  electrolytes;  distribution;  metallomic;  neurological;  diseases 


1.  Introduction 

Many  of  the  metals  around  us  are  essential  for  life,  but  others  are  known  to  be  highly  toxic;  even  the  essential 
metals  can  be  toxic  when  their  intakes  are  too  high.  For  example,  metals  such  as  chromium,  cobalt,  copper, 
manganese,  and  zinc  are  essential  for  life.  But,  an  excess  intake  of  these  essential  metals  can  induce  toxicity.  Some 
metals  such  as  arsenic,  cadmium,  lead,  mercury,  and  vanadium,  which  are  found  throughout  our  environment,  are 
toxic  to  humans  and  other  animals.  Some  of  these  toxic  metals  are  even  capable  of  forming  covalent  bonds  with 
carbon,  resulting  in  metal-organic  transformations.  This  type  of  transformation  affects  the  mobility  and  toxicity  of 
the  element.  Elements  can  come  from  naturally -occurring  processes  such  as  volcanoes,  water,  bacterial  activity,  and 
also  from  anthropogenic  sources  such  as  automobile  exhaust,  agricultural  fertilizers,  industrial  activities,  and  many 
other  sources.  It  has  been  shown  that  in  highly  industrialized  areas,  the  exposure  to  metallic  elements  is  extremely 
high[l]. 

Being  a  specialized  organ  of  the  body,  the  brain  metabolizes  and  accumulates  metals  as  part  of  its  normal 
development  and  function.  But  in  a  rich  metal  environment,  loss  of  metalloproteins  and  loss  of  defense  against 
oxidative  stress  caused  by  one  or  more  of  the  heavy  metals  could  be  responsible  for  neurodegenerative  disorders 
such  as  Parkinson’s  disease  (PD)  and  Alzheimer’s  disease  (AD)  [2].  The  intake  of  these  metals  occurs  via  ingestion 


*  Solomon  W.  Leung.  Tel:  +1-208-282-2524;  fax:  +1-208-282-4538. 
E-mail  address:  leunsolo@isu.edu 


of  metal-containing  food  and  water,  and/or  through  inhaling  metal -contaminated  air.  The  elemental  distributions  in 
the  different  brain  regions  appear  to  vary  for  each  element.  Some  of  these  metallic  elements  are  known  to  increase 
or  decrease  in  brains  of  humans  with  a  neurodegenerative  disorder. 

The  following  are  some  of  the  more  studied  elements  in  brain;  other  elements  are  also  found  in  brain,  but 
research  on  the  latter  group  has  been  scant.  Although  many  metals  are  normally  found  in  brain,  over-accumulation 
of  metals  may  lead  to  health  problems.  Moreover,  an  unbalanced  increase  or  decrease  could  cause  a  major  functional 
change  and  lead  to  a  neurodegenerative  disorder  even  though  the  underlying  molecular  mechanisms  are  largely 
unknown. 

Aluminum 

Aluminum  (Al)  is  one  of  the  more  widely  distributed  metals  in  the  environment.  Approximately  8%  of  the  earth’s 
crust  is  Al.  The  exposure  of  Al  normally  occurs  through  air,  food,  and  water  [3].  The  brain  contains  approximately 
1%  of  the  body’s  total  Al;  however,  Al  has  no  known  function  in  normal  mammalian  brain. 

During  the  life-span  of  a  normal  human  brain,  its  Al  levels  appear  to  increase  around  age  40,  and  then  plateau  at 
about  age  70.  The  Al  levels  then  begin  to  increase  again  from  age  80  to  90.  The  globus  pallidus  (GP),  substantia 
nigra  (SN)  and  the  nucleus  ruber  appear  to  be  the  highest  Al  levels  in  the  normal  human  brain  [4] .  The  levels  of  Al 
increase  in  the  grey  matter  in  patients  with  dialysis  encephalopathy  [5].  Also,  Al  accumulations  in  the  brain  have 
been  found  to  increase  in  patients  with  renal  failure.  Following  oral  exposure  to  this  metal,  retention  of  Al  was 
reported  in  the  hippocampus.  This  region  of  the  brain  is  rich  in  cholinergic  neurons.  These  and  other  observations 
suggest  that  Al  has  neuro toxic  properties.  Furthermore,  following  chronic  exposure,  Al  has  been  shown  to 
accumulate  in  all  regions  of  the  rat  brain.  There  is  evidence  of  a  relationship  between  the  high  levels  of  Al  and 
increased  risk  of  neurodegenerative  disorders,  including  AD  and  PD  [3]. 

Calcium 

Calcium  (Ca)  is  the  fifth  most  abundant  element  found  in  the  earth’s  crust.  Ca  occurs  most  commonly  in 
sedimentary  rocks  in  the  minerals  calcite,  dolomite,  and  gypsum.  Ca  is  essential  for  life  in  most  living  organisms, 
including  humans.  Ca  has  been  shown  to  be  elevated  in  the  brains  of  patients  with  AD:  it  concentrates  in  the 
amyloid  plaques.  These  plaques  are  one  of  the  neuropathological  hallmarks  of  AD.  However,  PSAPP  mice  (a 
mouse  model  of  AD)  appear  to  accumulate  less  Ca  in  their  plaques  compared  to  their  surrounding  brain  tissue  [6]. 

Chromium 

Chromium  (Cr)  is  also  found  in  the  earth’s  crust  and  is  mined  as  chromite  ore.  Because  of  chromium’s  high 
corrosion  resistance  and  hardness,  it  is  added  to  nickel  to  create  stainless  steel:  this  is  the  most  common  application 
of  Cr.  It  is  also  used  in  dyes  and  pigments,  as  a  gasoline  additive,  and  in  the  tanning  of  leather.  The 
pathophysiological  role  of  Cr  has  not  been  elucidated.  However,  Cr  has  been  shown  to  moderately  increase  in  the 
parietal  cortex  of  patients  with  AD  when  compared  to  that  in  normal  brain  [7]. 

Copper 

Copper  (Cu),  like  most  elements,  is  mined  from  the  earth’s  crust.  Furthermore,  Cu  is  recycled.  Cu  is  commonly 
used  in  electrical  applications,  piping,  many  household  products  (e.g.,  sinks,  plumbing,  pots),  architectural 
applications,  coin-making,  and  chemical  applications.  Cu  has  been  found  to  be  vital  in  human  and  plant  life.  Cu  is 
introduced  into  the  body  mostly  via  food  intake.  Some  foods  that  are  high  in  Cu  are  oysters,  beef  or  lamb  liver, 
Brazil  nuts,  cocoa,  black  pepper,  lobster,  sunflower  seeds,  green  olives,  avocados,  and  wheat  bran.  The  brain 
contains  approximately  7.3%  of  the  total  body  Cu  supply. 

Cu  has  been  an  extensively  studied  metal  in  the  brain  [8].  In  a  normal  brain,  Cu  is  distributed  in  similar  ways  in 
the  central  and  subcortical  white  matter  of  the  cerebellum  of  both  young  and  old  brains;  however,  the  periphery  of 
the  dentate  nucleus  is  rich  in  Cu  [2] .  The  higher  Cu  concentrations  are  mostly  found  in  the  cortex  and  hippocampus 
[8].  A  normal  aging  brain  has  been  shown  to  have  increased  Cu  levels,  especially  in  the  substantia  nigra  and  in 
some  cerebellar  regions  [4].  However,  when  the  levels  of  Cu  in  the  cortex  and  hippocampus  increase,  Wilson’s 
disease  is  said  to  result  [9].  In  AD,  there  is  an  abnormal  brain  Cu  distribution,  with  large  amounts  in  the  amyloid 
plaques  but  a  deficiency  in  the  neighboring  brain  tissue.  Other  researchers  also  reported  Cu  to  increase  in  the  senile 
plaques  [4] .  These  findings  suggest  the  involvement  of  Cu  in  AD  is  multifactorial  and  complex. 

Iron 

Iron  (Fe)  is  one  of  the  most  common  metals  found  in  everyday  use.  Fe  makes  up  about  5%  of  the  earth’s  crust. 
The  earth’s  core  is  believed  to  consist  largely  of  an  iron-nickel  alloy  constituting  35%  of  the  mass  of  the  earth  as  a 
whole.  Because  of  this  distribution,  Fe  is  thought  to  be  the  most  abundant  element  on  earth.  Some  popular  food 
stuffs  rich  in  Fe  include  red  meat,  fish,  poultry,  beans,  vegetables,  black-eye  peas,  wheat,  and  cereals. 


Fe  is  another  extensively  studied  metal  in  brain.  Fe  is  necessary  for  normal  brain  function  (e.g.,  in  learning  and 
memory)  [10].  In  a  normal  brain,  Fe  is  distributed  in  similar  ways  in  central  and  subcortical  white  matter  of  the 
cerebellum  of  both  young  and  old  brains;  in  the  cerebellar  cortex,  there  are  high  Fe  levels,  and  the  periphery  of  the 
dentate  nucleus  is  also  rich  in  Fe  [2] .  Fe  appears  to  increase  rapidly  in  the  young  brain  and  then  remains  stable  until 
the  later  years;  increases  in  Fe  in  the  substantia  nigra  and  globus  pallidus  have  been  reported  [4].  Regions  where 
brain  Fe  is  high  include  substantia  nigra,  globus  pallidus,  red  nucleus,  caudate  nucleus,  and  the  putamen  [11]. 

Like  Cu  and  Ca,  Fe  has  been  shown  to  be  elevated  in  brains  of  patients  with  AD.  Elevated  Fe  is  found  in  the 
amyloid  plaques  [6].  Fe  is  also  moderately  increased  in  the  parietal  cortex  in  AD  patients  [7].  In  patients  with 
Attention  Deficit  Hyperactivity  Disorder  (ADHD),  Fe  has  been  shown  to  increase  in  the  substantia  nigra  [12]. 

Manganese 

Manganese  (Mn)  is  found  in  the  earth’s  crust  and  in  seawater.  It  is  often  found  with  Fe.  Some  of  the  more 
common  usages  of  Mn  are  in  steel,  aluminum  alloys,  alkaline  batteries,  coins,  and  pigments.  Some  popular  foods 
that  contain  Mn  include  tea,  spinach,  grains,  rice,  eggs,  nuts,  olive  oil,  green  beans,  and  fish. 

The  majority  of  the  human  body’s  Mn  is  found  in  liver  and  kidneys;  nevertheless,  Mn  is  an  important  element  for 
normal  brain  development  and  function  [13].  In  the  aging  brain,  Mn  has  been  shown  to  redistribute  itself  in 
different  brain  regions,  including  hypothalamus,  thalamus,  and  corpus  callosum  [4].  High  brain  Mn  concentrations 
are  related  to  PD.  There  has  been  much  research  indicating  that  human  striatum,  globus  pallidus,  and  substantia 
nigra  show  increases  in  Mn  levels  and  are  thought  to  be  target  sites  for  Mn  neurotoxicity.  The  globus  pallidus  and 
pituitary  glands  are  other  regions  where  Mn  preferentially  accumulates.  High  exposures  to  Mn  result  in  increases  in 
Mn  in  the  olfactory  epithelium  and  olfactory  bulb  [14].  It  is  noteworthy  that  Mn  levels  in  the  cerebellum  are  similar 
in  AD  and  normal  brains  while  Mn  increases  in  the  parietal  cortex  of  AD  brains  [7]. 

Magnesium 

Magnesium  (Mg)  is  the  8*  most  abundant  element  in  the  earth’s  crust  and  in  found  also  in  seawater.  Mg  is 
commonly  used  in  structural  building  materials,  automotive  parts,  electronic  devices,  aerospace  construction, 
photography,  and  fireworks.  Mg  is  an  essential  metal  in  human  and  plant  life  [13].  Human  Mg  deficiency  has  been 
linked  to  the  development  of  asthma,  ADHD,  and  osteoporosis.  Foods  that  are  high  in  Mg  include  spices,  nuts, 
cereals,  coffee,  cocoa,  tea,  and  vegetables.  In  neurodegenerative  disorders  such  as  AD  and  PD,  Mg  does  not  appear 
to  play  a  major  role.  For  example.  Mg  levels  in  the  cerebellum  and  parietal  cortex  do  not  differ  between  patients 
with  AD  and  normal  humans  [7]. 

Mercury 

Mercury  (Hg)  is  found  in  deposits  throughout  the  world,  mostly  as  cinnabar  (a  common  ore  of  Hg).  The  more 
common  uses  of  Hg  are  in  barometers,  thermometers,  dental  products  (e.g.,  fillings),  and  electrical  equipment  (e.g., 
computers,  telephones,  etc.)  [15].  Exposures  to  Hg  most  commonly  occur  from  the  consumption  of  marine  species 
[1].  Other  exposures  to  Hg  may  be  from  exhaust  of  coal -burning  power  plants,  cement  production,  batteries,  and 
gold  production.  The  role  of  Hg  in  neurological  diseases  such  as  AD  and  PD  has  been  controversial.  Hg  can  cross 
the  blood-brain  and  blood-placental  barriers.  It  is  then  retained  by  the  brain  for  years  [16].  Hg  tends  to  accumulate 
in  lipid-rich  regions  of  the  brain.  Human  exposure  to  Hg  usually  results  in  kidney  and  neurological  disorders  [15]. 

Potassium  &  Rubidium 

Potassium  (K)  occurs  in  nature  as  an  ionic  salt  and  is  essential  for  humans  and  other  animals.  It  is  found 
dissolved  in  seawater  and  in  other  minerals.  Some  common  food  sources  of  K  include  orange  juice,  potatoes, 
bananas,  avocados,  tomatoes,  broccoli,  apricots,  and  many  other  fruits. 

Rubidium  (Rb)  is  not  essential  for  humans,  but  is  readily  taken  up  by  the  body.  It  is  found  commonly  mixed  in 
with  other  elements,  especially  K.  Rb  is  found  in  some  plants  as  well.  Some  common  uses  of  Rb  are  in  fireworks, 
lasers,  chemical  applications,  and  electronic  transmission.  Rb  is  found  in  come  brain  tumors. 

Exposure  to  K  and  Rb  is  not  known  to  cause  neurodegenerative  disorders.  Eor  example,  the  concentrations  of  K 
and  Rb  are  similar  between  AD  and  control  brains  [1;  7]. 

Sodium 

Sodium  (Na)  is  an  essential  element  for  humans  and  other  animals.  It  is  found  in  nature  as  a  compound  only;  the 
most  common  forms  are  salt  deposits.  The  most  common  form  of  Na  that  we  know  and  use  is  sodium  chloride, 
table  salt.  It  does  have  many  other  industrial  uses  as  well.  Over-  or  under-exposure  to  Na  has  not  been  shown  to 
cause  neurological  disorders.  Nevertheless,  Na  has  been  shown  to  increase  every  brain  region  in  AD  patients  [1]. 

Zinc 


Zinc  (Zn)  is  naturally  found  in  the  earth’s  crust  and  in  seawater.  It  is  normally  found  with  Fe  and  Cu  deposits. 
Zn  is  commonly  used  in  batteries,  production  of  brass,  bronze,  rubber,  in  pigments,  fire  retardant,  nuclear  weapons, 
automobile  engines,  and  agricultural  fungicides.  The  most  common  food  source  of  Zn  is  red  meats. 

Zn  is  another  essential  element  in  mammals.  Zn  is  distributed  in  similar  ways  in  the  central  and  subcortical  white 
matter  of  both  young  and  old  brains;  the  interior  of  the  dentate  nucleus  and  the  cerebellar  cortex  contain  high  levels 
of  Zn  [2].  The  regions  of  the  normal  brain  rich  in  Zn  include  the  hippocampus,  amygdala,  and  the  cortex.  As  the 
brain  ages,  its  Zn  distribution  changes,  just  in  the  regions  mentioned  above.  Nevertheless,  little  or  no  decrease  in 
brain  Zn  has  been  reported  in  aging  humans  or  rats  [4] .  Zn  is  found  to  be  elevated  in  human  amyloid  plaques  while 
PSAPP  mice  (an  AD  mouse  model  that  does  not  show  neurodegeneration)  only  had  a  29%  increase  of  Zn  in  their 
plaques  compared  to  the  Zn  in  brain  tissue  surrounding  the  plaques  [6] .  The  potential  role  of  Zn  as  a  cofactor  in  the 
pathogenesis  of  AD  was  strengthened  when  Zn  enrichment  was  found  in  senile  plaques  and  a  Zn  elevation  in  the 
neuropil  of  AD  patients  as  compared  to  those  in  control  individuals  [4] . 

Of  the  90  plus  naturally-occurring  elements,  26  are  known  to  be  essential  for  humans  and  animals  [17].  These 
consist  of  11  major  elements  or  macro -elements.  They  are:  C,  H,  O,  N,  S,  Ca,  P,  K,  Na,  Cl,  and  Mg.  Fifteen 
elements  are  known  as  trace  elements  or  micro -nutrients.  They  include:  Fe,  Zn,  Cu,  Mn,  Ni,  Co,  Mo,  Se,  Cr,  I,  F, 
Sn,  Si,  V,  and  As.  The  molecular  bases  for  the  essential  element  selection  and  rejection  have  not  been  elucidated, 
however.  Major  elements,  such  as  Na,  K,  Ca,  and  Mg,  are  required  for  bodily  functions  such  as  body  fluid  buffer, 
active  transport,  ionic  balance,  electrical  transmission,  tissue  development  as  well  as  the  composition  of  body  fluids 
and  structures.  Trace  elements  act  primarily  as  catalyst  in  enzyme  systems  in  cells  where  they  serve  a  wide  range  of 
functions  from  weak  ionic  effects  to  highly  specific  associations  such  as  metalloenzymes.  In  addition,  the  protein- 
metal  interactions  may  increase  the  stability  of  the  protein  moiety  to  metabolic  turnover. 

In  this  study,  we  investigated  30  elements  (including  electrolytes)  and  how  dietary  intake  on  a  life-time  basis 
would  affect  their  concentration  and  distribution  in  various  regions  of  the  rat  brain  (hypothalamus,  cerebellum,  pons 
and  medulla,  striatum,  mid-brain,  cerebral  cortex,  and  hippocampus)  and  discussed  their  health  implications.  The  30 
elements  of  interests  were:  Al,  As,  Ba,  Br,  Ca,  Cd,  Cl,  Co,  Cr,  Cu,  F,  Fe,  Hg,  I,  K,  La,  Mg,  Mn,  Mo,  Na,  Rb,  S,  Sb, 
Sc,  Se,  Si,  Sm,  Sr,  V,  and  Zn.  In  the  past,  research  has  primarily  focused  on  the  effects  of  different  elements  on  the 
brain  and  the  neurological  disorders  they  may  cause.  None  of  those  studies,  however,  have  examined 
simultaneously  as  many  elements  in  a  single  study  as  we  have  presented  here.  The  objective  of  this  paper  is  to 
characterize  the  levels  of  major  and  selected  trace  elements  in  various  regions  of  the  rat  brain  during  several  critical 
stages  of  development.  Because  during  the  first  8-9  days  of  age  postnatal,  the  rat  hippocampus  is  extremely  difficult 
to  visually  distinguish  from  the  overlying  cerebral  cortex,  we  had  included  the  hippocampus  tissue  together  with  the 
cerebral  cortex  for  analysis  in  the  case  of  5-day-old  tissue  samples.  The  four  postnatal  age  groups  of  rats  we  have 
studied  include  the  following: 

I.  5  days  old; 

II.  10  days  old; 

III.  22/23  days  old;  and 

IV.  120  days  old  (i.e.,  adult). 

While  humans  and  rats  are  not  identical  neurologically  and  physiologically,  there  are  more  similarities  between 
the  two  species  as  far  as  brain  structure  and  functions  are  concerned.  The  four  stages  of  the  postnatal  development 
of  the  rat  chosen  in  this  study  closely  parallel  the  postnatal  development  of  humans.  As  our  well  being  is  largely 
impacted  by  the  environment  we  are  living  in,  dietary  intake  is  definitely  a  major  factor  that  posts  a  long-term  effect 
on  our  health.  This  paper  provides  some  insight  into  how  our  diet  and  pollutants  in  our  diet  may  affect  our 
neurological  health.  Consequently,  our  experimental  results  may  allow  us  to  take  some  preventative  measures  in 
determining  how  best  to  optimize  and  gauge  our  dietary  intake  of  major  and  trace  elements  for  the  betterment  of  our 
health. 

2.  Experimental  Methods 

Wistar  rats  of  the  Portion  strain  (Animal  Breeding  Unit,  Carshalton,  Surrey,  U.K.)  bred  in  the  Institute  of 
Neurology,  University  of  London,  U.K.  were  used.  All  animals  were  kept  on  a  12-hour  light/I2-hour  dark  cycle 
with  free  access  to  food  and  water.  Elemental  concentrations  in  the  rat  food  pellets  had  been  determined  (Table  I 
below). 


Table  1 .  Elemental  Concentration  of  rat  food  pellet. 


Element 

Concentration  (in  mg/g) 

Ca 

6.39  +  1.68 

Cl 

2.31+0.49 

Fe 

0.25  +  0.05 

K 

5.36  +  0.95 

Mg 

1.17  +  0.32 

Na 

1.48  +  0.32 

Concentration  (in  |ag/g) 

Al 

98.06+  8.05 

Br 

10.57  +  2.26 

Co 

0.20  +  0.04 

Cr 

1.50  +  0.44 

Cu 

7.21+2.12 

F 

ND(5.00) 

Hg 

ND  (0.25) 

I 

ND  (0.50) 

Mn 

49.34  +  8.65 

Mo 

2.80  +  0.45 

Se 

ND  (0.25) 

Rb 

12.73  +  2.61 

V 

ND  (0.50) 

Zn 

47.73+4.11 

Thirty  trace  and  major  elements  in  different  brain  regions  of  rats  at  the  four  different  age  groups  (i.e.,  I  through 
IV  as  defined  above)  were  analyzed  by  instrumental  neutron  activation  analysis  (INAA)  [18].  The  samples  were 
irradiated  by  thermal  neutrons  using  three  different  sets  of  conditions  depending  on  the  nuclear  characteristics  of  the 
elements  of  interest  [18].  Not  all  30  elements  were  reported  in  the  results  because  those  not  reported  herein  were 
either  below  the  detection  limits  of  our  INAA  technique  [18]  or  the  elements  were  not  retained  by  the  brain  tissue. 
All  values  listed  are  mean  ±  S.D.;  ND  =  not  detectable,  and  values  in  brackets  are  the  maximum  elemental 
concentrations  present  in  the  diet. 

As  already  noted  above,  in  age  group  I,  the  hippocampal  tissue  had  been  included  in  the  cerebral  cortex  and 
analyzed  as  such. 

All  the  standard  materials  and  samples  for  INAA  were  freeze-dried  and  pelleted.  Dried  samples  (rat  brain 
regions)  were  homogenized  using  a  Glen  Creston  polystyrene  ball-mill  and  pelleted.  Other  details  of  standard  and 
sample  preparations  were  as  described  previously  [18;  19]. 

Standards  and  samples  were  irradiated  in  a  100  KW  ‘Consort’  Reactor  Mark  II  at  the  Imperial  College  Reactor 
Centre.  Irradiated  standards  and  samples  were  then  analyzed  for  their  elemental  contents  by  gamma  ray 
spectrometry  using  various  Ge(Li)  detectors  and  ND6600  Multichannel  Analyzer  (Nuclear  Data  Inc.,  Schaumburg, 
Illinois,  USA).  Details  of  the  elemental  determinations  were  described  in  the  methodology  paper  by  Chan  et  al. 
(1983). 

All  laboratory  chemicals  used  were  of  analytical  grade  (BDH  Chemicals  Limited,  U.K.)  and  single  element 
standards  of  trace  elements  were  obtained  from  AAS  (Ventron  Division,  Limited,  U.K.);  other  elemental  standards 
for  F,  Cl,  Br,  and  P  were  obtained  from  Hopkin  and  Williams  Chemical  Ltd.,  U.K.  Water  for  solution  preparations 
and  feeding  was  double-distilled. 


3.  Results 


Cerebellum 

The  cerebellum  is  the  “cauliflower- shaped”  region  of  the  brain  located  in  the  lower  part  of  the  brain  next  to  the 
brain  stem.  The  cerebellum  controls  movement,  balance,  and  coordination.  More  recent  evidence  suggests  that  it 
plays  roles  in  regulations  of  emotions  and  memory  and  learning.  Figure  1  shows  the  elemental  distributions  in  the 
cerebellum  during  rat  postnatal  development. 

It  can  be  noted  from  Figure  1  that  the  levels  of  different  elements  generally  show  a  decreasing  trend  as  the 
cerebellum  develops  and  reaches  adulthood:  this  trend  may  reflect  the  gradual  closing  of  the  blood-brain  barrier 
between  age  10  days  through  weanling  and  beyond.  However,  research  on  elemental  distributions  in  cerebellum 
during  development  has  been  minimal:  some  of  the  more  studied  elements  include  magnesium,  rubidium,  and 
sodium. 

Magnesium  levels  in  the  parietal  cortex  in  AD  patients  do  not  differ  from  those  in  normal  controls  [7].  Similarly, 
rubidium  levels  in  AD  brains  do  not  differ  from  those  in  control  brains  [1].  Consequently,  the  age-related  changes 
in  magnesium  and  rubidium  levels  in  the  cerebellum  may  not  be  have  good  predictive  value  of  neurological  diseases 
in  later  life.  On  the  other  hand,  the  sodium  levels  in  the  rat  cerebellum  decreases  during  the  latter  half  of  postnatal 
development  as  they  approach  the  adult  level.  On  the  other  hand,  sodium  levels  in  every  regions  of  the  human  brain 
are  significantly  higher  in  the  AD  patients  than  those  in  control  subjects  [1].  These  results  taken  together  suggest 
that  dietary  intake  of  sodium  may  have  some  relevance  in  the  causation  and/or  progression  of  AD. 

Cerebral  Cortex 
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Fig.  1.  Element  Concentrations  of  Rat  Cerebellum  at  Different  Development  Stages. 
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Fig.  2.  Element  Concentration  of  Rat  Cerebral-Cortex  at  Different  Developmental  Stages 

The  cerebral  cortex  is  responsible  for  all  intellectual  and  other  higher  functions  such  as  thinking,  voluntary 
movements,  language,  reasoning,  and  perception.  Figure  2  shows  the  elemental  distributions  in  the  cerebral  cortex 
during  postnatal  development  till  adulthood.  It  can  be  gleaned  from  the  results  shown  in  Figure  2  that  on  average, 
about  half  of  the  concentrations  of  different  elements  increase  with  increasing  age  while  about  half  of  the  levels  of 
the  other  elements  decrease  as  age  advances  toward  adulthood. 

Several  elements  in  the  human  cerebral  cortex  have  received  more  attention  recently;  they  are  described  in 
further  details  in  the  following: 

Even  though  the  physiological  role  of  aluminum  (Al)  in  brain  has  not  been  identified,  it  is  accumulated  in  the 
cerebral  cortex  of  the  rat  as  it  matures  to  adulthood:  presumably,  this  accumulation  reflects  dietary  intake  (Figure  2). 
Consequently,  increasing  brain  accumulation  of  Al,  which  is  known  to  be  neurotoxic,  could  induce  neurological 
problem(s)  in  the  long  term.  For  example,  Al  shows  significantly  higher  level  in  the  parietal  cortex  in  AD  patients 
compared  to  those  in  control  individuals  [7].  Similarly,  Al  accumulation  in  brain  and  other  tissues,  including  bone, 
liver,  and  kidney,  has  also  been  shown  to  accompany  renal  failure  [3]. 

Calcium  (Ca)  levels  in  the  rat  cerebral  cortex  do  not  markedly  change  during  postnatal  development  (Figure  2). 
On  the  other  hand,  one  of  the  pathological  hallmarks  of  Alzheimer’s  disease  (AD)  is  the  accumulation  of  amyloid 
plaques  between  nerve  cells  (i.e.,  neurons)  in  different  parts  of  human  brain  including  cerebral  cortex.  Ca  levels  in 
human  amyloid  plaques  in  AD  are  elevated.  Consistent  with  the  latter  observation  is  the  finding  that,  in  PSAAP 
mice  (a  mouse  model  of  AD,  which  shows  plaques  but  little  neurodegeneration),  Ca  accumulation  in  their  plaques  is 
less  than  those  in  the  surrounding  brain  tissue  [6].  Consequently,  age-related  accumulation  of  Ca  in  this  brain  region 
could  potentially  serve  as  marker  for  the  likelihood  of  developing  neurodegeneration  as  age  advances. 

Chromium  (Cr)  shows  a  moderate  increase  in  parietal  cortex  of  AD  patients  compared  to  those  in  control  subjects 
[7].  In  rat  cerebral  cortex,  Cr  levels  increase  from  day  10  to  day  22/23  and  thereafter  decrease  as  adulthood  is 
reached  (Figure  2).  Nevertheless,  relations  between  brain  Cr  levels  and  neurological  diseases  have  not  been  firmly 
established. 


Copper  (Cu)  in  amyloid  plaques  in  AD  is  elevated  [4].  In  PSAAP  mice  (a  mouse  model  of  AD,  which  shows 
plaques  but  less  neurodegeneration)  Cu  accumulation  in  their  plaques  is  less  than  those  in  the  surrounding  brain 
tissue  [6].  Consequently,  increasing  Cu  accumulation  in  cerebral  cortex  as  age  advances  can  potentially  herald  the 
onset  of  neurological  problems. 

The  magnesium  (Mg)  levels  in  rat  cerebral  cortex  fluctuate  during  development  and  level  off  toward  adulthood 
(Figure  2).  Mg  levels  in  parietal  cortex  and  cerebellum  in  AD  patients  do  not  differ  from  those  in  control  subjects. 
Taken  together,  these  observations  suggest  Mg  to  be  more  predictor  of  neurological  problems  as  age  advances. 

Manganese  (Mn)  shows  significantly  higher  levels  in  the  parietal  cortex  of  AD  patients  compared  to  those  in 
control  subjects  [7].  However,  cerebellar  Mn  levels  in  AD  are  similar  to  those  in  control  subjects  [7].  Figure  2 
shows  that  Mn  levels  in  cerebral  cortex  of  the  rat  show  a  general  trend  of  decrease  as  its  age  increases.  Nonetheless, 
whether  this  is  a  generalized  trend  of  an  essential  element  remains  to  be  established. 

Potassium  (K)  concentrations  in  the  AD  brain  appear  to  be  similar  to  those  in  control  brain,  especially  in  the 
regions  examined  [1].  K  generally  shows  a  trend  of  age-related  increases  in  the  rat  cerebral  cortex  (Figure  2), 
perhaps  reflecting  increases  in  cellular  material  because  intracellular  K  is  higher  than  extracellular  K. 

Sodium  (Na)  levels  in  the  rat  cerebral  cortex  decrease  with  increasing  age  (Figure  2),  reflecting  the  closing  of  the 
blood-brain  barrier  thereby  excluding  the  entry  of  extracellular  Na  into  cells.  On  the  other  hand,  Na  levels  in  every 
region  of  the  AD  brain  are  higher  than  corresponding  levels  in  control  brain  [1].  Consequently,  age-related 
increases  in  brain  sodium  may  be  considered  at  least  a  partial  predictor  of  age-related  neurological  problems. 

Zinc  (Zn)  is  elevated  in  the  amyloid  plaques  in  AD  and  PSAPP  mice  (an  AD  mouse  model  that  shows  little  or  no 
neurodegeneration)  only  had  a  29%  increase  of  Zn  in  their  plaques  compared  to  the  Zn  in  brain  tissue  surrounding 
the  plaques  [6].  By  contrast,  Zn  levels  in  the  rat  cerebral  cortex  markedly  increase  between  age  22/23  days  and 
adulthood  suggesting  that  the  increase  is  associated  with  tissue  growth.  However,  the  increase  in  brain  Zn  during 
brain  aging  may  be  more  predictive  of  onset  and/or  presence  of  neurological  problems  [6] . 

Hippocampus 

The  hippocampus  is  located  deep  within  the  temporal  lobe  and  is  part  of  the  limbic  system.  This  brain  region  is 
responsible  for  learning  and  formation  of  long-term  memory.  Figure  3  shows  the  elemental  distributions  in  the  rat 
hippocampus  at  different  stages  during  postnatal  development.  We  discuss  below  the  elements  that  were 
emphasized  in  several  recent  reports. 

Following  oral  exposure  of  rats  to  aluminum  (Al),  its  retention  has  been  noted  in  the  hippocampus  as  occurs  in 
other  brain  regions:  rat  hippocampal  Al  levels  increase  markedly  after  10  days  of  age  (Figure  3).  In  patients  with 
PD,  elevated  Al  levels  have  been  found  in  several  brain  regions  including  the  hippocampus,  which  is  rich  in 
cholinergic  neurons  [3].  Consequently,  chronic  accumulation  of  Al  in  this  brain  region  over  a  life-span  may  lead  to 
the  development  of  neurodegenerative  diseases  such  as  PD  because  of  Al  is  known  to  be  neurotoxic. 

Potassium  (K)  levels  in  the  rat  hippocampus  increase  from  age  day  10  till  adulthood,  likely  reflecting  the  increase 
in  cellular  material  during  this  developmental  period  (Figure  3).  However,  in  the  brain  regions  examined  in  AD, 
brain  K  remains  essentially  unchanged  compared  with  corresponding  levels  in  control  subjects  [1],  suggesting  that 
brain  K  may  not  be  a  good  indicator  of  the  likelihood  of  developing  neurological  diseases  such  as  AD. 

Rubidium  (Rb)  levels  in  rat  hippocampus  fluctuate  between  age  day  10  and  adulthood  (Figure  3).  However,  Rb 
levels  in  the  AD  brain  do  not  differ  from  those  in  control  brain  [1]  suggesting  that  Rb  levels  in  brain  may  not  be  a 
good  predictor  neurodegenerative  diseases  such  as  AD. 

Sodium  (Na)  levels  in  the  rat  hippocampus  decrease  between  ages  day  10  and  day  22/23  and  level  off  at 
adulthood  (Figure  3).  However,  Na  levels  in  every  part  of  the  AD  brain  examined  are  higher  than  corresponding 
levels  in  the  control  brain  [1]. 

Hypothalamus 

The  hypothalamus  is  located  at  the  interior  of  the  brain  under  the  thalamus.  It  controls  body  temperature, 
emotion,  thirst,  hunger,  appetite,  digestion,  and  sleep.  Figure  4  shows  the  elemental  distributions  in  rat 
hypothalamus  in  the  four  developmental  stages  we  have  investigated.  Even  though  this  brain  region  is  known  to 
accumulate  a  variety  of  metals,  their  precise  functional  significance  remains  to  be  fully  elucidated.  Only  few 
functionally  important  changes  during  development  can  be  commented  on  (Figure  4). 

The  electrolytes  in  this  rat  brain  region  show  fluctuating  trends  in  the  four  age  groups  investigated,  partly 
reflecting  the  closing  of  the  blood-brain  barrier.  For  example,  sodium  (Na)  and  chlorine  (Cl)  levels  significant 
decrease  in  the  first  22/23  days  postnatal.  On  the  other  hand  potassium  (K)  levels  markedly  increase  between  day  5 
and  day  10  postnatal. 
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Fig.  4.  Element  Concentrations  of  Rat  Hypothalamus  at  Different  Developmental  Stages 


Although  they  show  some  age-related  fluctuations,  the  essential  trace  elements  copper  (Cu),  selenium  (Se),  and 
zinc  (Zn)  levels  in  the  rat  hypothalamus  significantly  increase  between  postnatal  age  5  and  adulthood  (Figure  4).  At 
present,  one  can  only  speculate  about  the  functional  significance  of  the  postnatal  increases  of  these  essential  metals 
in  the  rat  hypothalamus  because  of  the  absence  of  relevant  studies. 

Mid-Brain 

As  its  name  implies,  the  mid-brain  is  located  in  the  middle  of  the  brain  above  the  brain  stem.  The  mid-brain 
generally  acts  as  a  relay  station  for  both  sensory  and  spinal  cord  signals  and  passes  them  on  to  the  limbic  system  and 
the  cortical  areas.  Figure  5  shows  the  elemental  distributions  in  the  rat  mid-brain  in  the  four  age  groups  we  have 
investigated.  In  the  rat  mid-brain,  the  levels  of  both  major  and  trace  elements  studied  show  age-related  fluctuations 
that  differ  from  those  in  the  rat  cerebral  cortex  or  hippocampus.  However,  the  relevance  of  these  fluctuations  in  the 
mid-brain  to  neurological  diseases  remains  to  be  elucidated. 

Pons  and  Medulla 

Situated  immediately  below  the  mid-brain,  pons  and  medulla  constitute  the  brain  stem  which  is  connected  to  the 
spinal  cord.  Key  functions  of  pons  include  motor  control  and  sensory  analysis  and  signal  relay  between  the  mid- 
brain  and  spinal  cord.  The  medulla  is  known  to  be  responsible  for  maintaining  heart  and  breathing  rates.  Figure  6 
shows  the  elemental  distributions  in  the  rat  pons  and  medulla  in  the  four  age  groups  we  have  investigated.  Most 
major  and  trace  elements  show  age-related  decreases  in  their  levels  in  rat  pons  and  medulla  as  adulthood  approaches 
(Figure  6).  Overall,  the  accumulation  of  metals  in  this  brain  region  is  not  as  quantitatively  marked  as  those  in  the 
other  brain  regions,  possibly  due  to  the  fact  that  this  brain  region  is  full  of  fiber  tracts  rather  cell  bodies.  Moreover, 
the  physiological  significance  of  the  distributions  of  metals  in  this  brain  region  is  still  poorly  understood. 

Striatum 

The  striatum  constitutes  the  sub-cortical  parts  of  the  forebrain:  it  includes  the  substantia  nigra  and  the  globus 
pallidus.  Among  its  best  known  function  is  its  role  in  the  planning  and  modulation  of  movement  pathways  as  well 
as  roles  in  other  cognitive  functions.  Figure  7  shows  the  elemental  distributions  in  the  rat  striatum  in  the  four  age 
groups  we  have  investigated.  We  discuss  below  the  elements  that  were  emphasized  in  several  recent  reports. 


■ 

Al 

■ 

Br 

□ 

Co 

□ 

C' 

□ 

Cu 

□ 

F 

□ 

Hg 

□ 

I 

□ 

Mn 

□ 

Mo 

□ 

Rb 

■ 

Se 

□ 

V 

■ 

Zn 

<D 


(/) 

c 

_o 


o 

O 


CD 

E 

_g) 

LU 


-  2.5 


3.5 


-  1 


m 

CD 

3 

CD 


o 

o 


2  ^ 


1.5 


□ 

Ca 

■ 

Cl 

■ 

Fe 

■ 

K 

□ 

Mg 

□ 

Na 

0.5 


IV 


Fig.  5.  Element  Concentrations  of  Rat  Mid-Brain  at  Different  Developmental  Stages 
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Fig.  6.  Element  Concentrations  of  Rat  Pons  &  Medulla  at  Different  Developmental  Stages 
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Fig.  7.  Element  Concentrations  of  the  Striatum  Different  Developmental  Stages 


There  is  recent  evidence  that  iron  (Fe)  plays  a  role  in  the  consolidation  of  long-term  memory.  Brain  Fe 
distribution  overlaps  with  that  of  dopaminergic  neurons.  In  rodent  models  of  neurological  disorders,  Fe  levels  in  the 
substantia  nigra  and  basal  ganglia  increase.  Because  of  those  observations,  increased  striatal  Fe  has  been  suggested 
to  be  responsible  for  neuronal  cell.  Furthermore,  Fe  accumulates  in  brain  as  a  function  of  age  [19].  In  rat  striatum, 
Fe  levels  decrease  between  ages  10  days  and  22/23  days  and  level  off  thereafter  (Figure  7). 

Brain  Fe  is  highest  in  the  substantia  nigra,  globus  pallidus,  red  nucleus,  caudate  nucleus,  and  putamen.  Increased 
brain  Fe  has  been  found  in  several  neurodegenerative  disorders  although  it  has  not  been  defined  as  the  main  cause 
[21].  Fe  level  in  the  substantia  nigra  increases  in  PD  but  total  Fe  in  the  substantia  nigra  zona  reticulata  does  not 
change  in  either  PD  or  AD  [11].  Thus,  these  findings  suggest  that  over  accumulation  of  iron  in  striatum  may  lead  to 
development  of  neurodegenerative  diseases  such  as  PD  and  AD  and  sources  of  Fe  exposure  could  be  environmental 
and  dietary.  However,  it  remains  to  be  determined  if  the  elevated  Fe  levels  antedate  injury  of  pigmented  neurons  or 
constitute  a  consequence  of  neuronal  degeneration  because  the  increased  Fe  in  the  substantia  nigra  may  contribute  to 
oxidative  damage  to  neurons.  Nevertheless,  most  brain  Fe  is  stored  in  an  inactive  form  bound  to  intracellular 
ferritin,  which  is  thought  to  be  mainly  localized  in  microglia  and  oligodendroglia.  Clearly,  additional  studies  are 
needed  to  clearly  delineate  the  pathophysiological  role  of  Fe  in  neurodegenerative  diseases. 

Chronic  manganese  (Mn)  toxicity  in  human  induces  signs  and  symptoms  that  closely  resemble  those  noted  in  PD. 
There  is  a  great  deal  of  evidence  that  human  striatum,  globus  pallidus,  and  substantia  nigra  show  preferential 
increases  in  Mn  and  are  believed  to  be  the  primary  sites  associated  with  Mn  neurotoxicity.  Moreover,  exposure  to 
high  Mn  leads  to  elevation  of  Mn  levels  in  olfactory  epithelium  and  olfactory  bulb  [14]. 

In  every  region  of  the  brain  examined,  brain  sodium  (Na)  is  increased  in  AD  compared  with  corresponding  levels 
in  control  subjects  [1].  On  the  other  hand,  Na  levels  in  rat  striatum  decrease  during  postnatal  development.  Taken 
together,  these  observations  suggest  that  high  Na  accumulation  in  brain  may  lead  to  pathological  states  and  sources 
of  the  Na  could  be  environmental  and/or  dietary  in  origin. 

4.  Conclusions 

Our  results  strongly  suggest  that  the  metallomic  distributions  in  various  regions  of  the  rat  brain  change  markedly 
during  the  different  stages  of  postnatal  development.  In  conjunction  with  the  reports  in  the  literature,  our  findings 
also  suggest  that  brain  regional  metallomic  distribution  can  be  influenced  by  dietary  intake  of  metals  and  other 
elements  and  may  pathophysiological  implications  in  several  key  neurodegenerative  diseases  such  as  Parkinson’s 
disease  and  Alzheimer’s  disease.  A  metallomic  distribution  model  of  various  regions  of  the  rat  brain  can  be 
developed  based  on  ours  experimental  results  and  statistical  analysis.  However,  much  remains  to  be  discovered 
regarding  the  brain  functional  significance  of  metallomic  distribution  during  development. 
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Abstract.  The  intake  and  concentration  of  metals  and  electrolytes  from  our  diet  are  believed  to  be  affecting  our  general  health, 
in  particular,  the  proper  functions  of  vital  organs.  For  example,  in  addition  to  other  genetic  and  environmental  factors, 
consuming  water  with  high  alkalinity  for  prolonged  time  is  suspected  to  lead  to  diseases  such  as  kidney  stone.  Evidence  has  been 
accumulating  that  excessive  metal  intakes  would  lead  to  organ  failures.  Once  absorbed,  minerals  and  electrolytes  can  travel 
freely  throughout  the  body,  and  distribute  at  key  organ  systems  such  as  the  brain,  lung,  kidney,  etc.  By  conducting  experiments 
with  animal  models  (e.g.,  rats),  it  is  possible  to  not  only  determine  where  the  organ  distribution  of  various  matrices  of  elements 
and  minerals  but  also  correlate  such  matrices  with  the  overall  physiological  and  behavioral  status  of  such  models.  In  this  study, 
information  matrices  of  30  different  elements  (including  heavy  metals  and  some  electrolytes)  and  their  distributions  in  various 
vital  organs  (e.g.,  brain,  lung,  kidney,  liver,  heart,  spleen,  and  uterus)  were  analyzed  as  a  function  of  normal  dietary  intake  at 
adulthood  (120  days  old).  An  elemental  (metal  and  electrolyte)  distribution  model  was  then  formulated  based  on  experimental 
results.  The  study  has  high  impact  to  our  understanding  of  how  environmental  health  would  affect  our  well  being.  This  study 
would  also  provide  insights  on  how  our  diet  would  affect  the  accumulations  of  unwanted  elements,  such  as  heavy  metals,  in  our 
vital  organs.  The  results  may  help  researchers  and  health  practitioner  to  identify  possible  links  between  daily  diet  (metals  and 
electrolytes)  and  diseases,  and  may  also  lead  to  a  better  understanding  of  diseases  associated  with  aging  such  as  Alzheimer’s  and 
Parkinson’s  diseases,  and  other  neurological  disorders. 

Key  words:  Brain  organs;  elements;  metals;  distributions;  diseases;  diet;  environment 


1.  Introduction 

Since  the  era  of  industrial  evolution,  living  conditions  for  humans  have  improved  drastically;  with  the 
consequence  of  better  living  conditions  and  less  physical  activities,  we  are  facing  other  aspects  of  health  issues  such 
as  obesity  and  hyper  immune  responses  (allergy).  In  modern  living,  considerable  attention  has  been  paid  to  dietary 
intake  or  supplement  due  to  health  concerns.  On  the  other  hand,  involuntarily  consumption  of  unwanted  chemicals 
and  preservatives  via  processed  food  and  polluted  water  is  also  possible.  One  such  example  would  be  consumption 
of  drinking  water  from  sources  that  are  laden  with  soluble  ions  and  heavy  metals.  This  occurs  quite  frequently  for 
those  that  are  living  in  rural  areas  with  no  treatment  system  for  their  drinking  water  in  developing  countries. 

Attempts  in  understanding  the  homeostasis  of  different  elements  in  brain  and  other  major  organs  fell  short 
significantly  due  to  the  vast  complexity  of  mechanisms  involved  [1].  What  cause  this  complexity  are  the  multiple 
factors  that  can  affect  the  dynamics  of  biological  functions.  For  examples,  an  element  of  different  compounds 
(chloride  versus  phosphate)  would  have  various  uptake  rates  by  the  body  [2]  and  the  uptake  rate  of  elements  in 
solution  by  the  digestive  system  was  proven  to  be  faster  than  in  food  stuffs.  Elemental  accumulations  are  not  solely 
related  to  exposure  but  likely  have  more  to  do  with  impairment  of  the  relevant  homeostasis  mechanism  [3]; 
conversely,  a  Cu  deficiency  in  mice  were  able  to  be  corrected  by  supplementation  of  Cu  in  drinking  water  [4], 
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2003).  In  addition,  larger  sample  size  is  needed  to  observe  statistical  significance  in  the  small  changes  over  life  time 
exposure  [5].  Such  constraint  creates  a  vast  obstacle  to  conduct  research,  and  the  hurdle  is  more  difficult  if  human 
subjects  are  involved. 

Currently,  the  understanding  of  homeostasis  mechanisms  for  accumulation  and  control  of  individual  element  in 
our  body  is  very  limited;  hence,  the  influence  of  elements  with  similar  properties  to  each  other  is  practically  non¬ 
existent.  However,  results  of  Zn  replacing  Cu  in  a  competitive  homeostasis  mechanism  in  rat’s  brain  were  recently 
reported  by  Maynard  et  al.  [5].  Therefore,  it  can  be  concluded  that  our  understanding  of  elemental  homeostasis 
mechanisms  in  our  body  systems  is  still  in  the  pioneer  stage,  and  opportunities  for  further  research  and  development 
are  widely  untouched. 

There  are  chemicals  (vitamins,  for  example)  and  elements  needed  to  maintain  proper  bodily  functions;  in  this 
study,  we  focused  on  the  essence  of  major  and  selected  trace  elements  and  how  these  elements  accumulated  in  our 
major  organs.  The  major  organs  are:  brain,  lung,  kidney,  liver,  heart,  spleen,  and  uterus.  Information  matrices  of 
30  different  elements  (including  heavy  metals  and  some  electrolytes)  that  were  fed  to  rats  as  part  of  a  regular  diet 
were  obtained  from  the  seven  major  organs  and  analyzed.  Measurements  of  the  elements  from  the  adult  rats  (120 
days  old)  were  compared  with  information  obtained  from  healthy  Japanese  males  [6].  A  linear  distribution  model 
based  on  experimental  results  and  statistical  analysis  for  the  elemental  accumulations  in  the  major  organs  was  then 
developed  to  relate  the  accumulation  ratio  between  rats  and  humans  taking  their  respective  regular  diet.  This  model 
can  be  used  as  an  assessment  tool  to  evaluate  elemental  homeostasis  in  different  organs  for  the  initial  screening  of 
potential  health  issues  and  diseases. 

2.  Experimental  Methods 

The  30  elements  included  in  this  study  were:  Al,  As,  Ba,  Br,  Ca,  Cd,  Cl,  Co,  Cr,  Cu,  F,  Fe,  Hg,  I,  K,  La,  Mg,  Mn, 
Mo,  Na,  Rb,  S,  Sb,  Sc,  Se,  Si,  Sm,  Sr,  V,  and  Zn.  Analytical  measurements  of  the  elements  from  the  organs  of  adult 
(120  days  old)  Wistar  rats  and  diet  pellets  that  were  used  to  feed  the  rats  were  reported  in  a  parallel  paper  at  the 
same  conference  (Metallomic  Distribution  in  Various  Regions  of  the  Brain  as  Influenced  by  Dietary  Intakes  and 
Their  Implications)  [7] . 

Information  from  the  organs  of  healthy  Japanese  males  was  abstracted  from  Katoh  et  al.  [5]:  The  data  were 
collected  from  64  persons  ranging  from  6  to  82  years  of  age  with  a  mean  age  of  42  years.  These  data  were  assumed 
to  be  representatives  of  healthy  humans  regardless  of  race. 

3.  Results 

3.1  Concentration  of  Elemental  Accumulations  with  Rats 

Table  1  tabulates  the  elemental  concentrations  obtained  from  7  major  organs  of  the  rats  which  were  feed  with 
regular  food  pellets.  Out  of  the  30  elements  of  interest,  only  20  elements  were  detectable  within  the  measurement 
limit  by  instrumental  neutron  activation  analysis  (INAA).  This  implies  that  either  the  concentrations  of  other 
(undetectable)  elements  were  too  low  for  the  analytical  method,  or  the  organs  did  not  retain  those  elements 
significantly.  The  latter  observation  was  especially  obvious  for  the  brain  that  showed  only  15  measureable 
elements. 

Table  1.  Measurements  of  elemental  concentrations  for  the  seven  major  organs.  Noted  that  concentrations  of  the  first  6  elements  (above  Al)  were 
in  mg/g  of  wet  weight  and  concentrations  of  the  rest  of  the  elements  were  in  jag/g  of  wet  weight.  ND  indicates  not  detectable. 


Element 

Liver 

Lung 

Heart 

Heart 

Spleen 

Uterus 

Brain 

Ca 

0.05 

0.08 

0.16 

0.04 

0.06 

0.09 

0.054 

Cl 

1.01 

1.39 

1.35 

0.8 

0.94 

1.99 

0.95 

Fe 

0.28 

0.14 

0.1 

0.1 

1.06 

0.09 

0.019 

K 

3.6 

1.94 

2.15 

2.39 

3.61 

2.35 

2.677 

Mg 

0.24 

0.11 

0.14 

0.15 

0.19 

0.22 

0.103 

Na 

0.64 

1.12 

1.11 

0.76 

0.57 

1.62 

0.957 

Al 

6.57 

3.98 

4.13 

5.68 

7.17 

3.43 

5.87 

Br 

4.67 

10.49 

7.76 

4.3 

4.96 

12.53 

1.91 

Co 

0.1 

0.03 

0.22 

0.04 

0.05 

0.02 

0.011 

Cr 

0.05 

0.06 

0.44 

0.33 

0.13 

0.58 

ND 

Cu 

5.41 

2.53 

10.39 

5.33 

3.79 

2.9 

2.1 

F 

2.41 

2.82 

4.95 

2.46 

ND 

6.15 

ND 

Hg 

0.12 

0.02 

0.53 

0.01 

0.2 

0 

ND 

I 

0.06 

0.05 

0.08 

0.05 

ND 

0.12 

ND 

Mn 

2.76 

0.2 

0.78 

0.32 

0.35 

0.19 

0.51 

Mo 

1.11 

1.37 

0.61 

0.28 

0.61 

0.71 

ND 

Rb 

16.27 

4.38 

5.04 

3.9 

5.79 

4.54 

2.66 

Se 

1.26 

0.4 

1.54 

0.39 

0.72 

0.44 

0.64 

V 

0.08 

0.01 

0.1 

0.07 

0.04 

0.08 

ND 

Zn 

41.13 

16.98 

24.56 

16.05 

17.34 

15.85 

10.79 

3.2  Elemental  Accumulations  in  Human  Organs 

Similar  to  Table  1,  Table  2  shows  the  corresponding  elemental  accumulations  in  6  organs  that  were  collected  by 
Katoh  et  al.  [6]  and  Magalhaes  et  al.  [8].  Discussions  with  the  brain  is  excluded  from  this  paper  but  are  discussed  in 
a  parallel  study  [7]  due  to  the  complexity  of  the  brain.  Katoh  et  al.  have  collected  21  elements  of  which  15  elements 
are  common  with  the  elements  from  the  rat’s  study  in  Table  1.  Magalhaes  et  al.  have  collected  fewer  elements, 
Table  2  only  shows  those  that  are  of  interested  in  this  study.  However,  Magalhaes  et  al.  also  compared  elemental 
concentrations  of  health  tissues  with  cancerous  tissues  of  the  same  individuals.  It  should  be  noted  that  samples  of 
Magalhaes  et  al.  were  expressed  in  pg/g  of  dry  weight  instead  of  wet  weight,  but  this  relative  weight  ratio  should  be 
compatible  for  both  approaches. 

Table  2.  Elemental  concentrations  of  various  organs  reported  by  Katoh  et  al.  [6],  the  concentrations  were  in  pg/g  of  wet  weight  except  as  noted. 
*The  elemental  concentrations  of  uterus  were  abstracted  from  Magalhaes  et  al.  [8]  with  samples  of  German  origin,  concentrations  were  reported 
as  pg/g  of  dry  weight,  except  otherwise  specified. 


Element 

Liver 

Lung 

Kidney 

Heart 

Spleen 

Uterus* 

Al 

11.3 

130 

10.4 

11.4 

12.5 

As(ng/g) 

300 

560 

400 

250 

380 

Br 

12.2 

48.6 

40.9 

16.7 

25.6 

19 

Ca 

208 

585 

529 

291 

335 

1590 

Cd 

16.7 

4 

237 

1.2 

5.4 

Cl(mg/g) 

4.2 

10.1 

10.9 

5 

6.7 

Co(ng/g) 

173 

123 

69 

70 

31 

Cs(ng/g) 

69 

88 

120 

113 

77 

Cu 

32.2 

14.2 

15.4 

18 

7.3 

4 

Fe 

837 

987 

430 

257 

1400 

59 

K(mg/g) 

9.4 

9.9 

10.4 

15.5 

15.9 

0.571 

La(ng/g) 

285 

311 

64 

32 

650 

Mg 

678 

565 

711 

1070 

729 

Mn 

5.58 

1.17 

4.92 

1.63 

0.82 

Mo 

2.1 

1.37 

1.55 

0.69 

0.96 

Na(mg/g) 

4.2 

10.4 

10.7 

5.7 

5 

Rb 

22.3 

15.9 

17 

20.1 

22 

Sb(ng/g) 

52 

242 

69 

16 

49 

Sc(ng/g) 

5 

26 

4 

5 

5 

Se 

1.87 

1.3 

3.86 

1.37 

1.61 

Zn 

228 

62 

238 

126 

83 

3.3  Normalized  Elemental  Distribution  Ratio  in  Various  Organs  between  Rats  and  Humans 

A  normalized  elemental  distribution  ratio  can  be  obtained  by  dividing  the  concentration  of  an  element  in  a  rat 
organ  by  the  concentration  in  the  same  human  organ.  Figure  1  shows  the  normalized  elemental  distribution  ratio  for 
the  6  organs  and  15  elements  that  were  common  in  our  work  and  that  of  Katoh  et  al.  [6].  As  shown  in  Figure  1,  the 
elemental  distributions  (homeostasis)  for  the  15  elements  in  the  6  major  organs  fit  rather  consistently  in  general.  For 
examples,  Na  and  Cl  have  nearly  the  same  distribution  ratio  for  all  6  organs,  K  is  almost  as  consistent  except  for 
concentration  in  the  uterus.  This  may  be  due  to  diet  difference  between  rats  and  humans,  or  the  difference  is  a  factor 
of  physiological/genetic  origin;  a  proper  explanation  of  the  observation  remains  to  be  determined.  In  general,  Co 
has  the  widest  spread  in  distribution  among  organs. 

The  distribution  model  can  be  used  to  predict  physiological  development  from  rat  (animal)  to  human.  An 
abnormally  high  or  low  concentration  of  elements  in  organs  can  be  a  prelude  of  organ  malfunction  and/or  cancer 
development.  For  example,  samples  of  cancerous  uterus  tissue  had  1.6  time  the  concentration  of  K  when  compared 
with  that  of  normal  uterus  tissue  from  the  same  individual  [8].  However,  the  general  direction  of  increase  or 
decrease  in  elemental  concentration  of  cancerous  tissue  is  not  always  the  same  for  different  elements  and  organs. 
The  approach  of  normalized  distribution  ratios  developed  in  this  study  can  be  used  to  find  the  general  direction  of 
elemental  distribution  of  disease  tissues,  although  there  are  genetic  difference  between  rats  and  humans. 

4.  Conclusions 

A  normalized  elemental  distribution  model  is  developed  by  comparing  elemental  measurements  of  the  same 
organ  in  rats  and  humans.  The  model  can  be  used  to  predict  disease  tissues  based  on  their  elemental  measurements 
and  to  determine  how  well  we  can  absorb  elemental  nutrients  from  food.  This  study  has  high  impact  on  our 
understanding  of  how  environmental  health  would  affect  our  well  being.  This  study  would  provide  insights  on  how 
our  diet  would  affect  the  accumulations  of  unwanted  elements,  such  as  heavy  metals,  in  our  vital  organs.  The  results 
may  help  researchers  and  health  practitioner  to  identify  possible  links  between  daily  diet  (metals  and  electrolytes) 
and  diseases,  and  may  also  lead  to  a  better  understanding  of  diseases  associated  with  aging  such  as  Alzheimer’s  and 
Parkinson’s  diseases,  and  other  neurological  disorders. 
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Fig.  1.  Elemental  concentration  ratio  of  rat  versus  human  for  6  major  organs. 
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1.  INTRODUCTION 

The  failure  of  cancer  chemotherapy  can  be  attributed  to  two  major  factors.  The  two  major  reasons  are 
toxic  effects  of  the  drugs  and  secondly  the  resistance  to  the  chemotherapeutic  agents  used  in  treatment  of 
cancer.  Although  the  design  of  the  drugs  is  to  get  rid  of  cancer  cells  in  the  body,  the  normal  cells  also  are 
exposed  to  the  anti-cancer  drugs  resulting  in  toxic  effects.  The  challenge  to  specifically  target  cancer  cells 
continues  and  there  have  been  many  drugs  designed  and  are  now  in  use  for  specific  cancer  cells.  Several 
drugs  like  herceptin  and  gleevec  are  in  use  in  clinic  with  improvement  of  survival  (1,  2).  It  becomes 
difficult  to  treat  cancer  when  few  of  the  cells  in  tumors  acquire  the  ability  to  adapt  to  the  toxic 
environment  of  the  drugs  that  are  used  in  chemotherapy  (3).  For  the  past  25  years,  many  laboratories 
around  the  world  have  focused  efforts  to  unravel  the  mechanisms  that  contribute  to  the  emergence  of 
resistance  in  cancer.  The  hallmark  of  resistance  was  the  discovery  of  P-glycoprotien  by  Dr.Victor  Ling. 
P-glycoprotein  was  found  to  be  an  active  transporter  and  pumped  drugs  outside  the  cells  (4).  This  in  turn 
decreased  the  intracellular  concentration  resulting  in  adaptation  of  cancer  cells  to  toxic  environment.  A 
downside  of  this  overexpression  of  P-glycoprotein  was  that  it  imparted  cross  resistance  to  several 
structurally  unrelated  drugs  (5).  Since  the  discovery  of  P-glycoprotein,  several  proteins  have  been 
identified  which  result  in  resistance  in  cancer.  Multidrug  Resistant  related  Proteins  (MRPs)  belong  to  a 
family  of  ATP  cassette  and  about  7  MRPs  have  been  identified  with  different  substrate  affinity  (6). 
Studies  in  our  laboratories  have  focused  on  many  drug  resistant  cells  from  leukemias,  sarcomas,  multiple 
myelomas,  breast  cancer  and  pancreatic  cancers.  We  have  shown  that  cisplatin  selected  methotrexate 
resistant  cells  have  a  66  kD  protein  that  in  its  unphosphorylated  state  fails  to  transport  the  drug  inside  the 
leukemia  cells  resulting  in  resistance.  Our  studies  with  sarcoma  cells  selected  for  resistance  to 
adriamycin  has  increased  expression  of  c-fos  indicating  a  role  of  this  transcription  factor  in  anthracycline 
resistance  (7,  8,  9).  Breast  cancer  cells  resistant  to  adriamycin  have  higher  expression  of  IL6  receptor 
(10).  Studies  with  dexamethasone  resistant  multiple  myeloma  cells  show  changes  in  intracellular 
signaling.  In  addition,  5-fluorouracil  resistant  pancreatic  cells  have  upregulated  levels  of  mitogenic  and 
drug  metabolizing  enzyme  (unpublished  data).  All  these  findings  from  our  laboratories  indicate  that 
resistance  is  a  complex  phenomenon  and  differs  in  different  cell  lines  as  well  as  mechanisms  vary 
depending  upon  the  exposure  of  the  chemotherapeutic  agent. 

We  took  a  different  approach  by  utilizing  nano  materials  to  study  the  effect  on  various  cancer  cells.  We 
exposed  Leukemia  cells  and  its  subline  that  was  selected  for  resistance  to  cisplatin  as  well  as  pancreatic 
cancer  cells  selected  for  resistance  to  5-fluorouracil  to  MnO  and  ZnO  nanoparticles  that  range  in  size 
from  30-80nm.  The  rationale  of  these  studies  was  to  determine  if  the  resistant  cells  differ  in  sensitivity  to 
nano  particles  and  if  the  cellular  signaling  pathways  were  altered  differentially  in  these  cell  limes.  The 
data  will  provide  us  with  information  if  cells  resistant  to  anticancer  drugs  respond  differently  to 
nanoparticles  so  that  we  may  design  drugs  using  nanomaterials  to  specifically  target  resistant  cells. 


2. 


CYTOTOXICITY  OF  METALLIC  OXIDE  NANOPARTICLES  AND  THE 
UNDERLYING  SIGNALING  MECHANISMS 


Nanomaterials  have  been  increasingly  used  in  industrial  applications  (e.g.,  drug  delivery,  additives  to 
drugs  and  cosmetics).  Because  of  their  wide  use,  occupational  exposure  to  nanomaterials  and 
nanoparticles  may  pose  as  health  risks.  Recent  studies  have  suggested  that  exposure  to  nanoparticles  may 
induce  cytotoxic  effects  in  some  mammalian  cell  types  although  these  effects  have  not  been 
systematically  investigated  (11). 

In  a  series  of  studies,  we  tested  the  hypothesis  that  titanium  oxide,  magnesium  oxide,  and  zinc  oxide 
nanoparticles  exert  differential  cytotoxic  effects  on  human  astrocytoma  (U87)  cells  and  human  fibroblasts 
(HFF-1).  Because  the  effects  of  such  nanoparticles  on  human  neural  cells  are  unknown,  we  have 
determined  the  putative  cytotoxic  effects  of  these  nanoparticles  on  human  astrocytes-like  astrocytoma 
U87  cells  and  compared  their  effects  on  normal  human  fibroblasts.  We  found  that  Ti02  micro-  and 
nanoparticles  induced  cell  death  on  both  human  cell  types  in  a  concentration-related  manner.  We  further 
noted  that  ZnO  nanoparticles  were  the  most  effective,  Ti02  nanoparticles  the  second  most  effective,  and 
MgO  nanoparticles  the  least  effective  in  inducing  cell  death  in  U87  cells.  The  cell  death  mechanisms 
underlying  the  effects  of  Ti02  micro-  and  nanoparticles  on  U87  cells  include  apoptosis,  necrosis,  and 
possibly  apoptosis-like  and  necrosis-like  cell  death  types.  Thus,  our  findings  may  have  toxicological  and 
other  pathophysiological  implications  on  exposure  of  humans  and  other  mammalian  species  to  metallic 
oxide  nanoparticles.  Furthermore,  we  are  of  the  opinion  that  these  mechanisms  can  be  exploited  to  induce 
the  death  of  cancer  cells  thereby  enhancing  the  process  of  new  anti-cancer  drug  discovery  (11). 


3.  CYTOTOXIC  EFFECTS  OF  METALLIC  OXIDE  NANOPARTICLES  AND  DRUG 
RESITANCE  MECHANISMS 


In  this  study,  we  determined  the  effect  of  MgO  nanoparticles  on  murine  leukemia  cancer  cells  (L1210 
cells)  and  a  subline  selected  for  resistance  to  cisplatin  (L/DDP  cells).  The  magnesium  oxide  nanoparticles 
showed  differential  effect  on  cell  survival  using  different  methods  of  assays.  We  further  determined  the 
effect  of  MgO  on  various  cells  signaling  proteins  (Akt,  p-Akt  and  Erk  and  p-Erk)  in  LI 2 10  and  LDDP 
cells  after  magnesium  oxide  nanoparticles  treatment.  Our  results  indicate  that  the  treatment  with  MgO 
nanoparticles  increased  the  expression  of  p-Akt  and  decrease  the  expression  of  p-Erk  expression  in  L1210 
and  L1210/DDP  cells.  The  treatment  of  nanoparticles  showed  no  effect  on  the  level  of  expression  of  Erk 
and  Akt  in  these  cells  indicating  that  the  treatment  of  cells  with  MgO  nanoparticals  decreased  activation 
of  erk  pathway  but  increased  activation  of  Akt. 

We  further  examined  the  expression  of  downstream  transcription  factors  (c-fos  and  c-jun)  as  they  are 
altered  due  to  erk  signaling.  The  western  blot  analysis  shows  that  MgO  nanoparticles  decreased  the 
expression  of  c-fos  in  L1210  and  LDDP  cancer  cells.  Expression  of  c-jun  in  L1210  cells  showed  some 
increase  at  treatment  concentration  of  25pg/ml.  In  L1210/DDP  cells,  the  level  of  c-fos  reduced  in  dose- 
related  manner,  however  the  level  of  c-jun  was  undetected. 


4.  CONCLUSIONS 


We  have  presented  an  overview  of  our  studies  on  anti-cancer  drug  resitance  mechanisms  as  well  as 
ongoing  systematic  studies  of  the  nanotoxicity  of  metallic  oxide  nanoparticles.  Our  ongoing  studies  also 


suggest  that  resistant  cancer  cells  may  exhibit  cross-resistant  to  the  cytotoxic  effects  of  metallic  oxide 
nanoparticles.  The  latter  effects  appear  to  be  mediated  by  cell  survival/proliferation  signaling 
mechanisms.  Clearly  these  are  important  and  novel  areas  of  anti-cancer  drug  discovery.  As  such  they 
merit  further  investigation.  We  are  currently  pursuing  these  exciting  new  dormains  of  nanomedicine  and 
nanocancer  research. 
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Abstract  -  Highly  branched  polymers  and  nano  An  particles 
sol-gel  were  used  to  construct  an  enzymatic  biofuel  cell 
system.  The  anode  and  cathode  of  this  biofuel  cell  modified 
with  the  sol-gel  were  characterized.  The  sol-gel  was  very 
effective  in  anchoring  and  stabilizing  lactate  dehydrogenase 
(LDH)  and  glutamate  dehydrogenase  (GDH),  the  enzymes 
used  in  the  biofuel  cell  system.  This  sol-gel  modification 
would  enable  further  enzymatic  biofuel  cell  development 
that  was  not  possible  due  to  rapid  deterioration  of  enzymes. 
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1.  Introduction 

Biochemical  fuel  cell  drew  heavy  popularity  among 
scientist  and  engineers  in  the  early  1960s  but  the 
commercialization  of  it  was  not  realized  due  to  technical 
difficulties  and  the  availability  of  inexpensive  petroleum 
energy  [1].  However,  the  recent  energy  crisis  and  the 
development  of  micro  circuitry  reiterate  the  interest  of 
biofuel  cell;  with  the  aid  of  nano  technology,  biofuel  cell 
has  leapfrogged  to  a  new  horizon.  In  addition  to  the 
conventional  application  of  waste  conversion  to  energy 
recycling  concept,  the  micro  and  nano  technology  enable 
the  concept  of  biofuel  cell  to  directly  extract  energy  from 
organisms  and  plants  [2,  3]. 

Our  research  group  has  started  a  biofuel  fuel  cell 
initiative,  the  objective  of  this  initiative  is  to  develop  a 
biofuel  cell  system  that  is  non-toxic  and  biological 
compatible  that  can  be  employed  in  a  natural  environment 
or  human  body.  In  this  paper,  we  are  reporting  an 
enzymatic  biofuel  cell  system  that  was  constructed  with 
electrodes  that  were  enhanced  with  polymer  and  nanogold 
particles  sol-gel  that  can  be  implanted  into  our  body  as 
power  source  for  biomedical  devices  such  as  pacemaker 
and  insulin  pump;  this  cell/battery  can  be  modified  to 
generate  electrical  current  to  be  utilized  at  point  of 
generation  or  stored  as  battery  power.  The  energy  source 
or  reactants  were  lactate,  a-ketoglutarate,  and  ammonia 
that  are  all  existing  in  our  body  or  as  parts  of  our  body 
fluid. 
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Membrane 

Fig.  1  Atypical  fuel  cell,  products  of  fuel  cell  reactants  (fuel  oxidants) 
can  migrate  to  the  cathode  side  through  the  semi-permeable 
membrane  to  complete  the  overall  fuel  cell  reactions. 

For  our  biofuel  cell  system,  the  anodic  half-cell  was  made 
by  an  Au  electrode  coated  with  lactate  dehydrogenase 
(LDH)  submerged  in  solution  containing  lactate  and 
nicotinamide  adenine  dinucleotide  (NAD-h),  thus,  for  the 
anodic  half  reaction: 

LDH 

Anode:  Lactate  -h  NAD  — >  pyruvate  -h  NADH  -i- 

2H^-h2e  (1) 

As  lactate  was  oxidized  into  pyruvate  in  the  anode,  the 
oxidative  potential,  Eo’(25  °C),  would  be  0.19  V. 

The  cathodic  half-cell  was  made  by  a  glassy  carbon 
electrode  (GCE)  coated  with  glutamate  dehydrogenase 
(GDH)  submerged  in  solution  containing  ammonia  and 
reduced  nicotinamide  adenine  dinucleotide  (NADH),  the 
cathodic  half  reaction  was: 

Cathode:  a-Ketoglutarate  -h  NH4^  -h  NADH  -h  H"^  -h  2e' 

GDH 

— >  glutamate  -h  NAD^  -h  H2O  (2) 

As  a-ketoglutarate  was  reduced  into  glutamate  in  the 
cathode,  it  generated  a  reductive  potential,  Eo’(25  °C),  of  - 
0.14  V. 


Combining  (1)  and  (2),  the  total  potential  for  the  fuel 
cell  with  the  anode  and  cathode  above  was  0.05  V  (per 
mole).  In  general,  biological  reactions  in  nature  do  not 
release  large  amount  of  energy  for  each  reaction  step  to 
preserve  energy  utilization  efficiency.  The  overall 
reaction  for  the  biofuel  cell  thus  was  [4] : 

LDH,GDH 

Lactate  +  a-ketoglutarate  +  NH4  - >  pyruvate  + 

glutamate  +  +  H2O  (3) 

Since  the  A  Eq’  of  (3)  was  greater  than  0,  the  reaction  was 
spontaneous  and  would  proceed  as  written  from  left  to 
right. 


II.  MATERIALS  AND  METHOD 

A.  Electrodes 

Gold  electrode  had  diameter  of  0.3  cm  and  the  GCE 
had  diameter  of  0.35  cm,  they  both  were  purchased  from 
Tianjin  Aida  Heng  Sheng  Co,  Tianjin,  China. 

B.  Electrode  Preparation 

1).  Anode:  A  clean  gold  electrode  was  immersed  in 
0. 1  M  cysteamine  solution  for  2  hours  in  the  dark,  then  it 
was  dipped  into  colloidal  gold  nanoparticles  for  24  hours, 
finally  the  electrode  was  dipped  into  LDH  solution  for  20 
hours  before  it  was  used  for  testing.  This  was  a  LDH-Au- 
cysteamine  (sol-gel)-modified  Au  anode  as  shown  in  Eig. 
2.  LDH  was  embedded  in  the  Au  sol-gel  matrix  which 
also  enabled  electronic  transfer. 


1-S-CCH2)2-NH2 
-S-CCH2)2-NH2 
-S-(CH2)2-NH2 


Electi’ode  wall 


Fig.  2.  A  gold  anode  modified  with  cysteamine,  Au  nanoparticles  (sol- 
gel)  and  LDH. 


2).  Cathode:  Several  combinations  of  ploymers 
(poly(amido  amine)  (PAMAM)  of  0*  and  2^^  generation, 
and  cysteamine)  with  GDH  and  nanogold  particles  were 
tested  for  their  efficacies  to  enable  the  reductive  reaction 
as  in  (2).  A  cleaned  glassy  carbon  electrode  was  first 
immersed  in  0.1  M  cysteamine  (or  PAMAM)  solution  in 
darkness.  The  resulting  monolayer-modified  electrode 
was  rinsed  thoroughly  with  twice -distilled  water  and 


soaked  in  water.  Then,  it  was  dipped  into  the  colloidal 
gold.  The  gold  colloid-cysteamine-modified  cathode  was 
dipped  into  the  1-glutamate  dehydrogenase  (GDH) 
solution  (pH  7.4)  (or  GDH  solution  containing  NADH). 
In  such  a  way,  a  GDH  (/NADH)  gold  colloid-cysteamine 
(or  PAMAM) -modified  glassy  carbon  cathode  was 
obtained. 

Eor  cathode  that  both  cysteamine  and  PAMAM  were 
coated,  the  cleaned  glassy  carbon  electrode  was  first 
immersed  in  cysteamine  solution,  the  resulting  electrode 
was  dipped  into  the  PAMAM  solution.  Then,  it  was 
dipped  into  the  colloidal  gold.  The  gold  colloid- 
cysteamine/PAMAM-modified  electrode  was  dipped  into 
the  GDH  solution  (pH  7.4)  (or  GDH  solution  containing 
NADH).  In  such  a  way,  a  GDH  (/NADH)  gold  colloid- 
cysteamine/P  AM  AM-modified  glassy  carbon  electrode 
was  obtained 

C.  Nanoparticles  Solution  Preparations 

Nanoparticles  Au  was  prepared  by  reacting  HAuCU 
with  citric  acid  [5]. 

All  chemical  reagents  used  in  this  study  were 
analytical  grade  or  the  highest  grade  available,  water  was 
double  deionized  distilled  water.  All  the  experiments 
were  carried  out  under  deoxygenated  condition  in  0.1  M 
phosphate  buffer  solution.  All  enzymes  and  biochemicals 
were  purchased  from  Sigma- Aldrich  Chemical  Co,  St. 
Louis,  MO,  USA. 

D.  Detections 

UV-VIS  spectrophotometry  was  carried  out  by  an 
Agilent  diodearray  spectrophotometer  when  needed; 
cyclic  voltammetry  was  conducted  by  using  a  Gamry  600 
Potentiostat.  Voltammetric  potential  was  measured 
against  a  saturated  chloride  electrode  (SCE). 

III.  RESULTS  AND  DISCUSSIONS 
A.  Anodic  half-cell 

Eig.  3  shows  the  oxidative  responses  of  the  modified 
Au  electrode  with  nanogold  particles,  cysteamine  and 
LDH.  As  seen,  the  characteristic  peak  of  lactate 
conversion  to  pyruvate  was  detected  at  250  mV  and  the 
accumulative  current  increased  linearly  with  added  lactate 
instantaneously  [6].  It  verified  that  the  modified  anodic 
electrode  was  functioning  as  expected  in  (1). 


ketoglutarate  relationship  appeared  to  support  this 
observation. 


Fig.  3  Voltammetric  responses  of  an  An  electrode  coated  with 
cysteamine,  An  nanoparticles,  and  LDH  at  pH  8.  Responses  were 
stepwise  additions  of  lactate  at  1  .Ox  "^  mol/ml  with  linear  current 
increments  (oxidative  peaks)  at  250  mV. 


ketoglutarate/mf,/! 


B.  Cathodic  half-cell 

Fig.  4  is  the  UV-VIS  spectrum  PAMAM-Au-GDH 
coated  on  a  plastic  cuvette  that  has  no  absorption  in  the 
UV-VIS  range,  the  same  procedures  used  to  modify  the 
cathode.  As  shown,  PAMAM  and  Au  have  strong 
absorption  at  278  and  548  nm,  respectively.  The  red  and 
blue  line  were  absorption  of  the  same  coating  after 
numerous  rinses  that  indicated  the  self-assembling  coating 
was  stable,  although  some  PAMAM  were  released  after 
the  initial  rinses. 


Fig.  5  is  the  reductive  response  of  a  GCE  modified 
with  2“^  generation  of  PAMAMs,  nanogold  particles,  and 
GDH.  The  cathodic  half-cell  reaction  functioned  more 
efficiently  at  lower  concentrations  of  a-ketoglutarate  and 
became  less  effective  as  the  accumulative  concentration 
of  a-ketoglutarate  was  higher  (>0.025  mM).  This  could 
be  an  effect  of  saturation  that  the  nanoAu  particles  could 
only  support  a  limited  amount  of  GDH  for  the  conversion 
of  a-ketoglutarate  to  glutamate.  An  alternative 
explanation  is  that  some  PAMAM  was  released  by  the  Au 
sol-gel  that  resulted  in  less  conversion  efficiency.  This 
also  supported  the  general  speculation  that  the  Au  sol-gel 
can  only  support  a  finite  amount  of  “sorbed”  molecules 
per  unit  of  Au  molecule.  The  near  linear  current  versus  a- 


Fig.  5.  Reductive  responses  of  a  glassy  carbon  electrode  modified  with 
PAMAM,  Au  nanoparticle  and  GDH  measured  at  0.7  V  in  solution  of 
ammonia  and  a-ketoglutarate. 

For  the  PAMAM-Au-GDH  cathodic  half-cell,  the 
voltammetric  responses  of  (3)  at  0.7  V  was  shown  in  Fig. 
5,  the  total  current  measured  was  3.11  pA;  Considering 
the  electrode  surface  area  of  0.0962  cm^  (diameter  of  0.35 
cm)  and  reactants  consumption  of  0.3  mM,  thus  the 
current  density  (A/  cm^)  would  be  32.3  pA/  cm^  and  the 
current  generated  from  the  reaction  was  10.4  mA/M. 

It  was  observed  that  with  the  different  combinations 
of  cysteamine  and  PAMAMs,  polymers  with  the  most 
branched  structure  would  support  the  sol-gel  nanogold 
structure  with  the  most  efficiency  to  anchor  the  embedded 
enzymes  (LDH  and  GDH,  for  examples)  for  the 
enzymatic  conversions  [6].  In  addition,  this  sol-gel 
structure  on  the  electrodes  could  stabilize  the  enzymes 
that  normally  would  easily  decompose  rapidly  once  they 
are  in  diluted  solution,  which  was  the  case  in  our 
electrode  preparation.  Our  anode  and  cathode  performed 
repeatedly  consistently  as  they  were  freshly  prepared  even 
after  they  were  stored  submerged  in  distilled  water  at  4  °C 
for  2  weeks.  A  stable  and  cost  effective  enzymatic 
system  is  very  important  for  the  realization  of  using 
enzymatic  biofuel  cell  for  practical  applications. 

Our  biofuel  cell  system  would  generate  a  relative  low 
potential  (0.05V),  but  the  reactants  are  all  readily 
available  from  our  body  which  make  it  closer  to  reality 
for  the  system  to  be  implanted  into  our  body  as  power 
source  for  biomedical  devices.  If  this  concept  of 
enzymatic  biofuel  cell  is  to  be  employed  to  extract  energy 
from  an  industrial  waste  containing  high  energy  that  is 
normally  discarded,  such  as  waste  from  potato  processing 


plant  and  cheese  factory,  then  a  more  potential  favorable 
redox  reaction  route  should  be  chosen[7].  For  example, 
the  current  cathode  with  (2)  has  a  negative  potential,  one 
can  choose  a  cathode  made  with  cytochrome  a  that  has  a 
positive  potential  as  shown  in  the  following: 

Cytochrome  a  +  Fe^"^  +  e'  ^  cytochrome  a  +  Fe^"^ 

that  will  produce  a  reductive  potential  of  0.29  V  per  mole 
at  25  °C.  Another  half  reaction  with  high  positive 
potential: 

V2  O2  +  2H^+  2e-  ^  H2O 

produces  a  reductive  potential  of  0.816  V  [8]. 

IV.  CONCLUSIONS 

An  enzymatic  biofuel  cell  system  consisted  of  anode 
and  cathode  modified  with  enzymes,  highly  branched 
polymers,  and  Au  nanoparticles  sol-gel  was  constructed 
and  characterized.  This  enzymatic  biofuel  cell  concept 
can  be  used  to  generate  power  for  various  biomedical  and 
environmental  applications,  depending  on  the  available 
energy  sources.  The  energy  sources  also  dictate  the 
enzyme  systems  to  be  used,  which  could  be  a  limiting 
factor  for  biofuel  cell.  The  highly  branched  polymers  and 
nanogold  particles  sol-gel  proved  to  be  effective  in 
anchoring  and  stabilizing  the  enzymes  used  in  the  biofuel 
cell  and  should  be  explored  further  in  the  development  of 
a  practical  biofuel  cell  system. 
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Abstract  -  The  intake  and  concentration  of  metals  and 
electrolytes  from  our  diet  are  believed  to  be  affecting  our 
general  health,  in  particular,  the  proper  functions  of  vital 
organs.  Other  than  genetic  factors  and  environmental 
stresses,  evidence  has  been  accumulating  that  excessive 
metal  intakes  would  lead  to  organ  failure.  Once  absorbed, 
minerals  and  electrolytes  can  travel  freely  within  the  body, 
and  deposit  at  key  organ  systems  such  as  the  brain,  lung, 
kidney,  etc.  By  conducting  experiments  with  an  established 
systematic  animal  model  (e.g.,  rats),  it  is  possible  to 
determine  the  elemental  distribution  matrices  within  the 
organs,  as  well  as  to  correlate  such  matrices  with  the  overall 
physiological  and  behavioral  status  of  the  animal.  In  this 
study,  rats  were  used  as  the  testing  animal  with  a  controlled 
diet  for  their  entire  lifetime.  Information  matrices  of  30 
different  elements  (including  heavy  metals  and  electrolytes) 
associated  with  their  distributions  in  various  vital  organs 
including  brain,  lung,  kidney,  liver,  heart,  spleen,  and  uterus 
were  analyzed  as  a  function  of  age  at  5,  10,  23,  and  120  days 
old.  In  addition,  how  excessive  Mn  intakes  would  affect  the 
accumulation  of  other  elements  was  also  studied.  It  was 
found  that  the  excessive  Mn  intakes  would  greatly  affect  the 
accumulation  of  most  metals  and  electrolytes  from  the  intake 
diet,  although  the  diet  only  contained  trace  amount  of  some 
of  these  elements.  For  example,  excessive  amount  of  Hg  was 
found  in  kidney  issue  compared  to  control  sample.  This 
multidimensional  analysis  of  elemental  accumulations  in 
major  organs  provided  groundbreaking  information  in  our 
understanding  of  how  dietary  intakes,  including  pollutants, 
can  directly  affect  our  physiological  condition  and  general 
health. 

Keywords  -  Metals,  electrolytes,  distribution,  Mn,  diet, 
accumulation. 

I.  INTRODUCTION 

In  the  contemporary  society,  considerable  attention 
has  been  paid  to  dietary  intake  or  supplement  due  to 
health  concerns.  On  the  other  hand,  involuntarily 
consumption  of  unwanted  chemicals  and  preservatives  via 
processed  foods  and  polluted  water  is  also  inevitable 
depending  on  the  lifestyle  and  available  resources  of 
individuals;  one  such  example  would  be  consumption  of 
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drinking  water  source  that  is  laden  with  soluble  ions  and 
heavy  metals.  This  occurs  quite  frequently  for  those  that 
are  living  in  rural  areas  with  no  treatment  system  for  their 
drinking  water  in  developing  countries. 

Attempts  in  understanding  the  homeostasis  of 
different  elements  in  brain  and  other  major  organs  fell 
short  significantly  due  to  the  vast  complexity  of  the 
mechanisms  involved  [1].  What  cause  this  complexity 
are  the  multiple  factors  that  can  affect  the  dynamics  of 
biological  functions,  and  often  these  factors  are  not 
apparent  until  the  advanced  age  of  an  animal.  In  addition, 
larger  sample  size  is  needed  to  observe  statistical 
significance  in  the  small  changes  over  life  time  exposure 
[2].  Such  constraint  creates  a  vast  obstacle  to  conduct 
research,  and  the  hurdle  is  more  difficult  if  human  subject 
is  involved,  making  studying  such  factors  prohibitively 
costly. 

There  are  chemicals  and  elements  that  we  need  to 
maintain  proper  bodily  functions:  in  this  study,  we 
focused  on  the  essence  of  major  and  selected  trace 
elements  and  how  these  elements  accumulated  in  our 
major  organs.  The  major  organs  are:  brain,  lung,  kidney, 
liver,  heart,  spleen,  and  uterus.  Information  matrices  of 
30  different  elements  (including  heavy  metals  and  some 
electrolytes)  that  were  fed  to  rats  as  part  of  a  regular  diet 
were  obtained  from  the  seven  major  organs  and  analyzed. 
The  30  elements  of  interests  were:  Al,  As,  Ba,  Br,  Ca,  Cd, 
Cl,  Co,  Cr,  Cu,  F,  Fe,  Hg,  I,  K,  La,  Mg,  Mn,  Mo,  Na,  Rb, 
S,  Sb,  Sc,  Se,  Si,  Sm,  Sr,  V,  and  Zn. 

Also,  we  investigated  how  intake  of  an  excessive 
contaminant,  such  as  a  heavy  metal  ion  (Mn^"^)  in  this 
study,  would  alter  the  accumulation  of  all  other  elements 
and  electrolytes  in  the  vital  organs  over  the  lifetime  of  the 
rats,  that  would  directly  affect  the  proper  functions  of 
these  organs. 

II.  EXPERIMENTATION 

Wistar  rats  of  the  Portion  strain  (Animal  Breeding 
Unit,  Carshalton,  Surrey,  U.K.)  bred  in  the  Institute  of 
Neurology,  University  of  London,  U.K.  were  used.  All 


animals  were  kept  on  a  12-hour  light/1 2-hour  dark  cycle 
with  free  access  to  food  and  water.  Elemental 
concentrations  in  the  rat  food  pellets  have  been 
determined  as  shown  in  Table  1  below. 


TABLE  I.  Elemental  Concentration  of  rat  food  pellet. 


Element 

Concentration  (in  mg/g) 

Ca 

6.39  +  1.68 

Cl 

2.31+0.49 

Fe 

0.25  +  0.05 

K 

5.36  +  0.95 

Mg 

1.17  +  0.32 

Na 

1.48  +  0.32 

Concentration  (in  jig/g) 

Al 

98.06+  8.05 

Br 

10.57  +  2.26 

Co 

0.20  +  0.04 

Cr 

1.50  +  0.44 

Cu 

7.21+2.12 

F 

ND(5.00) 

Hg 

ND  (0.25) 

I 

ND  (0.50) 

Mn 

49.34  +  8.65 

Mo 

2.80  +  0.45 

Se 

ND  (0.25) 

Rb 

12.73  +  2.61 

V 

ND  (0.50) 

Zn 

47.73  +  4.11 

Thirty  trace  and  major  elements  in  different  organs  of 
rats  at  four  different  age  groups  (5,  10,  23,  and  120  days) 
were  analyzed  by  instrumental  neutron  activation  analysis 
(INAA)  [3].  The  samples  were  irradiated  by  thermal 
neutrons  using  three  different  sets  of  conditions 
depending  on  the  nuclear  characteristics  of  the  elements 
of  interest.  Not  all  30  elements  were  reported  in  the 
results  because  those  not  reported  herein  were  either 
below  the  detection  limits  of  the  INAA  technique  [3]  or 
the  element  concentrations  were  not  high  enough  in  the 
samples  (food  pellets  or  organ)  for  detection. 

All  the  standard  materials  and  samples  for  INAA  were 
freeze-dried  and  pelleted.  Dried  samples  were 
homogenized  using  a  Glen  Creston  polystyrene  ball-mill 
and  pelleted.  Other  details  of  standard  and  sample 
preparations  were  as  described  previously  [3,  4]. 

Standards  and  samples  were  irradiated  in  a  100  KW 
‘Consort’  Reactor  Mark  II  at  the  Imperial  College  Reactor 


Centre.  Irradiated  standards  and  samples  were  then 
analyzed  for  their  elemental  contents  by  gamma  ray 
spectrometry  using  various  Ge  (Li)  detectors  and  ND 
6600  Multichannel  Analyzer  (Nuclear  Data  Inc., 
Schaumburg,  Illinois,  USA).  Details  of  the  elemental 
determinations  were  described  in  the  methodology  paper 
by  Chan  et  al.  [3]. 

All  laboratory  chemicals  used  were  of  analytical  grade 
(BDH  Chemicals  Limited,  U.K.)  and  single  element 
standards  of  trace  elements  were  obtained  from  AAS 
(Ventron  Division,  Limited,  U.K.);  other  elemental 
standards  for  L,  Cl,  Br,  and  P  were  obtained  from  Hopkin 
and  Williams  Chemical  Ltd.,  U.K.  Water  for  solution 
preparations  and  feeding  was  double-distilled. 

The  three  concentrations  of  Mn^"^  fed  to  the  rats  via 
drinking  water  were  1,  10,  and  20  mg/ml. 

III.  RESULTS  AND  DISCUSSIONS 

As  shown  in  Lig.  1,  there  were  only  20  elements 
detectable  from  the  kidney  tissue  of  the  rats  out  of  the  30 
elements  of  interest.  The  rest  of  elements  were  either 
under  the  detectable  limit  of  INAA,  or  the  kidney  did  not 
retain  these  elements:  As,  Ba,  Cd,  La,  S,  Sb,  Sc,  Si,  Sm, 
Sr.  Notes  that  some  of  the  undetectable  elements  from 
the  food  pellets  showed  up  in  the  kidney  tissue  (such  as  L, 
Hg,  I,  Se,  and  V)  which  indicated  that  the  elements  would 
accumulate  with  time  and  the  amounts  would  also  depend 
on  the  organs,  thus  their  functions. 

Some  elements  increased  with  time  (age);  many 
elements  would  decrease  slightly  or  level  off  with  age, 
these  variations  were  also  organ  dependent. 
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Fig.l  Elemental  concentrations  of  rats’  kidney  at  different 
developmental  stages  of  5,  10,  23,  and  120  days,  (a)  The  weight  of 
elements  in  pg/g  of  organ  in  wet  weight;  (b).  weight  of  elements  in  mg/g 
of  organ  in  wet  weight. 
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It  was  found  that  intake  would  definitely  affect 
the  retention  of  other  elements  in  the  major  organs.  Eig.  2 
shows  the  fractional  changes  of  different  elements  in  the 
kidney  tissue  when  3  different  concentrations  of  Mn^"^ 
were  fed  to  120  days  old  rats,  as  compared  to  the  120 
days  old  control  without  excessive  Mn^"^.  The  intake  of 
excessive  Mn  increased  the  accumulation  of  most  heavy 
metals.  More  noticeably,  it  also  increased  the 
accumulation  of  I  and  Hg,  and  decreased  the  retention  of 
Se  and  V,  all  of  which  were  not  detectable  in  the  food 
pellet.  Therefore,  if  we  consume  an  excessive  amount  of 
an  heavy  metal  (for  example,  Mn)  for  a  lengthy  period,  it 
is  likely  that  the  total  toxicity  would  be  synergistically 
increase  due  to  increased  accumulation  of  other  heavy 
metals  induced  by  the  excessive  Mn.  This  synergistic 
effect  has  been  observed  consistently  in  all  the  organs  we 
studied. 


IV.  CONCLUSIONS 

Retention  of  elements  from  diet  intake  was  found  to 
be  age  and  organ  dependent.  Excessive  intake  of  a  heavy 
metal  can  induce  synergistic  toxicity  due  to  increased 
accumulation  of  other  heavy  metals  presented  in  the  diet, 
although  the  concentrations  of  these  metals  may  be  at 
trace  level. 
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Fig.  2.  Different  concentration  treatments  with  Mn^^  in  water  with  %  changes  in  adult  kidney  relative  to  control  adult  level:  A). Life-long  treatment  with  1 

mg/ml  of  Mn^^;  B.)  10  mg/ml  of  Mn^^;  C.)  20  mg/ml  of  Mn^L 
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Abstract:  We  previously  reported  the  development  of  a  biosensor  platform  that  is  capable  of 
measuring  biometabolites  and  environmental  sensitive  species,  such  as  peroxide  and  nitrate/nitrate,  to 
concentrations  in  the  order  of  ppb  (parts  per  billion)  or  lower.  In  this  investigation,  we  modified  our 
platform  with  dendrimers  to  enhance  its  performance.  Zero  and  second  generation  of  dendrimers  were 
coated  on  the  surface  of  a  carbon  glassy  electrode  which  was  then  modified  with  1-glutamate 
dehydrogenase  (GDH)  and  a-keto  glutarate.  The  resulting  electrode  was  tested  with  ammonium 
solutions,  concentrations  ranged  from  2  to  300  nM  at  pH  7.4;  the  results  were  satisfactory. 
Measurements  at  lower  concentrations  had  better  resolution  than  at  higher  concentrations  and  it  is 
believed  that  the  measurement  limit  can  be  lower  than  2  nM.  This  biosensor  platform  was  proven  to  be 
versatile  and  can  be  employed  as  a  platform  for  ultrasensitive  detecting  devices  in  many  biomedical 
and  environmental  applications.  Copyright  ©  2011  IFSA. 

Keywords:  Biosensor,  GDH,  Ammonium,  Glassy  carbon  electrode,  PAMAM. 


1.  Introduction 

In  the  past  several  years,  our  research  group  has  been  developing  a  platform  for  biosensor  construction 
that  is  capable  of  detecting  target  species  that  are  in  nano  and  subnanomolar  levels  [1,2].  This  sensor 
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platform  is  based  on  an  An  electrode  modified  with  sol-gel  An  colloid  and  biocatalyst  that  is  specific 
to  the  chemical  species  to  be  detected,  the  An  colloid  comprises  nano-size  An  particles  and  cysteamine 
which  binds  strongly  on  the  surface  of  the  metal  electrode  and  provide  stable  linkage  with  the  nano 
gold  particles  and  biocatalysts.  Thus  far,  biometabolites  and  environmental  sensitive  chemicals  such  as 
nitrite/nitrate  and  peroxide  were  successfully  detected  at  level  of  nM  and  below  with  this  sensor 
platform. 

In  this  study,  we  were  developing  another  biosensor  platform  that  can  be  used  to  measure 
biometabolites  and  environmental  sensitive  chemicals  based  on  a  non-metal  glassy  carbon  electrode 
modified  with  sol-gel  Au  colloid  that  is  similar  to  the  sensor  platform  mentioned  previously,  except  the 
binding  polymer  would  be  a  dendrimer  (polyamidoamine,  PAMAM)  instead  of  cysteamine.  A 
dendrimer  was  chosen  to  be  the  linker  between  the  electrode  and  Au  particles/catalysts  because  of  its 
low  toxicity  and  highly  branched  structure  that  presumably  can  provide  more  anchoring  sites  for  the 
Au  particles  and  catalysts.  Thus,  the  dendrimer  can  enhance  the  performance  of  the  sensor  platform. 
However,  PAMAM  does  not  have  an  S  atom  in  the  molecular  structure  and  may  not  bind  as  well  on 
the  electrode’s  wall  thus  would  be  less  durable.  Performance  of  using  cysteamine  and  dendrimer  as  a 
linker  for  the  same  sensor  platform  was  compared  in  this  study  and  the  stability  and  durability  of  the 
senor  would  be  investigated.  Ammonia,  which  is  a  major  biometabolite  and  environmental  sensitive 
chemical,  was  used  as  the  surrogate  chemical  to  be  tested  by  this  sensor  platform  [3]. 


1.1.  Theory 

As  shown  in  the  following  Equation  (1),  glutamate  and  nicotinamide  adenine  dinucleotide  (NAD^)  can 
be  hydrolyzed  to  form  a-keto  glutarate,  |3-nicotinamide  adenine  dinucleotide  reduced  (NADH),  and 
ammonium  ion  with  the  enzyme,  glutamate  dehydrogenase  (GDH).  The  equilibrium  constant  is  in 
favor  of  the  formation  of  glutamate  and  thus  the  reverse  reaction  is  faster  kinetically  [4]. 


HC-NHj 

U  +  NAD+  + 

(orNADP+) 

I  ^  _ 

C-0 

II 
0 

Glutamate 


Glutamate 

dehydrogenase 


H^O 


:NHa 


C-0 

I 

C=0 

I 

CH. 

c-0" 

II 
0 


+  NADH 
(or  NAD  PH) 


+  H^ 


a-Ketoglutarate 


(1) 


For  many  biological  reactions,  the  end  product  or  metabolite  is  ammonium;  accumulation  of  a  high 
concentration  of  ammonium  is  toxic  to  the  body.  Environmentally,  ammonium  is  a  byproduct  of  many 
industrial  processes,  uncontrolled  discharges  of  ammonium  will  lead  to  harmful  consequence  to  the 
environment.  Our  goal  here  was  to  develop  a  sensor  device  that  is  nontoxic  and  can  measure  the 
ammonium  ion  at  the  lowest  concentration  possible;  its  utilities  can  be  found  in  many  biomedical  or 
environmental  applications.  Hence,  it  is  the  reverse  reaction  as  shown  above  (glutamate  formation) 
that  we  utilized  in  this  study;  however,  the  same  sensor  can  be  used  to  detect  a-keto  glutarate  or 
glutamate  with  a  slight  alternation  of  the  measuring  approach.  Measurements  of  these  chemical  species 
mentioned  above  that  were  reported  in  literature  were  mostly  in  the  range  of  mM  [5-7].  It  should  be 
noted  that  the  motivation  of  this  study  was  to  develop  a  sensor  that  can  measure  low  concentration  of 
the  target  species,  more  specifically,  it  is  to  relate  the  current  measurements  exerted  by  the  reacting 
species  in  a  solution  (with  characteristics  peaks  of  oxidation  and/or  reduction)  by  cyclic  voltammetry 
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to  concentrations  of  the  species,  rather  than  to  determine  the  reaction  kinetics  of  the  measuring  species 
of  which  in  many  instances  are  already  known. 


2.  Materials  and  Methods 

2.1.  Materials 

L-glutamic  dehydrogenase  (GDH,  from  bovine  liver,  solution  in  50  %  glycerol)  was  purchased  from 
Sigma-Aldrich  (St.  Louis,  MO,  USA),  the  concentration  of  GDH  was  28  mg  protein/mL,  and 
46  units/mg.  Cysteamine,  polyamidoamine  dendrimer  generation  0  (PAMAM_0),  polyamidoamine 
dendrimer  generation  (PAMAM_2),  a-keto  glutarate,  [3-nicotinamide  adenine  dinucleotide  reduced 
disodium  salt  hydrate  (NADH),  AuCl3HCl-4H20  (Au  %>  48  %)  and  Nascitrate  were  purchased  from 
Sigma.  All  the  other  chemicals  were  of  analytical  grade  or  highest  grade  available. 


2.2.  Electrode  Preparation 

The  cleaned  glassy  carbon  electrode  (GCE)  was  first  immersed  in  0.1  M  cysteamine  solution  in 
darkness.  The  resulting  monolayer-modified  electrode  was  rinsed  thoroughly  with  twice-distilled  water 
and  soaked  in  distilled  water.  Then,  it  was  dipped  into  the  colloidal  gold.  The  gold  colloid-cysteamine- 
modified  electrode  was  dipped  into  the  1-glutamate  dehydrogenase  (GDH)  solution  (pH  7.4)  (or  GDH 
solution  containing  NADH).  In  such  a  way,  a  GDH  (or  GDH/NADH)  gold  colloid-cysteamine- 
modified  glassy  carbon  electrode  was  obtained  (GCE  cysteamine-Au-GDH  or  cysteamine-Au- 
GDH/NADH). 

For  electrode  that  was  modified  by  PAMAM  only,  either  PAMAM  _0  or  PAMAM_2  was  used  in 
place  of  cysteamine,  these  resulting  electrodes  were  termed  GCE  PAMAM  _0  or  PAMAM_2-Au- 
GDH  or  GDH/NADH.  In  cases  that  both  cysteamine  and  PAMAM  were  coated  onto  electrodes,  the 
cleaned  glassy  carbon  electrode  was  first  immersed  in  cysteamine  solution,  the  resulting  electrode  was 
dipped  into  the  PAMAM  solution  (PAMAM  _0  or  PAMAM_2).  The  gold  colloid- 
cysteamine/PAMAM-modified  electrode  was  dipped  into  the  GDH  solution  (pH  7.4)  (or  GDH  solution 
containing  NADH).  In  such  a  way,  a  GDH  (or  GDH/NADH)  gold  colloid-cysteamine/P  AM  AM- 
modified  glassy  carbon  electrode  was  obtained  (GCE  cysteamine/PAMAM  _0  or  PAMAM_2-Au- 
GDH  or  GDH/NADH). 


2.3.  Nanoparticles  Solution  Preparations 

Nanoparticles  Au  was  prepared  by  reacting  HAuCfi  with  citric  acid  [2]. 

2.4.  Detections 

UV-VIS  spectrophotometry  was  carried  out  by  an  Agilent  diode-array  spectrophotometer  (Agilent 
Model  8453);  cyclic  voltammetry  was  conducted  by  using  a  Gamry  600  Potentiostat.  Voltammetric 
potential  was  measured  against  a  saturated  chloride  electrode  (SCE).  The  experimental  setup  of  the 
cyclic  voltammetry  is  shown  in  Fig.  1. 
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Fig.  1.  Cyclic  voltammetry  and  the  sensor  measurement  cell. 


2.5.  Experimental  Procedures 

For  all  experiments,  the  measurement  cell  contained  5  mL  of  2.5  mM  of  NADH,  then  a  combined 
solution  of  a-keto  glutarate  and  NH4^  was  injected  into  the  reaction  cell  for  measurement  periodically, 
at  60  second  intervals;  injection  volume  varied  from  10  to  1500  pL  depending  on  the  concentration 
required.  The  concentration  of  a-keto  glutarate  solution  was  1x10'^  mol/L,  NH4^was  1x10'^  mol/L.  All 
experiments  were  conducted  at  pH  7.4  in  a  0.1  M  phosphate  buffer  solution  under  deoxygenated 
condition  and  all  solutions  were  prepared  with  double  deionized  distilled  water. 

Measurement  of  current  (i)  with  time  was  usually  at  about  700  mV  (vs.  SCE)  for  the  reduction  reaction 
and  at  near  2.0  mV  for  the  oxidation  reaction.  The  resulting  concentrations  of  a-keto  glutarate  and 
NH4^in  the  reaction  cell  ranged  from  2  to  300  nM  after  each  injection  unless  otherwise  stated. 


3.  Results  and  Discussion 

3.1.  Identification  of  PAMAM  Binding  with  GDH  in  Sol-Gel  An  Colloid 

Fig.  2(a)  shows  the  UV-VIS  spectrum  of  PAMAM_2  solution  at  various  concentrations.  PAMAM’s  in 
general  have  major  absorption  peak  at  227  nm,  but  a  minor  peak  also  appears  at  278  nm.  The  peak  at 
278  disappears  at  dilute  concentration  as  shown  in  blue  in  Fig.  2(a).  GDH  solution  has  similar 
spectrum  as  PAMAM_2  accept  that  its  absorptivity  is  less  intense  at  278,  as  shown  in  black  in 
Fig.  2(b).  Fig.  2(b)  also  shows  the  spectra  of  a  plastic  cuvette  (made  for  UV-VIS  range)  coated  with 
cysteamine-Au-GDH,  PAMAM_0-Au-GDH,  and  PAMAM_2-Au-GDH  in  red,  green,  and  blue, 
respectively.  The  peak  at  near  548  nm  is  associated  with  Au  particles.  The  peak  at  227  nm  would 
nearly  disappear  for  the  coating  (sol-gel  colloid)  containing  cysteamine  (red  line)  after  the  cuvette  was 
rinsed  with  deionized  water  numerous  times,  but  a  small  peak  at  278  nm  would  remain,  that  was 
believed  to  be  a  combined  cluster  layer  of  cysteamine  and  GDH  situated  in  the  Au  colloid.  The  same 
can  be  observed  if  rinsing  was  done  with  the  PAMAM’s  coating,  however,  the  remaining  cluster  peak 
at  278  nm  was  much  larger  and  the  Au  peak  at  548  nm  was  accordingly  higher.  Hence,  it  can  be 
reasoned  from  the  magnitude  of  the  absorbance  at  278  nm  that  PAMAM’s  can  bind  better  with  the  Au 
nanoparticles  and  GDH  to  form  a  colloid  attached  onto  the  electrode  surface  than  cysteamine  with  Au 
nanoparticles  and  GDH  in  this  self-assembly  process. 
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(a) 


(b) 

Fig.  2.  UV-VIS  spectra  of  PAMAM_2  and  other  senor  materials  coated  on  an  UV-VIS  cuvette:  (a)  Spectra  of 
PAMAM_2  solutions  at  various  concentrations,  characteristic  peaks  of  PAMAM’s  are  at  227  and  278  nm.  At 
lower  concentration,  as  shown  in  blue,  PAMAM_2  only  has  absorption  peak  at  227  nm;  (b)  Spectrum  of  GDH 
solution  and  spectra  of  an  UV-VIS  plastic  cuvette  coated  with  cysteamine-Au-GDH,  PAMAM_0-Au-GDH,  and 
PAMAM_2-Au-GDH  in  black,  red,  green,  and  blue,  respectively. 


3.2.  Voltammetric  Responses  of  the  Modified  GCE’s  for  NH/  Detection 

We  have  explored  several  combinations  of  sol-gel  An  colloids  for  the  sensor  development  to  detect 
ammonia,  these  combinations  were:  Cysteamine/PAMAM_0-Au-GDH,  cysteamine/PAMAM_2-Au- 
GDH,  cysteamine/PAMAM_0-Au-GDH/NADH,  and  cysteamine/PAMAM_2-Au-GDH/NADH.  We 
have  carried  out  a  wide-range  of  ammonia  concentrations  from  2  nM  to  300  nM  with  all  the  GCE’s 
modified  with  different  sol-gel  Au  colloid  combinations  in  order  to  determine  the  champion  performer. 
Trial  measurements  of  the  electrodes  indicated  that  two  distinguish  characteristic  peaks  could  be  used 
to  relate  proportionally  the  concentrations  of  ammonia  with  heights  of  current  peaks:  a  reductive  peak 
at  near  700  mV  and  an  oxidative  peak  at  2  mV.  Fig.  3  in  the  following  is  the  voltammograms  for  the 
ammonia  measurements  generated  by  using  a  GCE  modified  with  PAMAM_2-Au-GDH.  The  blue 
voltammogram  is  measurement  of  the  blank  in  phosphate  buffer  solution.  It  should  be  noted  that  the 
reductive  peaks  at  700  mV  shifted  to  higher  positive  voltage  with  increase  of  ammonia  concentrations. 
The  oxidative  peaks  at  about  2  mV  were  also  detected  but  were  not  obviously  observed  from  the 
figure. 


78 


Sensors  &  Transducers  Journal,  Vol.  11,  Special  Issue,  April  2011,  pp.  74-83 


30 


io 


-1.0 


-o.s 


0.0 


0.5 


1.0 


Fig.  3.  Cyclic  voltammograms  of  reaction  of  NH/  with  a-keto  glutarate  at  pH  7.4 
for  concentrations  from  2  to  300  nM. 


Overall,  GCE  modified  with  either  PAMAM  O  or  PAMAM_2-Au-  GDH/NADH  worked  best  for  the 
detection  of  ammonia  with  a-keto  glutarate,  although  there  was  no  significant  detection  advantage  by 
using  the  more  branched  PAMAM_2  in  the  sensor  preparation.  Detection  of  NH4^  concentrations 
can  be  better  demonstrated  by  using  the  oxidative  peaks  at  2  mV.  Voltammograms  of  the  oxidative 
peaks  at  2  mV  of  the  ammonia  reaction  with  a-keto  glutarate  using  GCE  modified  by 
PAMAM_2-Au-GDH/NADH  and  cysteamine-Au-GDH  are  shown  in  Fig.  4  (a)  and  Fig.  4  (b) 
respectively. 

As  shown  in  Fig.  4(a),  there  was  about  0.45  pA  difference  between  the  blank  buffer  solution  (in  blue) 
and  the  measurement  of  2  nM  NH4^  solution  (in  brown),  which  indicated  that  the  sensor  platform  is 
capable  of  measuring  NH4^  concentration  to  subnanomolar  level.  Fig.  4(b)  is  the  voltammograms  of 
the  same  solutions,  but  current  increments  of  the  oxidative  peaks  were  relatively  small,  which  indicates 
that  the  PAMAM_2-Au-GDH/NADH  modification  makes  a  more  superior  sensor  for  low  ammonia 
concentration  detection.  The  more  efficient  of  NADH  oxidation  in  the  system  could  also  be  attributed, 
at  least  partially,  by  the  direct  binding  of  NADH  with  GDH  in  the  Au  colloid. 

Fig.  5  shows  the  amperometric  responses  measured  by  5  sensors  using  the  same  platform  with 
different  modifications  for  the  reaction  of  NH4'^  with  a-keto  glutarate  at  2  mV  for  concentrations 
ranged  from  2  to  300  nM.  It  can  be  observed  that  there  were  two  near  linear  regions  that  can  be 
explored  to  be  used  for  sensor  design:  a  sensitive  region  at  concentrations  less  than  20  nM,  and  a 
relatively  less  sensitive  region  at  concentrations  larger  than  40  nM.  One  may  conclude  that  this  non- 
metal  biosensor  platform  is  ideal  for  making  sensor  for  ammonia  detection  at  extremely  low 
concentrations  (>20  nM).  It  is  unclear  at  this  time  about  the  mechanisms  why  the  modified  GCE’s 
become  less  sensitive  at  the  higher  concentration  region,  it  is  conceivable  that  there  is  a  limited 
quantity  of  Au  colloid  attached  to  the  GCE  surface  and  its  ability  to  transfer  electrons  is  saturated  and 
hence  turns  inefficient  at  higher  concentration. 
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Fig.  4.  (a)  Cyclic  voltammograms  of  PAMAM_2- Au-GDH/NADH  modified  GCE  for  detection  of  NH/  at  pH 
7.4.,  concentrations  of  NH/  varied  from  2  to  300  nM.  The  bottom  reduction  line  in  blue  was  measurement  for  a 
blank,  (b)  Same  measurements  with  a  GCE  modified  with  cysteamine-Au-GDH. 
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Fig.  5.  Amperometric  responses  of  ammonia  reaction  with  a-keto  glutarate  from  5  different  GCE  sensors 
modified  with  similar  platform  materials:  black  is  cysteamine-Au-GDH,  red  is  cysteamine/PAMAM_0-Au- 
GDH,  green  is  PAMAM_0-Au-GDH,  blue  is  cysteamine/PAMAM_2-Au-GDH,  light  blue  is  PAMAM_2-Au- 
GDH. 
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3.2.  Reproducibility  and  Stability  of  the  Modified  GCE’s 

An  ideal  sensor  platform  should  be  able  to  generate  measurements  that  are  reproducible  and  the  system 
is  stable  with  time,  thus  the  measurements  are  consistent  and  reliable.  Fig.  6  (a)  shows  the  50  cyclic 
responses  of  a  typical  modified  GCE  in  the  same  ammonia  solution.  It  can  be  seen  that  some 
deterioration  occurred  (as  shown  by  the  characteristic  peaks  at  near  700  mV)  after  the  50  cycles  but  the 
results  are  relatively  consistent.  Fig.  6  (b)  shows  the  amperometic  responses  of  a  GCE  modified  by 
PAMAM_0-Au-GDH/NADH  at  2.0  mV  after  2  weeks  stored  inside  a  refrigerator  at  4  °C,  the 
responses  are  nearly  identified  with  the  same  trend,  the  measurements  indicated  that  the  sol-gel  Au 
colloid  stabilized  the  GDH/NADH  within  the  cluster  and  prevented  the  bioenzyme/biochemical  from 
deteriorating.  It  is  well  known  that  these  bioenzyme/biochemical  are  very  unstable,  especially  under 
dilute  concentrations  as  they  were  in  this  study.  These  results  demonstrated  that  the  biosensor  platform 
has  reasonable  reproducibility  and  stability. 
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Fig.  6.  (a)  Voltammograms  of  a  modified  GCE  with  50  measurement  cycles  of  the  same  solution; 
(b)  Amperometic  respones  of  a  GCE  modified  by  PAMAM_0-Au-GDH/NADH  at  1.8  mV, 
before  (blue)  and  after  (red)  2  weeks  stored  inside  a  refrigerator  at  4  °C. 


4.  Conclusions 

We  successfully  modified  our  glassy  carbon  electrode  biosensor  platform  [2]  for  ammonium  detection; 
we  further  modified  the  sensor  platform  with  PAMAMs  and  the  detection  lower  limit  was  enhanced. 
This  highly  modified  electrode  can  detect  ammonium  concentrations  down  to  2  nM  or  lower.  The  low 
detection  limit  of  this  biosensor  is  far  more  superior  than  most  available  detection  methods  in  the 
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public  domain.  This  biosensor  platform  can  be  modified  to  be  used  for  many  measurement 
applications  in  biomedical  and  environmental  field  that  require  high  sensitivity  at  low  concentrations. 
Currently,  the  challenge  of  biosensor  development  is  not  in  finding  the  right  enzymes  or  conjugate 
reactions  (Equation  (1))  that  govern  the  particular  species  to  be  detected,  it  is  the  portability,  stability, 
and  noise  reduction  that  demand  further  research  and  development. 
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1.1  INTRODUCTION 

In  a  recent  draft  document,  the  US  Environmental  Protection  Agency  (EPA)  has 
emphasized  that  exposure  to  nanomaterials  can  occur  during  their  fabrication  or 
production  process  because  the  materials  can  pollute  the  environment  [1]. 
Environmental  exposure  of  humans  to  silicon  dioxide  has  been  increasing 
because  of  escalating  use  of  silicon  dioxide,  including  a  range  of  its  particle  sizes, 
in  cosmetics,  food,  and  drug  formulations  [2,3].  Although  silicon  dioxide  has 
been  considered  to  be  a  comparatively  nontoxic  substance,  research  in  the  last 
two  decades  has  revealed  that  silicon  dioxide  particles  are  not  as  harmless  as 
they  were  previously  assumed  to  be. 

In  sizes  above  the  micrometer  range  (i.e.,  >  1  jam),  silicon  dioxide  appears  to  be 
benign  to  humans,  insects,  and  microorganisms.  However,  silicon  dioxide 
particles  of  sizes  smaller  than  1  pm  can  exert  toxic  effects  in  humans  and  animals. 
For  example,  silicosis  is  a  disease  found  both  in  humans  and  rats:  the  underlying 
silicon  dioxide  toxicity  is  due  to  prolonged  exposure  to  crystalline  silica  dust. 
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leading  to  pulmonary  injuries  or  lung  inflammation  [4,5].  Because  silicon  dioxide 
nanoparticles  can  readily  cross  the  blood-brain  barrier  (see  below),  they  can 
penetrate  into  the  nervous  system  and  exert  their  toxicity  on  neural  cells.  This 
review  therefore  focuses  on  discussing  the  effects  of  silicon  dioxide  nanoparticles 
on  neural  cells  both  in  vivo  and  in  vitro.  Three  recent  reviews  [6-8]  cover  the 
toxicity  of  these  particles  in  peripheral  tissues  and  cell  types:  readers  are  referred 
to  those  for  effects  of  silicon  dioxide  nanoparticles  on  non-neural  cell  types  and 
other  aspects  not  covered  in  this  review. 

1 .2  NANOPARTICLES  CAN  CROSS  THE  BLOOD-BRAIN  BARRIER 

The  blood-brain  barrier  (BBB)  constitutes  an  effective  barrier  to  exclude 
undesirable  and/or  toxic  substances  in  the  circulation  from  entering  the  central 
nervous  system,  including  the  brain.  In  this  context,  for  targeting  therapeutic 
agents  to  the  brain,  one  needs  to  device  mechanism(s)  whereby  this  restriction  of 
the  BBB  is  overcome  or  by-passed.  Consequently,  various  studies  on  employing 
nanoparticles  to  assist  with  drug  delivery  or  delivery  of  genetic  material  to 
advance  gene  therapy  have  concluded  that  nanoparticles  can  cross  the  BBB 
[9,10].  For  example,  Kim  et  al.  [9]  synthesized  silica-overcoated  magnetic 
nanoparticles  containing  rhodamine  B  isothiocyanate  within  a  silica  shell  of 
controllable  thickness  (MNPs@Si02(RITC)):  in  that  study  they  employed 
particles  with  50-nm  thickness.  They  administered  those  particles 
intraperitoneally  into  mice  for  four  weeks  and  were  able  to  detect  the 
nanoparticles  in  the  brains  of  those  mice.  Their  study  [9]  clearly  demonstrated 
that  such  nanoparticles  can  penetrate  the  BBB. 

Nanoparticles  have  also  been  employed  to  achieve  neuron-specific  delivery  of 
genetic  material  to  advance  gene  therapy  of  various  neurological  disorders.  For 
example,  Zang  et  al.  [11]  employed  85-nm  PEGylated  immunoliposome 
(containing  antibodies  to  the  rat  transferrin  receptor)  to  deliver  tyrosine 
hydroxylase  (TH)  expression  plasmid  to  normalize  TH  activity  in  the  striatum  in 
a  rat  model  of  experimental  parkinsonism  induced  by  6 -hydroxy dopamine.  Their 
results  demonstrated  that  intravenously-administered  immunoliposomes 
containing  the  TH  expression  plasmid  could  cross  the  BBB  giving  rise  to 
increased  striatal  TH  activity  in  the  TH-transfected  rats  [11].  Thus,  their  findings 
suggested  that  the  immunoliposomes  crossed  the  BBB  via  the  transvascular  route 
[11].  In  addition  to  the  transvascular  route,  nanoparticles  can  also  cross  the  BBB 
after  they  have  induced  alterations  in  BBB  permeability  and  induced  cerebral 
edema  [10]. 
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1.3  TOXICITY  OF  SILICON  DIOXIDE  NANOPARTICLES  IN  MAMMALIAN 
NEURAL  CELLS 

The  toxicity  of  silicon  dioxide  nanparticles  in  mammalian  neural  cells  is 
discussed  below  from  three  perspectives:  (i)  environmental  health  impact  of 
exposure  to  silicon  dioxide  nanoparticles,  (ii)  toxicity  of  the  nanoparticles  in 
mammalian  neural  cells  in  vivo,  and  (iii)  toxicity  of  the  nanoparticles  in 
mammalian  neural  cells  in  vitro. 

1 .3.1  Environmental  health  impact  of  exposure  to  silicon  dioxide 
nanoparticles 

As  has  already  been  alluded  to  above,  the  ever  increasing  use  of  silicon  dioxide, 
including  a  range  of  its  particles  sizes,  in  cosmetics,  food,  drug  formulations,  and 
numerous  other  industrial  applications  [2,3,12]  has  raised  some  concerns 
regarding  the  environmental  health  impact  of  human  exposure  to  silicon  dioxide 
particles,  especially  nanoparticles  [12].  Because  nanoparticles,  including  silicon 
dioxide  nanoparticles,  can  cross  the  BBB  (see  above),  their  accumulation  in 
significant  quantities  in  the  central  nervous  system  can  induce  deleterious  effects 
on  neural  cells,  thereby  disturbing  the  normal  functions  of  such  cells  and  even 
inducing  neurodegeneration.  The  findings  of  three  early  studies  provide  some 
support  for  the  notion  that  accumulation  of  silicon  dioxide  nanoparticles  in  brain 
could  lead  to  neurodegeneration  [13-15].  Silica  micro-  and  nanoparticles,  when 
introduced  into  the  brains  of  rats  and  mice,  induced  inflammatory  responses  in 
brain  astrocytes  and  macrophages  and  degeneration  of  axons  and  axon  terminals 
adjacent  to  the  astrocytes  [13].  Silicon  and  aluminum  were  noted  to  be  co¬ 
localized  in  the  central  region  of  senile  plaque  cores  in  the  cortex  of  patients  with 
senile  dementia  of  the  Alzheimer  type  [14].  Moreover,  the  accumulated  silicon 
and  aluminum  appeared  to  be  found,  at  least  in  part,  in  lipofuscin  granules  in  the 
brains  of  patients  who  died  with  Alzheimer's  disease  [15]. 

1 .3.2  Toxicity  in  vivo  of  silicon  dioxide  nanoparticles  in  mammalian  neural 
cells 

There  have  been  very  few  studies  on  the  toxicity  of  silicon  dioxide  nanoparticles 
in  vivo  on  mammalian  neural  cells.  Nevertheless,  the  results  of  the  few  studies 
are  quite  revealing  and  allow  us  to  make  two  tentative  generalizations,  (i)  Silicon 
dioxide  nanoparticles  can  cross  the  BBB:  one  consequence  of  such  particles  being 
able  to  cross  the  BBB  is  that  they  could,  at  least  potentially,  exert  undesirable 
effects  on  neural  cells  in  the  central  nervous  system,  (ii)  Most  of  the  toxic  effects 
of  silicon  nanoparticles  in  vivo  on  neural  cells  are  similar  to,  if  not  identical  with, 
the  effects  of  such  nanoparticles  noted  in  neural  cells  in  vitro  (see  below).  Thus, 
this  generalization  points  to  the  utility  of  employing  neural  cell  models  in  vitro  to 
screen  for  the  toxicity  of  various  types  of  silicon  dioxide  nanoparticles  and  the 
importance  of  employing  such  models  to  elucidate  the  cellular  and  molecular 
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mechanisms  underlying  the  cytotoxicity  of  silicon  dioxide  nanoparticles. 
Nevertheless,  it  is  noteworthy  that  cytotoxicity  of  these  nanoparticles  in  neural 
cells  cannot  be  easily  and  readily  investigated  employing  animal  models  in 
studies  in  vivo.  We  will  briefly  discuss  how  the  findings  of  the  few  studies  on 
toxicity  of  silicon  dioxide  nanoparticles  on  neural  cells  in  vivo  have  led  us  to 
formulate  the  two  generalizations  above. 

In  their  study  to  investigate  toxicity  and  tissue  distribution  of  silica-overcoated 
magnetic  nanoparticles  in  mice,  Kim  et  al.  [9]  synthesized  silica-overcoated 
magnetic  nanoparticles  containing  rhodamine  B  isothiocyanate  within  a  silica 
shell  of  controllable  thickness  (MNPs@Si02(RITC)).  They  employed 
MNPs@Si02(RITC)  with  50-nm  thickness  and  administered  those  particles 
intraperitoneally  into  mice  for  four  weeks  and  were  able  to  detect  the 
nanoparticles  in  the  brains  of  those  mice.  Furthermore,  using  an 
immunocytochemical  approach  and  employing  the  dorsal  cochlear  nucleus  as  a 
representative  example  of  whole  brain  localization,  they  were  able  to  show  that 
MNPs@Si02(RITC)  co-localized  with  a  well-characterized  neuronal  marker, 
NeuN.  Based  on  their  observations,  Kim  et  al.  concluded  that  the  silica 
nanoparticles  (MNPs@Si02(RITC))  could  cross  the  BBB,  enter  neurons,  but  do 
not  alter  the  permeability  of  the  BBB  [9].  Nevertheless,  they  did  not  detect  any 
gross  abnormal  histopathological  lesions  in  several  organs,  including  brain, 
kidney,  liver,  testis,  uterus,  lung,  heart  and  spleen,  in  mice  four  weeks  after 
intrapertoneally  injection  of  MNPs@Si02(RITC)  into  the  mice  at  25,  50  or  100 
mg/kg  [9].  Consequently,  Kim  et  al.  [9]  concluded  such  silica  nanoparticles  can 
penetrate  the  BBB  and  enter  neurons  without  apparently  altering  their  normal 
function,  suggesting  that  the  silica-overcoated  nanoparticles  at  the  doses 
employed  were  apparently  not  toxic  to  neurons.  The  findings  and  conclusions  of 
Kim  et  al.  [9]  are  in  sharp  contrasts  with  those  of  a  more  recent  study  by  Wu  et  al. 
[16]. 

Wu  et  al.  [16]  examined  the  effects  of  intranasal  exposure  of  adult  rats  to  silica 
nanoparticles  (20  pg  per  rat  daily  for  1  or  7  days).  They  reported  intranasal 
instillation  of  silicon  dioxide  nanoparticles  into  rats,  especially  for  seven  days, 
significantly  increased  levels  of  silicon  dioxide  nanoparticles  in  several  brain 
regions  monitored,  with  the  rank  order:  olfactory  bulb  >  striatum  >  hippocampus 
>  brain  stem  >  cerebellum  >  frontal  cortex  [16].  Evidently,  after  intranasal 
administration,  silicon  dioxide  nanoparticles  were  able  to  cross  the  BBB  and 
became  differentially  accumulated  within  seven  days  in  several  key  brain 
regions,  especially  in  olfactory  bulb,  striatum,  and  hippocampus.  Because  of  their 
importance  in  several  neurodegenerative  diseases,  Wu  et  al.  further  examined 
the  effects  of  these  nanoparticles  on  key  parameters  concerned  with  oxidative 
stress,  inflammatory  response(s),  and  neurotransmitter  metabolism  [16].  They 
noted  that  the  striatum  was  more  vulnerable  than  the  hippocampus  to  the  toxic 
effects  of  silicon  dioxide  nanoparticles  in  terms  of  changes  in  these  parameters 
subsequent  to  the  accumulation  of  such  nanoparticles  in  the  two  brain  regions. 
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Specifically,  in  rats  exposed  to  silicon  dioxide  nanoparticles  for  seven 
consecutive  days,  their  striatal  levels  of  hydrogen  peroxide,  a  by-product  of 
reactive  oxygen  species  (ROS)  generation,  and  MDA,  a  marker  and  end-product 
of  lipid  peroxidation,  were  significantly  increased  while  striatal  level  of  reduced 
glutathione  (GSH)  was  significantly  decreased;  however,  striatal  SOD,  an 
important  antioxidant  enzyme,  was  unchanged  [16].  By  contrast,  in  the 
hippocampus  of  rats  intranasally  instilled  with  silicon  dioxide  nanoparticles  for 
seven  consecutive  days,  only  MDA  levels  were  increased  [16].  Thus,  their 
findings  strongly  suggested  that  intranasal  exposure  of  adult  rats  to  silicon 
dioxide  nanoparticles  selectively  induces  oxidative  stress  in  their  striatum:  Wu  et 
al.  also  confirmed  that  the  nanoparticles  can,  and  do,  induce  oxidative  stress  in 
vitro  in  PC12  cells,  which  constitute  a  model  of  dopaminergic  neurons  (see  Table 
1  and  the  next  subsection  below). 

Wu  et  al.  [16]  also  observed  that  intranasal  instillation  of  silicon  dioxide 
nanoparticles  into  adult  rats  for  seven  consecutive  days  resulted  in  differential 
changes  in  inflammatory  responses  in  the  striatum  (but  not  in  the  hippocampus) 
of  the  treated  rats.  They  detected  significantly  higher  striatal  levels  of  TNF-a,  IL- 
ip,  and  IL6  in  the  treated  rats:  both  TNF-a  and  IL-ip  are  pro-inflammatory 
cytokines,  whose  release  leads  to  the  stimulation  of  expression  of  IL-6  and  IL-8. 
Along  with  the  selective  changes  in  the  striatal  levels  of  cytokines  associated 
with  inflammatory  response (s)  induced  by  intranasal  exposure  of  rats  to  silicon 
dioxide  nanoparticles  for  seven  days,  Wu  et  al.  [16]  also  discerned  a  significant 
decrease  (by  -25%)  in  striatal  dopamine  level  in  the  treated  rats  whereas  their 
hippocampal  glutamate  level  was  not  significantly  altered.  Animal  models 
revealed  that  dopamine  depletion  in  the  striatum  is  associated  with  movement 
disorders  [16]  that  were  reminiscent  of  that  in  Parkinson's  disease.  Consequently, 
their  findings  led  Wu  et  al.  [16]  to  conclude  that  exposure  to  silicon  nanoparticles 
exerts  a  negative  impact  on  the  striatum  and  dopaminergic  neurons  and  may 
pose  a  risk  for  neurodegenerative  diseases.  In  view  of  the  interesting 
observations  and  conclusion  of  Wu  et  al.  [16],  we  would  like  to  propose  that 
accumulation  and  toxicity  of  silicon  dioxide  nanoparticles  in  the  striatum  may 
serve  as  a  model  system  for  parkinsonism  and  Parkinson's  disease.  Clearly,  this 
is  a  research  area  that  merits  further  investigation. 

Despite  the  interesting  differential  changes  in  striatum  and  to  a  much  lesser 
extent  in  the  hippocampus  induced  by  intranasal  instillation  of  silicon  dioxide 
nanoparticles  noted  by  Wu  et  al.  [16],  those  researchers  did  not  detect  any 
noticeable  changes  in  the  general  behavior  of  the  treated  rats.  Nevertheless,  Wu 
et  al.  [16]  cautioned  that  more  extensive  and  specialized  neurobehavioral  testing 
is  needed  to  clearly  delineate  whether  or  not  exposure  of  rats  in  vivo  to  silicon 
dioxide  nanoparticles  definitely  results  in  functional  behavioral  changes  [16]. 
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1 .3.3  Toxicity  in  vitro  of  siiicon  dioxide  nanoparticies  in  mammaiian  neurai 
ceiis 

The  need  for  cell  models  in  vitro  to  screen  cytotoxicity  of  nanoparticies  in 
neural  cells.  Until  recently,  few,  if  any,  studies  have  addressed  the  cytotoxicity  of 
nanoparticies  in  neural  cells.  We  were  the  first  to  propose  the  importance  of 
developing  neural  cell  models  in  vitro  to  facilitate  the  high  throughput  screening 
of  the  putative  toxicity  of  nanoparticies  in  various  neural  cell  types  [12, 17-32]. 

Initially  we  developed  several  types  of  neural  cell  models  in  vitro  consisting  of 
human  astrocytoma  U87  cells  and  human  neuroblastoma  SK-N-SH  cells  for  high 
throughput  screening  of  the  putative  toxicity  of  nanomaterials,  including 
nanoparticies  [12,  17-24].  Even  though  U87  and  SK-N-SH  cells  are  neurotumor 
cells,  they  are  good  models  in  vitro  for  astrocytes  and  neurons,  respectively, 
because  there  is  good  evidence  that  the  structure  and  functions  of  U87  and  SK-N- 
SH  cells  closely  resemble  their  counterparts  in  normal  brain,  [17-24,  26].  We  have 
initiated  a  series  of  studies  to  systematically  examine  the  putative  cytotoxic 
effects  of  nanoparticies  of  metallic  and  non-metallic  oxides  in  astrocytes  and 
neurons  employing  U87  (astrocytes-like)  and  SK-N-SH  (neurons-like)  cells  [12, 
17-26].  We  have  also  modified  the  ''standard"  cell  survival  (i.e.,  MTT)  assay  so 
that  the  assay  can  be  used  to  assess  the  effects  of  nanoparticies  on  cell  survival 
with  improved  accuracy  by  minimizing  the  interference  by  nanoparticies  in  the 
assay  [22,23]. 

We  have  further  developed  several  types  of  co-culture  models  of  astrocytes  and 
neurons  employing  U87  and  SK-N-SH  cells  to  facilitate  mechanistic  elucidation 
of  the  protection  by  astrocytes  conferred  on  neurons  against  agents  (including 
toxic  nanoparticies)  that  induce  neurodegeneration  [20-22,  26,30] . 
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Table  1.  In  vitro  studies  of  nanosilica  toxicity  in  neural  cells 


Silica 

form  (Size) 

Cells  Used 
(Exposure  time 
in  hours) 

Endpoints  and  Findings 

Ref. 

Colloidal 

SiOj-NP 
(25  nm) 

SK-N-SH 

U87 

(48) 

-  1  cell  survival  (significant  decrease  at  25,  50, 100  jug/  ml) 

- 1  LDH  release 

-  t  cell  survival  when  co-cultured  with  U87  cells 

-  Altered  cellular  morphology 

[17,18, 

20] 

Mesoporous 
Nanomaterials 
MCM-41  (5-30  nm ) 
•AP-T 

•MP-T 

Spherical  silica 
nanoparticles  Si02 
(5-30  nm ) 

SK-N-SH 

(24) 

-  Cytotoxicity  of  nanoparticles 

MCM-41  >MP-T> AP-T  «  Si02  (cytotoxicity  of  nanoparticles  in  descending 
order  of  toxicity) 

-  More  adsorptive  surface  area  of  the  particle  resulted  in  higher  toxicity 

[33] 

Amorphous 
Si02-NP 
(50  &  70  nm) 

SK-N-SH , 

N2a 

(4) 

-  Internalized  nanoparticles  into  the  cytoplasm  and  localized  in  nuclei 
-Induced  aberrant  clusters  of  protein  aggregates  in  the  nucleoplasm 

[35] 
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Table  1.  In  vitro  studies  of  nanosilica  toxicity  in  neural  cells  (cont.) 


Silica 

form  (Size) 

Cells  Used 
(Exposure  time 
in  hours) 

Endpoints  and  Findings 

Ref. 

Mesoporous 

nanomaterials 

(MSNs) 

•MCM-41 

•SBA-15 

Solid-cored 

Silica  microsphere 
(SMS) 

(300  -  350  nm) 

SK-N-SH 
(3,  24  and  51) 

-  SBA-15 

inhibitory  effect  on  cell  survival  at  50  and  100  pg/  mL  and  cytotoxic  at 

200  pg/mL  (3  hr) 

recovery  in  cell  viability  (27  hr  and  51  hr) 

-  MCM-41 

toxicity  during  the  short  exposure  (3  hr) 
recovery  in  cell  viability  (  51  hr)  except  at  200  pg/  mL 
-SMS 

not  toxic  except  at  200  pg/  mL  ( 3  hr) 
toxic  (27  hr  and  51  hr) 

functionalization  of  amine  group  decreases  toxicity 

L34J 

Si-NP 

(prepared  by  sol  gel 
method) 

(150-200  nm) 

primary  culture 
of  rat 
microglia 
(24) 

-  Internalization  by  microglia  at  all  concentrations  tested 

-  Not  cytotoxic  and  did  not  alter  phagocytosis 

-  t  in  intracellular  production  of  ROS  and  RNS 
- 1  IL-lp  level 

- 1  TNF-a  gene  expression 
- 1  COX-2  gene  expression  at  36.4  pg/ml 

136J 
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Table  1.  In  vitro  studies  of  nanosilica  toxicity  in  neural  cells  (cont.) 


Silica 

form  (Size) 

Cells  Used 
(Exposure  time 
in  hours) 

Endpoints  and  Findings 

Ref. 

Colloidal 

U87 

- 1  cell  survival  (significant  decrease  at  25,  50, 100  jiig/  ml) 

112J 

SiOj-NP 
(25  nm) 

(48) 

-  t  citrate  synthase  and  malate  dehydrogenase  activities 

-  1  expression  of  cytochrome  C  oxidase  subunit  II,  j  expression  of  NADH 

dehydrogenase  subunit  6  and  j  expression  of  phosphorylated  ERK 

-  Cells  became  more  enlarged  and  swollen 

SiO^-NP 

15  nm 
(92  nm  with 

FBS 

protein) 

PC12 

(24) 

- 1  cell  survival,  t  LDH  release, 

-  Oxidative  stress 

t  ROS  production,  t  MDA,  j  GSH  and  j  SOD  activity 

-  Rounded  shaped  and  reduced  length  of  extended  neurites 

-  Apoptosis 

double  stained  with  PI-  and  FITC-Iabeled  annexin  V 

1  the  expression  of  bcl2,  t  the  expression  of  p53,  p21,  p-p53,  Gadd45  and 
bax 

-  Cell  cycle  arrest  at  100  and  200  pg/ml 

[16] 
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Table  1.  In  vitro  studies  of  nanosilica  toxicity  in  neural  cells  (cont.) 


Silica 

form  (Size) 

Cells  Used 
(Exposure  time 
in  hours) 

Endpoints  and  Findings 

Ref. 

Colloidal 

SiOj-NP 
(25  nm) 

Schwann  cells 
(R3), 

DRG  neurons 
(50B11) 

(36  and  48) 

-  1  cell  survival 

DRG  neurons  <  Schwann  cells 

-  Internalized  nanoparticles  (Schwann  cells  and  DRG  neurons) 

-  Enlarged  and  swollen  nuclei  (Schwann  cells  and  DRG  neurons) 

-  Oxidative  stress 

Schwann  cells 
j  GSH  and  j  Mn-SOD  (R3) 

DRG  neurons 

Multi-phasic  effect  on  GSH  and  t  Mn-SOD 

-  1  expression  of  NADH  dehydrogenase  subunit  6  and  t  expression  of 

succinate  dehydrogenase  fc  subunit 

-  1  expression  of  p-ERK  (Schwann  cells  and  DRG  neurons) 

-  Did  not  change  the  expression  of  ERK 

[28,31, 

37] 

Abbreviations:  COX-2,  cyclooxygenase  2;  DRG,  dorsal  root  ganglion;  FITC,  fluorescein  isothiocyanate;  GSH,  reduced  glutathione;  IL,  interleukin;  LDH,  lactate 
dehydrogenase;  MDA,  malondialdehyde  (end  product  of  lipid  peroxidation);  N2a,  mouse  neuroblastoma  cell  line;  NMR,  nuclear  magnetic  resonance;  PC12, 
pheochromocytoma  cells;  PI,  propidium  iodide;  Ref.,  references;  RNS,  reactive  nitrogen  species;  ROS,  reactive  oxygen  species;  SEM,  scanning  electron  microscopy; 
Si02-NP,  silicon  dioxide  nanoparticles;  SK-N-SH,  human  neuroblastoma  cell  line;  TEM,  transmission  electron  microscopy;  TNF,  tumor  necrosis  factor;  U87,  human 
astrocytoma  cell  line;  XRD,  X-ray  diffraction. 
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Because  the  putative  cytotoxic  effects  of  nanoparticles  of  metallic  and  non- 
metallic  oxides  in  neural  cells  of  the  peripheral  nervous  system  (PNS)  are 
unknown,  we  have  recently  developed  cell  models  in  vitro  consisting  of  Schwann 
cells  and  dorsal  root  ganglion  (DRG)  neurons  to  facilitate  the  systematic 
investigation  of  the  effects  of  such  nanoparticles  on  the  PNS  [27-29,  31,32].  The 
results  of  our  recent  and  ongoing  studies  clearly  demonstrate  that  our  cell 
models  in  vitro  constitute  excellent  cell  culture  models  for  elucidating 
pathophysiological  mechanisms  of  agents  (including  nanoparticles)  that  can 
induce  peripheral  neuropathy  [27-29,31,32]. 

The  results  of  our  previous  and  ongoing  studies  clearly  demonstrate  that  the  cell 
models  we  have  developed  allow  the  systematic  and  mechanistic  investigations 
of  putative  cytotoxicity  of  nanoparticles  of  metallic  and  non-metallic  oxides  in 
neural  cells  derived  from  both  the  central  and  the  peripheral  nervous  systems 
[12,  17-32].  Furthermore,  they  also  strongly  suggest  that  our  models  can  be 
applied  to  screen  the  cytotoxicity  of  nanomaterials  other  than  nanoparticles  of 
metallic  and  non-metallic  oxides  in  neural  cells  of  central  and  peripheral  nervous 
systems  [12,  17-32].  We  will  discuss  in  the  next  subsection  the  findings  of  our 
studies  and  compare  them  with  those  of  other  researchers. 

Cellular  and  molecular  mechanisms  underlying  the  cytotoxicity  in  vitro  of 
silicon  dioxide  nanoparticles  in  neural  cells.  The  results  of  the  studies  to  date 
concerning  the  cytotoxicity  in  vitro  of  silicon  dioxide  nanoparticles  in  neural  cells 
are  summarized  and  compared  as  shown  in  Table  1. 

We  were  the  first  to  initiate  a  series  of  studies  to  systematically  investigate  the 
cytotoxic  mechanisms  of  silicon  dioxide  nanoparticles  on  mammalian  (including 
human)  neural  cells  [12,17,18,20,22].  Our  initial  finding  that  silicon  dioxide 
nanoparticles  induced  cytotoxicity  on  human  neuroblastoma  SK-N-SH  (neurons¬ 
like)  and  human  astrocytoma  U87  (astrocytes-like)  cells  by  lowering  their 
survival  [17]  prompted  us  to  further  elucidate  the  mechanisms  underlying  the 
cytotoxicity  of  silicon  dioxide  nanoparticles  in  neurals  cells  [12,18].  Necrosis 
appeared  to  be  one  cytotoxic  effect  induced  by  the  nanoparticles  in  both  SK-N- 
SH  (neurons-like)  and  U87  (astrocytes-like)  cells  as  indicated  by  the  increases  in 
lactate  dehydrogenase  (LDH)  release  from  the  cells  into  the  surrounding 
medium  (Table  1)  [17,18].  The  dose-related  changes  in  cellular  morphology  in 
U87  and  SK-N-SH  cells  induced  by  silicon  dioxide  nanoparticles  paralleled  the 
dose-related  decreases  in  the  survival  of  those  cells  induced  by  the  nanoparticles 
[17,18].  Interestingly,  when  SK-N-SH  (neurons-like)  cells  were  co-cultured  on  a 
monolayer  of  U87  (astrocytes-like)  cells  and  exposed  to  silicon  dioxide 
nanoparticles,  the  survival  of  both  cell  types  was  improved  compared  to  the 
survival  of  both  cell  types  when  they  were  cultured  alone  as  monotypic  culture 
and  exposed  to  silicon  dioxide  nanoparticles  (Table  1)  [20]. 
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We  investigated  further  the  cytotoxic  mechanisms  underlying  the  dose-related 
decreases  in  survival  of  U87  cells  induced  by  silicon  dioxide  nanoparticles  [12]. 
We  found  the  activities  of  citrate  synthase  and  malate  dehydrogenase  in 
nanoparticles-treated  U87  cells  were  increased,  possibly  due  to  an  energetic 
compensation  in  surviving  cells  (Table  1)  [12].  By  contrast,  the  expression  of 
mitochondrial  DNA-encoded  cytochrome  C  oxidase  subunit  II  and  NADH 
dehydrogenase  subunit  6  and  the  cell  signaling  protein  phosphorylated  ERK  (p- 
ERK)  was  altered  in  the  nanoparticles-treated  U87  cells  (Table  1)  [12].  Thus,  we 
were  the  first  to  report  on  the  effects  of  silicon  dioxide  nanoparticles  on 
expression  of  mitochondrial  DNA-encoded  protein  and  on  expression  of  cell 
survival  signaling  protein  (i.e.,  ERK)  [12].  Our  findings  suggest  that  silicon 
dioxide  nanoparticles  induces  disruption  of  mitochondrial  DNA-encoded 
protein  expression,  leading  to  decreased  mitochondrial  energy  production  in  U87 
cells;  the  nanoparticles  also  induced  decreases  in  cell  survival/ proliferation 
signaling  in  those  cells  [12]. 

Different  types  of  nanosilica  particles  exert  dissimilar  cytotoxic  effects  on  neural 
cells.  Di  Pasqua  et  al.  [33]  and  Tao  et  al.  [34]  demonstrated  that  mesoporous  silica 
(MCM  41)  nanoparticles  are  more  toxic  to  SK-N-SH  cells  compared  to  spherical 
silica  (including  silicon  dioxide)  nanoparticles  (Table  1).  They  also  found  that 
functional  groups  on  silica  nanoparticles  play  major  roles  in  determining  the 
toxicity  of  silica  nanoparticles:  for  example,  grafting  aminopropyl  group (s)  on 
mesoporous  silica  nanoparticles  decreased  the  cytotoxicity  of  MCM-41  in  SK-N- 
SH  cells  [33].  Thus,  it  is  imperative  to  consider  whether  or  not  and  how  the 
surface  of  the  nanoparticles  may  influence  their  properties  while  selecting 
nanosilica  for  biomedical  and  biotechnological  applications. 

In  elegant  studies  in  vitro,  Chen  and  von  Mikecz  [35]  demonstrated  that 
amorphous  silica  nanoparticles  (50  &  70  nm)  entered  several  cell  types  including 
neuronal  cells  (i.e.,  N2a  and  SK-N-SH  cells),  translocated  into  their  nuclei,  and 
altered  nuclear  functions  in  a  matter  of  hours  (Table  1)  [35].  However,  silica 
particles  of  sizes  between  200  nm  and  5  pm  neither  penetrated  into  the  nuclei  nor 
modified  nuclear  function  and  architecture  of  the  cells  [35].  Furthermore,  this 
group  noted  that  once  they  penetrated  into  the  nuclei  of  the  cells,  silica 
nanoparticles  with  an  average  diameter  of  50  nm  induced  the  formation  of 
aberrant  protein  aggregates  in  their  nuclei  [35].  The  protein  aggregates,  whose 
formation  was  induced  by  the  silica  nanoparticles,  contained  essential 
components  of  nuclear  protein  machines  such  as  coactivators  of  transcription, 
unmutated  polyQ  proteins,  and  members  of  the  ubiquitin  proteasome  systems 
(UPS)  [35].  Their  interesting  observations  led  von  Mikecz  and  co-workers  to 
propose  that  the  components  of  the  UPS  are  recruited  to  silica-nanoparticles- 
induced  nuclear  inclusions  to  break  down  aggregated  proteins  [35].  Moreover, 
even  when  silica  nanoparticles  did  not  alter  cell  viability  or  enhance  cell  death, 
silica  nanoparticles  induced  repression  of  gene  expression,  ultimately  leading  to 
decreased  cellular  replication  and  irreversible  inhibition  of  cell  proliferation  [35]. 
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This  group  of  researchers  therefore  concluded  that  through  the  induction  of 
intranuclear  protein  aggregation  that  contains  proteins  with  polyQ  stretches, 
silica  nanoparticles  trigger  a  subnuclear  pathology  that  closely  mimics  molecular 
events  characteristic  of  formation  of  insoluble  protein  inclusions  in 
neurodegenerative  aggregation  diseases  [35].  Chen  and  von  Mikecz  further 
advocated  that  ''silica  nanoparticles  have  emerged  as  excellent  tools  for  proof -of- 
principle  studies,  in  this  case,  establishment  of  cell-based  models  for 
degenerative  protein  aggregation  diseases"  [35]. 

Silicon  dioxide  nanoparticles  can  induce  alterations  in  mitochondrial  oxidative 
metabolism  and  induce  oxidative  stress.  For  example,  silicon  dioxide 
nanoparticles  induced  cell  death  in  U87  (astrocytes-like)  cells  by  disturbing  their 
mitochondrial  function  (Table  1)  [12].  Wu  et  al.  [16]  observed  that  treatment  of 
PC12  cells  (a  model  of  dopaminergic  neurons  in  vitro)  with  silicon  dioxide 
nanoparticles  led  to  increased  LDH  release,  enhanced  ROS  production,  increased 
MDA  production  but  decreased  levels  of  GSH  and  SOD,  and  ultimately 
decreased  cell  survival  [16].  Additionally,  their  mechanistic  studies  with  PC12 
cells  also  revealed  that  at  doses  higher  than  50  jug/mL,  the  number  of  apoptotic 
PC12  cells  increased  markedly  [16].  They  attributed  this  apoptotic  effect  induced 
by  silicon  dioxide  nanoparticles  to  the  G2/M  cell  cycle  arrest  in  conjunction  with 
increased  protein  expression  of  p53,  phospho-p53  (p-p53),  p21,  Gadd45,  and  bax, 
but  decreased  protein  expression  of  bcl-2  because  both  p21  and  Gadd45  are 
proteins  that  are  down-stream  from  p53  in  regulating  cell  cycle  whereas  the 
increase  in  bax/bcl-2  ratio  favors  apoptosis  [16].  Along  with  those  observations, 
they  also  found  that  silicon  dioxide  nanoparticles  induced  decreases  in 
dopamine  levels  and  expression  of  tyrosine  hydroxylase  (TH,  a  rate-limiting 
enzyme  in  dopamine  synthesis)  [16].  (However,  the  authors  erroneously  stated 
that  silicon  dioxide  nanoparticles  upregulated  the  expression  of  TH  in  dose- 
dependent  manner  [see  Ref.  16,  p.  4485].)  Interestingly,  and  relevant  to  this 
discussion  of  the  mechanistic  actions  of  silicon  dioxide  nanoparticles  on  neural 
cells,  the  findings  of  Wu  et  al.  in  PC12  cells  in  vitro  (i.e.,  enhanced  ROS 
production,  increased  MDA  production  but  decreased  levels  of  GSH  and 
dopamine)  confirmed  what  they  observed  in  the  striatum  of  rats  after  intranasal 
instillation  of  silicon  dioxide  nanoparticles  into  those  rats  in  vivo  [16]. 
Consequently,  their  parallel  studies  in  vivo  and  in  vitro  strongly  suggest  that 
many  -  if  not  most  -  of  the  mechanisms  underlying  the  cytotoxicity  of  silicon 
dioxide  nanoparticles  in  neural  cells  in  vitro  may  also  occur  in  the  cytotoxicity  of 
silicon  dioxide  nanoparticles  in  neural  cells  in  vivo  [16]. 

The  effects  of  silica  nanoparticles  in  primary  cultures  of  rat  microglia  in  vitro  [36] 
appear  to  somewhat  differ  from  the  effects  of  these  nanoparticles  in  PC12  cells  in 
vitro  [16]  and  in  the  rat  striatum  after  intranasal  instillation  of  the  nanoparticles 
in  vivo  [16].  Choi  et  al.  [36]  were  the  first  to  observe  that  over  a  24-hour  period, 
exposure  of  rat  microglial  cells  in  primary  culture  in  vitro  to  silica  nanoparticles 
resulted  in  the  entry  of  nanparticles  into  those  cells  via  endocytosis  and  other 
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nanoparticle  uptake  mechanisms  [36].  Similar  to  the  effects  of  silicon  dioxide 
nanoparticles  in  PC12  cells  in  vitro  [36]  and  to  the  same  effects  in  the  rat  striatum 
after  intranasal  instillation  of  the  nanoparticles  in  vivo  [16],  Choi  et  al.  also  noted 
that  these  nanoparticles  induce  oxidative  stress  in  rat  microglial  cells  in  vitro  by 
enhancing  their  production  of  ROS  and  reactive  nitrogen  species  (RNS)  and 
altering  their  expression  of  proinflammatory  genes  (i.e.,  increase  in  COX-2  but 
decrease  in  tumor  necrosis  factor-a  expression)  (Table  1)  [36].  However,  even  at 
the  highest  treatment  concentration  of  40,000  nanoparticles  per  |liL  (i.e.,  7.28 
|Lig/  mL)  for  24  hours,  silica  nanoparticles  did  not  significantly  lower  the  survival 
of  microglial  cells  in  vitro  [36].  Nevertheless,  Choi  et  al.  [36]  did  suggest  that 
continuous  production  of  ROS  by  microglia  induced  by  the  silica  nanoparticles 
could  induce  deleterious  effects  on  neurons  in  their  vicinity  and  the  dysfunction 
induced  by  the  nanoparticles  may  not  allow  the  microglia  to  sustain  neuronal 
health. 

Because  the  putative  cytotoxic  effects  of  silicon  dioxide  nanoparticles  in  neural 
cells  in  the  peripheral  nervous  system  (PNS)  are  largely  unknown,  we  have 
employed  our  in  vitro  model  of  Schwann  cells  to  systematically  investigate  the 
putative  cytotoxicity  of  silicon  dioxide  nanoparticles  on  neural  cells  derived  from 
the  PNS  [25,27,28,31,37].  We  are  the  first  to  report  on  the  effects  of  silicon  dioxide 
nanoparticles  on  neural  cells  in  the  PNS  [28,37].  Results  of  our  ongoing  studies 
have  demonstrated  that  silicon  dioxide  nanoparticles  exerted  cytotoxic  effect  on 
Schwann  cells  by  lowering  their  survival  (Table  1)  [28,37].  Light  microscopic 
examination  revealed  that  treatment  of  Schwann  cells  with  the  nanoparticles 
induced  dose-related  changes  in  cellular  morphology,  consistent  with  the 
nanoparticles-induced  progressive  decrease  in  cell  viability  and  increase  in 
uptake  of  nanoparticles.  Furthermore,  employing  flow  cytometry,  we  noted  the 
cytotoxicity  of  silicon  dioxide  nanoparticles  could  be  attributed,  at  least  in  part,  to 
the  uptake  of  the  nanoparticles  by  Schwann  cells  [28,37].  Treatment  with  silicon 
dioxide  nanoparticles  also  induced  increased  LDH  release,  decreased  glutathione 
level,  and  altered  morphology  and  expression  of  Mn-superoxide  dismutase, 
NADH  dehydrogenase  subunit  6,  and  succinate  dehydrogenase  in  Schwann  cells 
[28,37].  Thus,  our  findings  are  compatible  with  the  observation  that  silicon 
dioxide  nanoparticles  induce  decreases  in  survival  of  neural  cells  derived  from 
the  central  nervous  system  and  the  decreases  in  cell  survival  can  be  attributed,  at 
least  in  part,  to  the  nanoparticles-induced  oxidative  stress  [12,16,28,36,37]. 

The  effects  of  silicon  dioxide  nanoparticles  on  dorsal  root  ganglion  (DRG) 
neurons,  an  in  vitro  model  of  DRG  neurons  in  PNS  in  vivo  [27-29,  31,32],  only 
show  a  few  similarities  to  those  noted  in  the  Schwann  cells  in  vitro  (Table  1). 
Treatment  of  silicon  dioxide  nanoparticles  altered  the  morphology  of  DRG 
neurons:  their  nuclei  were  swollen  and  their  processes  decreased  in  number  and 
they  became  rounded  whereas  untreated  DRG  neurons  were  spindle-shaped  [28- 
37].  Treatment  of  DRG  neurons  with  silicon  dioxide  nanoparticles  did  not  induce 
any  necrotic  cell  damage  or  necrotic  cell  death  at  concentrations  from  0.1  to  150 
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|ig/mL  but  induced  oxidative  stress  by  decreasing  glutathione  levels  (Table  1) 
[28,37].  Nevertheless,  when  we  treated  DRG  neurons  with  the  nanoparticles  at 
the  highest  concentration  employed  (i.e.,  200  pg/mL),  they  showed  significant 
increases  in  LDH  release  into  the  surrounding  medium,  suggesting  that  the 
nanoparticles  did  induce  necrotic  damage  and/or  cell  death  in  DRG  neurons  at 
that  concentration  [28,37].  Thus,  the  results  of  our  current  and  ongoing  studies 
strongly  suggest  that  silicon  dioxide  nanoparticles  induce  differential  effects  on 
neural  cells  in  the  PNS. 

1.4  PATHOPHYSIOLOGICAL  IMPLICATIONS  OF  TOXICITY  OF  SILICON 
DIOXIDE  NANOPARTICLES  IN  MAMMLIAN  NEURAL  CELLS 

Even  though,  to  date,  the  literature  on  the  effects  of  silicon  dioxide  nanoparticles 
on  mammalian  neural  cells  is  rather  limited,  the  results  of  published  and 
ongoing  studies  appear  to  coalesce  into  a  recognizable  pattern  (see  Tables  1) 
which  allows  us  to  draw  some  tentative  generalizations  regarding 
pathophysiological  implications  of  toxicity  of  silicon  dioxide  nanoparticles  in 
mammalian  neural  cells.  However,  in  this  review,  we  can  only  very  briefly 
discuss  four  such  generalizations. 

(i)  Because  silicon  dioxide  nanoparticles  can  readily  cross  the  blood-brain  barrier 
(BBB)  (also  see  section  1.2  above),  once  the  nanoparticles  penetrate  into  the 
central  (or  for  that  matter,  the  peripheral)  nervous  system,  they  can  directly 
influence  neural  cells  therein.  Consequently,  whether  the  effects  of  silicon 
dioxide  nanoparticles  on  neural  cells  are  deleterious  critically  depends  on  the 
extent  of  the  accumulation  of  the  nanoparticles  in  the  nervous  tissue. 

(ii)  Evidence  is  accumulating  that  silicon  dioxide  nanoparticles  appear  to  exert 
differential  effects  on  neural  cells.  It  is  well  recognized  that  glial  cells  protect 
neurons  from  a  variety  of  pathophysiological  assaults  [26,30].  Therefore,  it  is 
conceivable  that  in  addition  to  the  direct  cytotoxic  effect  on  neurons  exerted  by 
silicon  dioxide  nanoparticles,  the  nanoparticles  can  exert  indirect  toxic  effects  on 
neurons  through  their  actions  on  glial  cells,  ultimately  compromising  the  ability 
of  glial  cells  to  maintain  neuronal  health  and  well  being. 

(iii)  As  alluded  to  above  (see  subsections  1.3.2  and  1.3.3  above),  silicon  and 
aluminum  were  found  to  be  co-localized  in  the  cores  of  senile  plaques  in  the 
cortex  of  Alzheimer's  disease  (AD)  patients  [14]  and  accumulated  silicon  and 
aluminum  were  also  found  in  lipofuscin  granules  in  patients  who  died  of  AD 
[15].  Moreover,  when  directly  introduced  into  the  brains  of  rats  and  mice  in  vivo, 
silica  nanoparticles  induced  inflammatory  responses  in  astrocytes  and 
degeneration  of  axons  and  axon  terminals  in  the  vicinity  of  the  astrocytes  [13]. 
These  early  observations  [13-15],  together  with  more  recent  reports  (see  Table  1) 
of  toxic  effects  of  silicon  dioxide  nanoparticles  on  mammalian  neural  cells  in  vivo 
and  in  vitro,  strongly  suggest  that  the  neurotoxicity  of  silicon  dioxide 
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nanoparticles  may  assume  pathophysiological  and  perhaps  even  pathogenetic 
importance  in  neurodegenerative  diseases  such  as  Alzheimer's  disease. 

(iv)  We  have  mentioned  earlier  that  their  important  findings  led  Wu  et  al.  [16]  to 
conclude  exposure  to  silicon  dioxide  nanoparticles  exerts  negative  health  impact 
on  the  striatum  in  general  and  on  dopaminergic  neurons  in  particular  and  may 
therefore  pose  a  risk  for  neurodegenerative  diseases.  Our  review  of  the  literature 
on  toxicity  of  silicon  dioxide  nanoparticles  in  mammalian  neural  cells  has  also 
prompted  us  to  propose  that  accumulation  and  toxicity  of  silicon  dioxide 
nanoparticles  in  the  striatum  may  serve  as  a  model  system  for  parkinsonism  and 
Parkinson's  disease.  Furthermore,  Chen,  von  Mikecz  and  their  associates  [35] 
elegantly  demonstrated  that  upon  entering  neural  cells,  silicon  dioxide 
nanoparticles  can  enter  their  nuclei  and  induce  the  formation  of  aberrant  protein 
aggregates  therein.  Because  such  aberrant  protein  aggregates  are  highly 
reminiscent  of  those  noted  in  the  brain  in  neurodegenerative  diseases,  Chen  and 
von  Mikecz  [35]  therefore  proposed  that  "silica  nanoparticles  have  emerged  as 
excellent  tools  for  proof-of-principle  studies,  in  this  case,  establishment  of  cell- 
based  models  for  degenerative  protein  aggregation  diseases." 


1.5  CONCLUSIONS  AND  PROSPECTS  FOR  FUTURE  RESEARCH 

In  this  concise  review,  we  have  summarized  and  discussed  the  literature  on  the 
toxicity  of  silicon  dioxide  nanoparticles  on  mammalian  neural  cells  in  vivo  and  in 
vitro.  Despite  the  fact  that,  to  date,  the  studies  published  in  this  literature  are 
rather  limited  in  number,  a  clear  and  consistent  "picture"  is  slowly  emerging 
regarding  the  mechanisms  underlying  the  toxicity  of  silicon  dioxide 
nanoparticles  in  neural  cells.  As  we  have  emphasized  earlier,  one  major  reason 
why  this  literature  is  scant  is  that  until  recently,  there  was  a  lack  of  suitable  cell 
models  in  vitro  for  high  throughput  screening  of  the  cytotoxicity  of  silicon 
dioxide  nanoparticles  —  and  for  the  matter  the  cytotoxicity  of  nanoparticles  in 
general  —  in  mammalian  neural  cells.  We  were  the  first  to  develop  neural  cell 
models  in  vitro  consisting  of  various  neural  cell  types  derived  from  both  the 
central  and  the  peripheral  nervous  systems  so  as  to  allow  the  high  throughput 
screening  of  the  cytotoxicity  of  silicon  dioxide  nanoparticles  in  mammalian 
neural  cells  [12, 17-32]. 

Based  on  a  critical  review  of  the  literature  as  well  as  current  and  ongoing  studies, 
we  can  tentatively  arrive  at  the  following  conclusions,  (i)  Far  from  being 
harmless,  silicon  dioxide  nanoparticles  can  and  do  induce  differential 
cytotoxicity  on  mammalian  neural  cells,  (ii)  Some  of  the  recognized  mechanisms 
underlying  the  toxicity  of  silicon  dioxide  nanoparticles  in  neural  cells  include, 
but  are  not  limited  to,  oxidative  stress,  inflammatory  responses,  necrotic  damage 
and  cell  death,  apoptosis,  formation  of  aberrant  nuclear  protein  aggregates  and 
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altered  mitochondrial  metabolism,  (iii)  Perhaps  the  most  interesting  and  also 
intriguing  conclusion  is  that  silicon  dioxide  nanoparticles  can  serve  as  versatile 
tools  for  elucidating  pathophysiological  and  molecular  mechanisms  underlying 
neurodegenerative  diseases  such  as  Alzheimer's  disease  and  Parkinson's  disease. 
Moreover,  our  current  and  ongoing  studies  also  strongly  suggest  that  these 
nanoparticles  can  also  be  fruitfully  exploited  to  elucidate  mechanisms 
underlying  peripheral  neuropathy. 

As  evident  from  this  concise  review,  there  are  still  much  to  be  discovered 
concerning  the  toxicity  of  silicon  dioxide  nanoparticles  in  mammalian  neural 
cells.  The  availability  of  various  models  in  vitro  consisting  of  various  neural  cell 
types  derived  from  both  the  central  as  well  as  the  peripheral  nervous  system 
greatly  facilitate  both  the  high  throughput  screening  of  the  cytotoxicity  of  silicon 
dioxide  nanoparticles  and  systematic  investigation  of  the  underlying  cellular  and 
molecular  mechanisms.  Clearly,  these  are  interesting  and  exciting  areas  that 
merit  further  and  systematic  investigation. 
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13  Synonyms 

14  Interdependence  between  manganese  and  other  metal 

15  ions;  Manganese-metal  ion  interactions 

16  Definition 

17  Manganese  and  its  interrelation  with  other  metal  ions 

18  in  health  and  disease  refers  to  how  the  level  and 

19  metabolism  of  manganese  in  an  organ  are  related  to 

20  the  levels  and  metabolism  of  other  metal  ions  in  the 

21  same  organ  in  a  healthy  individual  and  how  disease 

22  states  exert  modulatory  effects  on  such  interrelations. 

23  Introduction 

24  To  understand  the  “state  of  the  art”  regarding  manga- 

25  nese  (Mn)  and  its  interrelation  with  other  metal  ions  in 

26  health  and  disease,  one  needs  to  appreciate  the 


advantages  and  the  limitations  of  the  approaches  that  27 
critically  drive  the  advances  of  this  multidisciplinary  28 
field.  As  have  been  emphasized  earlier,  “Ideally,  if  one  29 
can  demonstrate  directly  the  mechanisms  that  causally  30 
link  the  metabolism  of  manganese  to  those  of  other  31 
metals,  then  one  can  define  the  physiological  . . .  situ-  32 
ations  or  conditions  that  show  interdependence  33 
between  Mn  and  other  metal  ions.  However,  largely  34 
because  of  methodological  limitations  as  well  as  lim-  35 
itations  of  experimental  approaches,  the  data  in  the  36 
literature  and  those  of  ongoing  studies  are  better  or  37 
more  accurately  defined  as  depicting  the  interrelations  38 
between  Mn  and  other  metal  ions.  This  conceptual  39 
distinction  should  be  borne  in  mind  when  one  assesses  40 
the  advances  in  the  topic  areas  to  be  discussed. . .”  (Lai  4i 
et  al.  2000).  42 

The  scope  of  this  entry  is  limited  to  a  summary  43 
discussion  of  the  interrelations  between  Mn  and  other  44 
elements  after  chronic  exposure  of  animals  or  humans  45 
to  Mn  because  distributions  of  ►  Mn  in  brain  regions  46 
and  in  peripheral  organs  usually  reflect  chronic  rather  47 
than  acute  exposure  to  this  metal.  Several  aspects  of  48 
this  topic  not  covered  in  this  entry  because  of  space  49 
limitations  have  been  discussed  in  some  detail  in  one  50 
or  another  of  our  previous  publications  (Chan  et  al.  51 
1983;  Lai  et  al.  1984,  1985a,  c,  1999,  2000;  Leung  52 
et  al.  2011;  Wright  et  al.  201 1).  53 

Interdependence  Between  Manganese  and  54 
Other  Metals  in  Absorption  55 

Because  manganese  (Mn)  is  an  essential  trace  metal,  56 
intake  of  this  metal  is  usually  via  food  intake  and  57 
intake  via  the  drinking  water  (Underwood  1977;  Lai  58 
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et  al.  1984,  2000).  Respiratory  exposure  of  Mn  to 
humans  is  rare  except  under  poorly  controlled  indus¬ 
trial  environments  such  as  manganese  mining,  steel 
mills,  and  metal  soldering  in  a  confined  space.  Conse¬ 
quently,  the  major  findings  to  date  employing  animal 
models  concerning  the  interdependence  between  Mn 
and  other  metals  are  centered  upon  intestinal  absorp¬ 
tion  and  subsequent  organ  distribution.  Several  gener¬ 
alizations  are  evident:  intestinal  Mn  absorption 
depends  on  dietary  iron  (Fe).  Low-dietary  Fe  enhances 
Mn  absorption  whereas  high-dietary  Fe  lowers  Mn 
absorption  (Lai  et  al.  1985c,  2000).  Similarly,  high¬ 
dietary  Mn  intake  results  in  lowered  Fe  absorption  (Lai 
et  al.  1985c,  2000).  Furthermore,  inclusion  of  essential 
and  nonessential  trace  metals  in  the  drinking  water  of 
rats  and  mice  can  alter  accumulation  of  essential  trace 
metals  (including  Mn)  in  their  peripheral  organs  (see 
Lai  et  al.  2000  for  discussion). 

Interrelations  Between  Manganese  and 
Other  Metals  in  Several  Peripheral  Organs 

A  developmental  rat  model  had  been  developed  so  that 
the  organ  distribution  of  multiple  metals  and  other 
elements  could  be  systematically  analyzed  based  on 
dietary  intake.  Furthermore,  by  exposing  rats  in  utero 
to  manganese  (added  as  the  chloride  form  in  the  drink¬ 
ing  water)  and  continuously  until  they  were  employed 
for  analysis,  the  effects  of  Mn  on  the  distributions  of 
other  trace  metals  and  electrolytes  in  various  organs 
during  development  and  aging  can  be  systematically 
investigated  employing  versatile  techniques  such  as 
instrumental  neutron  activation  analysis  (INAA) 
(Chan  et  al.  1983;  Lai  et  al.  1984,  1999,  2000).  Those 
series  of  studies  constitute  the  largest  and  most  com¬ 
plete  sets  of  data  in  the  Mn-metal  interaction  literature 
(Chan  et  al.  1983;  Lai  et  al.  1985a,  1985c,  1999,  2000; 
Leung  et  al.  2011;  Wright  et  al.  201 1). 

The  relative  distribution  of  trace  metals  in  different 
peripheral  organs  subsequent  to  their  intestinal  absorp¬ 
tion  reflects  the  amount  of  metal-binding  molecules 
(e.g.,  proteins  and  nucleic  acids)  in  each  organ  and 
the  organ’s  storage  capacity  (Lai  et  al.  2000).  In  rats, 
the  rank  order  of  the  relative  abundance  of  trace  metals  in 
peripheral  organs  is  Fe  ^  Zn  >  Cu  >  Al  >  Mn  >  Se. 
The  rank  order  of  Fe  level  in  peripheral  organs  is  spleen 
::$>  liver  >  lung  >  heart  kidney.  The  rank  order  of 
Zn  level  is  liver  ::$>  kidney  >  spleen  lung  heart. 


The  rank  order  of  Cu  level  is  kidney  ^  liver  io5 
heart  >  spleen  >  lung.  The  rank  order  of  Mn  level  io6 
is  liver  ^  kidney  ^  spleen  heart  >  lung  whereas  i07 
that  for  Se  is  kidney  >  liver  >  spleen  >  io8 
lung  =  heart.  However,  the  rank  order  of  the  level  io9 
of  the  nonessential  metal  Al  is  spleen  >  liver  >  no 
heart  >  kidney  ~  lung.  in 

In  adult  (i.e.,  120-day-old)  rats,  chronic  Mn  treat-  112 
ment  induces  dose-related  differential  elevation  in  Mn  113 
in  heart,  kidney,  spleen,  and  liver  (Lai  et  al.  1985c,  114 
2000) .  Associated  with  the  differential  elevation  of  Mn  1 1 5 
in  the  peripheral  organs  is  a  shift  in  the  patterns  of  116 
organ  distribution  of  trace  metals  (Lai  et  al.  1985c,  117 
2000).  For  example,  in  Mn-treated  rats,  Fe  levels  are  118 
increased  in  spleen  and  lung  whereas  Zn  level  is  119 
decreased  in  liver  and  Cu  level  is  decreased  in  spleen,  120 
compared  to  corresponding  levels  in  untreated  rats  (Lai  121 
et  al.  1985c,  2000).  However,  the  organ  distributions  of  122 
several  other  metals  are  also  affected  by  chronic  man-  123 
ganese  exposure.  (Because  of  space  limitation,  those  124 
findings  will  not  be  discussed  here:  see  Lai  et  al.  1985c,  125 
2000  for  additional  details.)  126 

Based  on  the  findings  discussed  above,  two  gener-  127 
alizations  can  be  arrived  at:  (1)  Dietary  intake  of  trace  128 
metals  and  electrolytes  and  their  subsequent  organ  129 
distribution  is  under  regulatory  control  even  though  130 
the  mechanisms  mediating  the  control  are  far  from  131 
being  understood.  (2)  Increasing  the  levels  of  Mn  in  132 
dietary  intake  (e.g.,  via  addition  of  manganese  salt  in  133 
the  drinking  water)  ultimately  alters  the  patterns  of  134 
organ  distribution  of  trace  metals.  135 

Regional  Differences  in  Distribution  of  Trace  i36 
Metals  in  Brain  137 

In  the  adult  rat,  whole  brain  levels  of  trace  metals  differ  i38 
and  the  rank  order  of  levels  of  several  trace  metals  is  139 
Fe  >  Zn  >  Al  >  Cu  >  Se  Mn  (Lai  et  al.  1985c,  i4o 
2000).  Additionally,  brain  levels  of  several  trace  i4i 
metals  (e.g.,  Fe,  Cu,  Mn,  and  Se)  are  altered  in  the  142 
aged  rat  brain  compared  to  the  corresponding  levels  in  143 
the  young  adult  rat  brain  (Lai  et  al.  1985c,  2000).  On  i44 
the  other  hand,  each  trace  metal  has  its  own,  almost  145 
unique,  brain  regional  distribution.  i46 

In  development,  various  regions  of  the  mammalian  147 
brain  undergo  structural  changes  concomitant  with  i48 
increases  in  glial  cell  numbers  and  migrations  of  grow-  149 
ing  and  maturing  neurons  (Lai  et  al.  2000).  Although  150 
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151  not  yet  fully  understood,  these  developmental  struc- 

152  tural  and  cellular  changes  ultimately  give  rise  to  each 

153  trace  metal  exhibiting  its  characteristic  regional  distri- 

154  bution  in  the  adult  brain  (Lai  et  al.  1985c,  2000).  For 

155  example,  in  the  adult  rat,  Fe  level  is  higher  in  hippo- 

156  campus,  hypothalamus,  pons  and  medulla,  and  cere- 

157  bellum  than  in  midbrain,  striatum,  and  cerebral  cortex. 

158  Zn  level  is  higher  in  hippocampus  and  cerebral  cortex 

159  than  in  the  other  regions  whereas  Cu  level  is  highest  in 

160  hypothalamus,  intermediate  in  striatum,  midbrain,  and 

161  cerebellum  but  lowest  in  hippocampus,  pons  and 

162  medulla,  and  cerebral  cortex.  Se  level  is  highest  in 

163  hippocampus,  midbrain,  and  hypothalamus,  interme- 

164  diate  in  cerebellum  and  cerebral  cortex,  but  lowest  in 

165  striatum  and  pons  and  medulla.  Mn  level  is  highest  in 

166  midbrain,  cerebellum,  and  pons  and  medulla,  interme- 

167  diate  in  cerebral  cortex  and  hypothalamus,  but  lowest 

168  in  striatum  and  hippocampus.  The  level  of  the  nones- 

169  sential  trace  metal,  Al,  unlike  those  of  the  essential 

170  metals  (e.g.,  Fe,  Zn,  Cu,  Mn,  Se)  is  lower  in  cerebral 

171  cortex  than  those  in  other  regions. 

172  Distributions  of  electrolytes  are  also  somewhat  dif- 

173  ferent  from  those  of  trace  metals  (Lai  et  al.  1985c, 

174  2000).  In  the  adult  rat,  Ca  level  is  lower  in  cerebral 

1 75  cortex  and  midbrain  than  in  the  other  regions.  Mg  level 

176  is  also  lower  in  cerebral  cortex  than  those  in  other 

177  regions. 

178  Interrelations  Between  Manganese  and 

179  Other  Metals  in  Brain 

180  To  facilitate  the  investigation  of  the  interrelations 

181  between  manganese  and  other  trace  metals  and  elec- 

182  trolytes  in  brain  and  other  organs,  a  model  of  chronic 

183  and  life-span  exposure  of  rats  to  manganese  had  been 

184  developed  (Lai  et  al.  1984,  1985b).  Chronic  Mn  expo- 

185  sure  was  carried  out  by  adding  MnCl2.4H20  into  the 

186  drinking  water  given  to  the  rats.  Four  groups  of  rats 

187  were  studied:  the  control  group  was  given  just  the 

188  double-distilled  water;  group  A  was  given  1  mg  of 

189  MnCl2.4H20  per  mL  of  double-distilled  water;  group 

190  B  was  given  10  mg  of  MnCl2.4H20  per  mL  of  double- 

191  distilled  water;  and  group  C  was  given  20  mg  of 

192  MnCl2.4H20  per  mL  of  double-distilled  water  (Lai 

193  et  al.  1984,  1985b).  The  rats  were  exposed  to  Mn  in 

194  utero  via  their  mothers’  circulation;  postnatally,  they 

195  were  exposed  to  Mn  via  their  mothers’  milk;  and  from 

196  around  weaning  (i.e.,  21/22  days  postnatal)  onward. 


they  were  directly  exposed  to  Mn  in  the  drinking  water  197 
(Lai  et  al.  1984,  1985b).  When  the  rats  attained  full  i98 
adulthood  (i.e.,  at  120  days  of  age),  they  were  eutha-  199 
nized  and  their  organ  removed  (Lai  et  al.  1984, 1985b).  200 
Each  rat  brain  was  dissected  into  the  following  seven  201 
regions:  cerebellum,  cerebral  cortex,  hippocampus,  202 
hypothalamus,  midbrain,  pons  and  medulla,  and  stria-  203 
turn  (Lai  et  al.  1984,  1985b).  The  contents  of  trace  204 
metals  and  other  elements  in  each  brain  region  were  205 
determined  employing  instrumental  neutron  activation  206 
analysis  (INAA)  (Chan  et  al.  1983;  Lai  et  al.  1985c,  207 
1999,  2000).  By  combining  the  versatile  technique  of  208 
INAA  with  the  animal  model  of  chronic  and  life-span  209 
exposure  to  Mn,  a  comprehensive  metallomic  database  210 
had  been  collected  of  levels  of  trace  metals  and  other  21 1 
essential  and  nonessential  elements  in  all  the  brain  212 
regions  in  the  four  groups  of  rats  (one  control  and  213 
three  Mn- treated  groups,  namely.  A,  B,  and  C)  (Chan  214 
et  al.  1983;  Lai  et  al.  1985c,  1999,  2000).  The  data  215 
were  taken  from  the  comprehensive  metallomic  data-  21 6 
base  and  then  analyzed  so  as  to  allow  the  interpretation  217 
of  how  Mn  can  interact  with  trace  and  major  elements  21 8 
in  discrete  rat  brain  regions  (Leung  et  al.  2011;  Wright  219 
et  al.  201 1).  The  level  of  each  trace  metal  or  element  in  220 
each  brain  region  in  the  Mn-treated  rat  was  compared  221 
with  the  corresponding  level  (set  as  100%)  in  the  same  222 
region  in  the  untreated  (i.e.,  control)  rat  and  the  differ-  223 
ence  ranked  as  %  increase  or  %  decrease  relative  to  the  224 
value  in  the  control  animal.  For  ease  of  visual  compar-  225 
ison,  the  rank  orders  of  increases  or  decreases  of  levels  226 
were  color-coded  (Tables  1  and  2)  (Leung  et  al.  2011;  227 
Wright  et  al.  2011).  228 

As  evident  from  the  rank-order  patterns  of  the  229 
regional  distributions  of  trace  metals  (Table  1)  and  230 
electrolytes  (Table  2)  in  the  seven  brain  regions  in  231 
the  rats  treated  with  the  three  doses  of  Mn,  several  232 
generalizations  regarding  how  Mn  interacts  with  233 
other  trace  metals  and  other  elements  can  be  arrived  234 
at.  (1)  Because  the  distributions  of  trace  metals  and  235 
other  elements  in  the  adult  rat  brain  show  region-  236 
specific  differences,  their  patterns  of  distribution  in  237 
the  untreated  normal  rat  brain  are  significantly  altered  238 
by  Mn  treatment  and  such  alterations  can  be  generally  239 
correlated  with  the  dose  of  Mn  administered  (Tables  1  240 
and  2).  (2)  Mn  treatment  leads  to  selective,  region-  241 
specific  increases  in  the  accumulation  of  some  trace  242 
and  major  elements  (Tables  1  and  2).  (3)  Mn  treatment  243 
results  in  selective,  region- specific  decreases  in  the  244 
accumulation  of  other  trace  and  major  elements  245 
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246  (Tables  1  and  2).  (4)  By  contrast,  Mn  treatment  gives 

247  rise  to  both  increases  and  decreases  in  the  accumula- 

248  tion  of  some  other  trace  and  major  elements,  and  these 

249  fluctuations  in  their  accumulation  are  dependent  on 

250  both  brain  region  in  question  and  the  dose  of  Mn 

251  administered  (Tables  1  and  2). 

252  As  may  be  expected,  upon  chronic  Mn  treatment, 

253  Mn  levels  show  the  largest  region- specific  increases 

254  among  all  the  trace  metals  that  were  investigated  and 

255  showed  increases  (Table  1).  Among  the  trace  metals 

256  examined  showing  region- specific  increases  in  their 

257  levels  induced  by  Mn  treatment,  the  rank  order  of 

258  their  relative  changes  compared  with  each  other  is 

259  Mn  >  Hg  >  Cu  >  Se  (Table  1).  Because  all  these 

260  trace  metals  are  neurotoxic  when  taken  in  excess,  this 

261  finding  suggests  that  increased  brain  regional  Mn  accu- 

262  mulation  consequent  to  Mn  treatment  results  in 

263  increased  regional  accumulation  of  Hg  (a  nonessential 

264  toxic  metal),  Cu,  and  Se,  ultimately  leading  to 

265  a  cumulative  toxicity  due  to  all  three  metals  and  per- 

266  haps  even  neurodegeneration. 

267  Among  the  trace  metals  and  other  elements  show- 

268  ing  region- specific  decreases  in  their  levels  induced  by 

269  Mn  treatment,  the  rank  order  of  their  relative  changes 

270  compared  with  each  other  is  F  >  V  >  Br  >  A1  >  Mo 

271  (Table  1).  The  functional  roles  of  F,  V,  Br,  and  Mo  in 

272  mammalian  brain  are  poorly  defined.  Nevertheless,  Al, 

273  a  nonessential  trace  metal  in  mammals,  is  known  to  be 

274  neurotoxic  (Lai  et  al.  2000).  Thus,  this  finding  suggests 

275  that  Mn  accumulation  consequent  to  Mn  treatment 

276  induces  region- specific  decreases  in  Al  accumulation, 

277  leading  to  a  lowering  of  neurotoxicity  due  to  Al. 

278  Among  the  trace  metals  and  other  elements  show- 

279  ing  region- specific  fluctuations  (i.e.,  both  trends  of 

280  increases  and  decreases)  in  their  levels  induced  by 

281  Mn  treatment,  the  rank  order  of  their  relative  changes 

282  compared  with  each  other  is  Cr  >  Zn  >  Co  >  Rb  >  I 

283  (Table  1).  The  functional  roles  of  Cr,  Rb,  and  I  in 

284  mammalian  brain  are  not  defined.  Zn  is  an  essential 

285  trace  metal:  its  decreases  and  increases  in  brain 

286  regional  accumulation  induced  by  Mn  treatment 

287  could  lead  to,  respectively,  deficiency  and  toxicity 

288  states  (Lai  et  al.  2000).  On  the  other  hand,  the  only 

289  known  role  of  Co  in  mammals  is  that  it  is  a  component 

290  in  vitamin  B 1 2  and  is  required  in  ultra- trace  quantities. 

291  However,  it  is  neurotoxic  when  taken  in  excess.  Thus, 

292  the  decreases  and  increases  in  brain  regional  accumu- 

293  lation  of  Co  induced  by  Mn  treatment  could  give  rise 


to,  respectively,  vitamin  B12  deficiency  and  Co  294 
neurotoxicity.  295 

Brain  Fe  level  approaches  those  of  major  elements  296 
and  electrolytes  such  as  Ca  (Lai  et  al.  1985c,  2000).  Fe  297 
interacts  with  Mn  in  intestinal  absorption  (see  above):  298 
thus,  consistent  with  this  notion  is  the  observation  that  299 
in  Mn- treated  rats,  the  largest  increase  in  Fe  levels  are  300 
noted  in  hypothalamus,  striatum,  and  cerebellum  301 
(Table  2),  and  these  are  the  same  regions  that  show  302 
the  highest  accumulation  of  Mn  (Table  1).  Because  Fe  303 
is  neurotoxic  when  taken  and/or  accumulated  in  304 
excess,  this  observation  suggests  that  the  increase  in  305 
Fe  accumulation  could  accentuate  the  neurotoxicity  of  306 
the  accumulated  Mn,  possibly  leading  to  enhanced  307 
neurodegeneration  (Lai  et  al.  2000).  308 

Similar  to  Fe,  two  electrolytes  (namely,  Na  and  Cl)  309 
show  region-specific  increases  in  their  levels  induced  310 
by  Mn  treatment,  the  rank  order  of  their  relative  311 
changes  compared  with  each  other  is  Fe  >  Na  >  Cl  312 
(Table  2).  This  finding  suggests  that  increases  in  Na  313 
and  Cl  accumulation  induced  by  Mn  treatment  could  314 
result  in  altered  ionic  balance  in  neural  cells.  315 

Unlike  the  trace  metals,  none  of  the  electrolytes  31 6 
exhibit  predominantly  region- specific  decreases  in  317 
their  levels  induced  by  Mn  treatment  (Table  2).  31 8 

Three  other  electrolytes  exhibit  region- specific  flue-  31 9 
tuations  (i.e.,  both  trends  of  increases  and  decreases)  in  320 
their  levels  induced  by  Mn  treatment,  the  rank  order  of  321 
their  relative  changes  compared  with  each  other  is  322 
Ca  >  K  >  Mg  (Table  2).  It  is  interesting  to  note  that  323 
Mn  treatment  results  in  increased  Ca  accumulation  in  324 
midbrain,  pons  and  medulla,  and  striatum  but  325 
decreased  accumulation  in  cerebellum  and  hippocam-  326 
pus  (Table  2),  suggesting  in  Mn-treated  rats,  midbrain,  327 
pons  and  medulla,  and  striatum  are  the  regions  that  328 
are  prone  to  calcification  and  Ca-mediated  329 
neurodegeneration  (Lai  et  al.  2000).  On  the  other  330 
hand,  the  Mn-treatment-induced  fluctuations  in  331 
regional  K  may  lead  to  altered  neuronal  excitability  332 
and  conduction,  while  the  fluctuations  in  regional  Mg  333 
could  result  in  some  alterations  in  key  protein  func-  334 
tions  (e.g.,  receptor-gaited  ion  channels  and  protein  335 
kinases)  in  which  Mg  plays  important  roles.  336 

In  addition  to  the  findings  discussed  above,  chronic  337 
and  life-span  Mn  treatment  also  modulates  on  the  338 
region- specific  distributions  of  trace  metals  and  elec-  339 
trolytes  during  development  and  aging.  Some  of  those  340 
findings  have  been  discussed  previously  and  will  not  341 


Comp,  by:  Prabu  Stage:  Proof  Chapter  No.:  330  Title  Name:  EMP 
Date:2/3/12  Time:  19:04:39  Page  Number:  5 


Mn  and  Its  Interrelation  with  Other  Metal  Ions  in  Health  and  Disease 


5  M 


342  be  reiterated  here  (see  Lai  et  al.  1985c,  1999,  2000  for 

343  detailed  discussion). 

344  Taken  together,  the  region- specific  interactions 

345  between  Mn  and  other  trace  metals  and  other  elements 

346  (Tables  1  and  2)  may  have  pathophysiological  impli- 

347  cations  in  neurodegenerative  and  other  neurological 

348  diseases  (see  below). 

349  Interrelations  Between  Manganese  and 

350  Other  Metals  in  Brain  in  Human  Health  and 

351  Diseases 

352  While  Mn  can  interact  with  trace  elements  (e.g.,  F,  V, 

353  Br,  Al,  Mo)  leading  to  region-specific  decreases  in 

354  their  accumulation,  the  health  impact  of  the  Mn- 

355  induced  decreases  is  largely  unknown  as  the  functional 

356  roles  of  these  trace  elements  in  brain,  with  the  excep- 

357  tion  of  Al,  are  unknown.  Of  some  health  concern  are 

358  the  Mn  interactions  where  brain  regional  levels  of  trace 

359  metals  become  increased:  these  trace  metals  include 

360  Mn,  Hg,  Cu,  Se,  Fe,  and  Zn.  The  available  evidence 

361  suggests  that  the  accumulation  of  these  metals  may 

362  have  pathophysiological  implications  in  several  neu- 

363  rodegenerative  and  other  neurological  diseases  and  the 

364  implications  are  briefly  summarized  below. 

365  High  brain  levels  of  Mn,  Ca,  and  Al  are  found  in 

366  Alzheimer’s  disease  (AD).  In  AD  patients,  plasma 

367  levels  of  Al,  Cd,  Hg,  and  Se  are  increased  (see  Lai 

368  et  al.  2000  for  discussion).  Fe  is  also  elevated  in  mul- 

369  tiple  regions  of  the  AD  brain.  Fe  in  the  cores  and  rims 

370  of  senile  plaques  of  amygdala  of  AD  patients  is  ele- 

371  vated  and  Fe  (like  Cu  and  Zn)  can  accelerate  aggrega- 

372  tion  of  (3-amyloid  peptide,  a  hallmark  of  AD 

373  neuropathology  (see  Lai  et  al.  2000  for  discussion). 

374  Additionally,  Zn  level  is  increased  in  different  regions 

375  of  the  AD  brain  (see  Lai  et  al.  2000  for  discussion). 

376  Consequently,  Fe,  Zn,  Al,  and  Cu  have  been  proposed 

377  to  be  responsible  for  inducing  cell  death,  especially 

378  neuronal  cell  death,  in  the  AD  brain  because  of  (a) 

379  formation  of  reactive  oxygen  species,  (b)  other  metal- 

380  mediated  cytotoxic  effects,  or  (c)  a  combination  of 

381  mechanisms  (see  Lai  et  al.  2000  for  discussion). 

382  Chronic  ►  Mn  toxicity  in  humans  shows  signs  and 

383  symptoms  that  are  reminiscent  of  those  noted  in 

384  Parkinson’s  disease  (PD)  and  dystonia  (Lai  et  al. 

385  2000).  Some  but  not  all  studies  have  demonstrated  an 

386  increased  brain  level  of  Mn  in  PD.  However,  increased 


levels  of  Fe  and  Zn  are  found  in  the  substantia  nigra  of  387 
PD  patients.  388 

In  several  neurological  diseases  other  than  AD  and  389 
PD,  brain  metabolism  of  Mn  and  other  metals  are  also  390 
disturbed.  Pick’s  disease  is  associated  with  increases  in  391 
brain  Mn,  Fe,  and  Na  and  decreases  in  brain  Cr  and  Se.  392 
In  amyotrophic  lateral  sclerosis  (ALS)  brain,  levels  of  393 
Al  and  Ca  are  elevated.  These  findings  suggest  Mn  394 
may  interact  with  other  metals  in  Pick’s  disease  and  395 
in  ALS  (see  Lai  et  al.  2000  for  discussion).  396 

In  some  metabolic  encephalopathies  (e.g.,  dialysis  397 
encephalopathy,  chronic  renal  failure  without  dialysis,  398 
and  hepatic  coma),  brain  Al  is  elevated.  Thus,  Al  399 
neurotoxicity  is  implicated  in  these  encephalopathies.  4oo 
There  is  also  good  evidence  that  Mn  level  is  elevated  in  4oi 
globus  pallidus  of  patients  with  liver  cirrhosis,  thereby  402 
implicating  ►  Mn  in  brain  in  hepatic  encephalopathy  403 
(see  Lai  et  al.  2000  for  discussion).  404 

Conclusions  and  Prospects  for  Future  405 

Investigation  406 

There  have  been  significant  advances  in  our  under-  407 
standing  of  manganese  and  its  interrelations  with  408 
other  metal  ions  in  health  and  disease.  The  advances  409 
in  the  last  25  years  have  been  built  upon  the  skillful  4io 
exploitation  of  the  versatile  technique  of  instrumental  41 1 
neutron  activation  analysis  (INAA)  in  conjunction  412 
with  a  rat  model  of  chronic  and  life-span  exposure  to  413 
Mn  in  constructing  and  assembling  a  comprehensive  41 4 
metallomic  database  containing  the  distributions  of  415 
over  20  trace  and  major  elements  in  seven  discrete  41 6 
brain  regions  and  in  multiple  peripheral  organs  in  rats  417 
during  their  life  span  (i.e.,  from  early  postnatal  devel-  4i8 
opment  until  aging).  This  comprehensive  database  also  419 
contains  the  distributions  of  some  20  trace  and  major  420 
elements  in  seven  discrete  brain  regions  and  in  multi-  421 
pie  peripheral  organs  in  rats  continuously  exposed  to  422 
three  doses  of  Mn  over  their  life  span.  The  gradual  423 
mining  and  analyses  of  selected  sets  of  data  within  this  424 
comprehensive  metallomic  database  have  allowed  us  425 
to  arrive  at  a  number  of  fundamental  conclusions  as  to  426 
how  Mn  interacts  with  other  trace  and  major  elements  427 
in  various  regions  of  the  rat  brain  and  in  various  428 
peripheral  organs.  429 

(1)  Mn  interacts  with  multiple  trace  elements  (espe-  430 
daily  Fe)  in  the  process  of  intestinal  absorption.  431 
(2)  Each  trace  and  major  element  has  its  own,  almost  432 
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433  unique,  brain  regional  distribution.  (3)  The  patterns  of 

434  distributions  of  trace  and  major  elements  in  the 

435  untreated  rat  brain  show  region- specific  differences, 

436  and  these  patterns  are  significantly  altered  by  Mn  treat- 

437  ment  in  an  approximately  dose-related  manner.  (4)  The 

438  patterns  of  brain  regional  distributions  of  trace  and 

439  major  elements  in  the  adult  rats  and  the  modulations 

440  by  chronic  Mn  treatments  thereon  have  implications  in 

441  health  and  disease,  especially  in  regard  to  several  neu- 

442  rodegenerative  (e.g.,  Alzheimer’s  disease  and 

443  Parkinson’s  disease)  and  other  neurological  diseases. 

444  (5)  However,  the  cellular  and  molecular  mechanisms 

445  underlying  how  Mn  interacts  with  other  trace  and 

446  major  elements  in  brain  and  other  organs  are  almost 

447  totally  unknown.  (6)  Nevertheless,  the  continued  min- 

448  ing  and  systematic  analyses  of  discrete  segments  of  the 

449  comprehensive  metallomic  database  are  beginning  to 

450  facilitate  the  formulation  of  discrete,  testable  hypoth- 

451  eses  regarding  such  cellular  and  molecular  mecha- 

452  nisms  and  lead  to  novel  and  productive  research. 

453  Thus,  these  endeavors  promise  to  break  new  grounds 

454  in  our  understanding  of  how  trace  and  major  elements 

455  interact  in  biological  systems. 
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ti  1  Mn  and  Its  Interrelation  with  Other  Metal  Ions  in  Health  and  Disease,  Table  1  Changes  in  levels  of  trace  metals  and  other 
elements  in  brain  regions  in  adult  female  rats  after  chronic  treatment  with  Mn  compared  with  corresponding  levels  in  untreated  (i.e., 
control)  rats.  The  Mn-treated  groups  consisted  of  group  A  (1  mg  of  MnCl2.4H20  per  mL  of  double-distilled  water),  group  B  (10  mg  of 
MnCl2.4H20  per  mL  of  double -distilled  water),  and  group  C  (20  mg  of  MnCl2.4H20  per  mL  of  double-distilled  water).  The  data  were 
derived  from  the  comprehensive  metallomic  database.  The  level  of  each  trace  metal  or  element  in  each  brain  region  in  the  Mn-treated 
rat  was  compared  with  the  corresponding  level  (set  as  100%)  in  the  same  region  in  the  untreated  (i.e.,  control)  rat  and  the  difference 
ranked  as  %  increase  or  %  decrease  relative  to  the  value  in  the  control  animal.  For  ease  of  visual  comparison,  the  rank  orders  of 
increases  or  decreases  of  levels  were  color-coded  as  follows:  Those  levels  showing  %  higher  than  corresponding  values  in  control  rats 
were  color-coded  as:  red,  0-25%;  purple,  25-50%;  and  brown,  >50%.  Those  levels  showing  %  decrease  compared  with 
corresponding  values  in  control  rats  were  color-coded  as:  yellow,  0%  to  —25%;  green,  —25%  to  —50%;  and  blue,  >—50%.  Those 
levels  that  were  the  same  as  corresponding  values  in  control  rats  were  coded  in  black  and  those  levels  that  were  not  detectable  (i.e., 
below  the  limits  of  detection)  by  the  INAA  technique  were  not  color-coded  (i.e.,  white) 
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t2  1  Mn  and  Its  Interrelation  with  Other  Metal  Ions  in  Health  and  Disease,  Table  2  Changes  in  levels  of  iron  and  electrolytes  in 
brain  regions  in  adult  female  rats  after  chronic  treatment  with  Mn  compared  with  corresponding  levels  in  untreated  (i.e.,  control)  rats. 
The  Mn-treated  groups  consisted  of  group  A  (1  mg  of  MnCl2.4H20  per  mL  of  double-distilled  water),  group  B  (10  mg  of 
MnCl2.4H20  per  mL  of  double-distilled  water),  and  group  C  (20  mg  of  MnCl2.4H20  per  mL  of  double-distilled  water).  The  data 
were  derived  from  the  comprehensive  metallomic  database.  The  level  of  each  trace  metal  or  element  in  each  brain  region  in  the  Mn- 
treated  rat  was  compared  with  the  corresponding  level  (set  as  100%)  in  the  same  region  in  the  untreated  (i.e.,  control)  rat  and  the 
difference  ranked  as  %  increase  or  %  decrease  relative  to  the  value  in  the  control  animal.  For  ease  of  visual  comparison,  the  rank 
orders  of  increases  or  decreases  of  levels  were  color-coded  as  follows:  Those  levels  showing  %  higher  than  corresponding  values  in 
control  rats  were  color-coded  as:  red,  0-25%;  purple,  25-50%;  and  brown,  >50%.  Those  levels  showing  %  decrease  compared  with 
corresponding  values  in  control  rats  were  color-coded  as:  yellow,  0%  to  —25%;  green,  —25%  to  —50%;  and  blue,  >—50%.  Those 
levels  that  were  the  same  as  corresponding  values  in  control  rats  were  coded  in  black  and  those  levels  that  were  not  detectable  (i.e., 
below  the  limits  of  detection)  by  the  INAA  technique  were  not  color-coded  (i.e.,  white) 
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1.1  INTRODUCTION 

In  a  recent  draft  document,  the  US  Environmental  Protection  Agency  (EPA)  has 
emphasized  that  exposure  to  nanomaterials  can  occur  during  their  fabrication  or 
production  process  because  the  materials  can  pollute  the  environment  [1]. 
Environmental  exposure  of  humans  to  silicon  dioxide  has  been  increasing 
because  of  escalating  use  of  silicon  dioxide,  including  a  range  of  its  particle  sizes, 
in  cosmetics,  food,  and  drug  formulations  [2,3].  Although  silicon  dioxide  has 
been  considered  to  be  a  comparatively  nontoxic  substance,  research  in  the  last 
two  decades  has  revealed  that  silicon  dioxide  particles  are  not  as  harmless  as 
they  were  previously  assumed  to  be. 

In  sizes  above  the  micrometer  range  (i.e.,  >  1  jam),  silicon  dioxide  appears  to  be 
benign  to  humans,  insects,  and  microorganisms.  However,  silicon  dioxide 
particles  of  sizes  smaller  than  1  pm  can  exert  toxic  effects  in  humans  and  animals. 
For  example,  silicosis  is  a  disease  found  both  in  humans  and  rats:  the  underlying 
silicon  dioxide  toxicity  is  due  to  prolonged  exposure  to  crystalline  silica  dust. 
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leading  to  pulmonary  injuries  or  lung  inflammation  [4,5].  Because  silicon  dioxide 
nanoparticles  can  readily  cross  the  blood-brain  barrier  (see  below),  they  can 
penetrate  into  the  nervous  system  and  exert  their  toxicity  on  neural  cells.  This 
review  therefore  focuses  on  discussing  the  effects  of  silicon  dioxide  nanoparticles 
on  neural  cells  both  in  vivo  and  in  vitro.  Three  recent  reviews  [6-8]  cover  the 
toxicity  of  these  particles  in  peripheral  tissues  and  cell  types:  readers  are  referred 
to  those  for  effects  of  silicon  dioxide  nanoparticles  on  non-neural  cell  types  and 
other  aspects  not  covered  in  this  review. 

1 .2  NANOPARTICLES  CAN  CROSS  THE  BLOOD-BRAIN  BARRIER 

The  blood-brain  barrier  (BBB)  constitutes  an  effective  barrier  to  exclude 
undesirable  and/or  toxic  substances  in  the  circulation  from  entering  the  central 
nervous  system,  including  the  brain.  In  this  context,  for  targeting  therapeutic 
agents  to  the  brain,  one  needs  to  device  mechanism(s)  whereby  this  restriction  of 
the  BBB  is  overcome  or  by-passed.  Consequently,  various  studies  on  employing 
nanoparticles  to  assist  with  drug  delivery  or  delivery  of  genetic  material  to 
advance  gene  therapy  have  concluded  that  nanoparticles  can  cross  the  BBB 
[9,10].  For  example,  Kim  et  al.  [9]  synthesized  silica-overcoated  magnetic 
nanoparticles  containing  rhodamine  B  isothiocyanate  within  a  silica  shell  of 
controllable  thickness  (MNPs@Si02(RITC)):  in  that  study  they  employed 
particles  with  50-nm  thickness.  They  administered  those  particles 
intraperitoneally  into  mice  for  four  weeks  and  were  able  to  detect  the 
nanoparticles  in  the  brains  of  those  mice.  Their  study  [9]  clearly  demonstrated 
that  such  nanoparticles  can  penetrate  the  BBB. 

Nanoparticles  have  also  been  employed  to  achieve  neuron-specific  delivery  of 
genetic  material  to  advance  gene  therapy  of  various  neurological  disorders.  For 
example,  Zang  et  al.  [11]  employed  85-nm  PEGylated  immunoliposome 
(containing  antibodies  to  the  rat  transferrin  receptor)  to  deliver  tyrosine 
hydroxylase  (TH)  expression  plasmid  to  normalize  TH  activity  in  the  striatum  in 
a  rat  model  of  experimental  parkinsonism  induced  by  6 -hydroxy dopamine.  Their 
results  demonstrated  that  intravenously-administered  immunoliposomes 
containing  the  TH  expression  plasmid  could  cross  the  BBB  giving  rise  to 
increased  striatal  TH  activity  in  the  TH-transfected  rats  [11].  Thus,  their  findings 
suggested  that  the  immunoliposomes  crossed  the  BBB  via  the  transvascular  route 
[11].  In  addition  to  the  transvascular  route,  nanoparticles  can  also  cross  the  BBB 
after  they  have  induced  alterations  in  BBB  permeability  and  induced  cerebral 
edema  [10]. 
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1.3  TOXICITY  OF  SILICON  DIOXIDE  NANOPARTICLES  IN  MAMMALIAN 
NEURAL  CELLS 

The  toxicity  of  silicon  dioxide  nanparticles  in  mammalian  neural  cells  is 
discussed  below  from  three  perspectives:  (i)  environmental  health  impact  of 
exposure  to  silicon  dioxide  nanoparticles,  (ii)  toxicity  of  the  nanoparticles  in 
mammalian  neural  cells  in  vivo,  and  (iii)  toxicity  of  the  nanoparticles  in 
mammalian  neural  cells  in  vitro. 

1 .3.1  Environmental  health  impact  of  exposure  to  silicon  dioxide 
nanoparticles 

As  has  already  been  alluded  to  above,  the  ever  increasing  use  of  silicon  dioxide, 
including  a  range  of  its  particles  sizes,  in  cosmetics,  food,  drug  formulations,  and 
numerous  other  industrial  applications  [2,3,12]  has  raised  some  concerns 
regarding  the  environmental  health  impact  of  human  exposure  to  silicon  dioxide 
particles,  especially  nanoparticles  [12].  Because  nanoparticles,  including  silicon 
dioxide  nanoparticles,  can  cross  the  BBB  (see  above),  their  accumulation  in 
significant  quantities  in  the  central  nervous  system  can  induce  deleterious  effects 
on  neural  cells,  thereby  disturbing  the  normal  functions  of  such  cells  and  even 
inducing  neurodegeneration.  The  findings  of  three  early  studies  provide  some 
support  for  the  notion  that  accumulation  of  silicon  dioxide  nanoparticles  in  brain 
could  lead  to  neurodegeneration  [13-15].  Silica  micro-  and  nanoparticles,  when 
introduced  into  the  brains  of  rats  and  mice,  induced  inflammatory  responses  in 
brain  astrocytes  and  macrophages  and  degeneration  of  axons  and  axon  terminals 
adjacent  to  the  astrocytes  [13].  Silicon  and  aluminum  were  noted  to  be  co¬ 
localized  in  the  central  region  of  senile  plaque  cores  in  the  cortex  of  patients  with 
senile  dementia  of  the  Alzheimer  type  [14].  Moreover,  the  accumulated  silicon 
and  aluminum  appeared  to  be  found,  at  least  in  part,  in  lipofuscin  granules  in  the 
brains  of  patients  who  died  with  Alzheimer's  disease  [15]. 

1 .3.2  Toxicity  in  vivo  of  silicon  dioxide  nanoparticles  in  mammalian  neural 
cells 

There  have  been  very  few  studies  on  the  toxicity  of  silicon  dioxide  nanoparticles 
in  vivo  on  mammalian  neural  cells.  Nevertheless,  the  results  of  the  few  studies 
are  quite  revealing  and  allow  us  to  make  two  tentative  generalizations,  (i)  Silicon 
dioxide  nanoparticles  can  cross  the  BBB:  one  consequence  of  such  particles  being 
able  to  cross  the  BBB  is  that  they  could,  at  least  potentially,  exert  undesirable 
effects  on  neural  cells  in  the  central  nervous  system,  (ii)  Most  of  the  toxic  effects 
of  silicon  nanoparticles  in  vivo  on  neural  cells  are  similar  to,  if  not  identical  with, 
the  effects  of  such  nanoparticles  noted  in  neural  cells  in  vitro  (see  below).  Thus, 
this  generalization  points  to  the  utility  of  employing  neural  cell  models  in  vitro  to 
screen  for  the  toxicity  of  various  types  of  silicon  dioxide  nanoparticles  and  the 
importance  of  employing  such  models  to  elucidate  the  cellular  and  molecular 
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mechanisms  underlying  the  cytotoxicity  of  silicon  dioxide  nanoparticles. 
Nevertheless,  it  is  noteworthy  that  cytotoxicity  of  these  nanoparticles  in  neural 
cells  cannot  be  easily  and  readily  investigated  employing  animal  models  in 
studies  in  vivo.  We  will  briefly  discuss  how  the  findings  of  the  few  studies  on 
toxicity  of  silicon  dioxide  nanoparticles  on  neural  cells  in  vivo  have  led  us  to 
formulate  the  two  generalizations  above. 

In  their  study  to  investigate  toxicity  and  tissue  distribution  of  silica-overcoated 
magnetic  nanoparticles  in  mice,  Kim  et  al.  [9]  synthesized  silica-overcoated 
magnetic  nanoparticles  containing  rhodamine  B  isothiocyanate  within  a  silica 
shell  of  controllable  thickness  (MNPs@Si02(RITC)).  They  employed 
MNPs@Si02(RITC)  with  50-nm  thickness  and  administered  those  particles 
intraperitoneally  into  mice  for  four  weeks  and  were  able  to  detect  the 
nanoparticles  in  the  brains  of  those  mice.  Furthermore,  using  an 
immunocytochemical  approach  and  employing  the  dorsal  cochlear  nucleus  as  a 
representative  example  of  whole  brain  localization,  they  were  able  to  show  that 
MNPs@Si02(RITC)  co-localized  with  a  well-characterized  neuronal  marker, 
NeuN.  Based  on  their  observations,  Kim  et  al.  concluded  that  the  silica 
nanoparticles  (MNPs@Si02(RITC))  could  cross  the  BBB,  enter  neurons,  but  do 
not  alter  the  permeability  of  the  BBB  [9].  Nevertheless,  they  did  not  detect  any 
gross  abnormal  histopathological  lesions  in  several  organs,  including  brain, 
kidney,  liver,  testis,  uterus,  lung,  heart  and  spleen,  in  mice  four  weeks  after 
intrapertoneally  injection  of  MNPs@Si02(RITC)  into  the  mice  at  25,  50  or  100 
mg/kg  [9].  Consequently,  Kim  et  al.  [9]  concluded  such  silica  nanoparticles  can 
penetrate  the  BBB  and  enter  neurons  without  apparently  altering  their  normal 
function,  suggesting  that  the  silica-overcoated  nanoparticles  at  the  doses 
employed  were  apparently  not  toxic  to  neurons.  The  findings  and  conclusions  of 
Kim  et  al.  [9]  are  in  sharp  contrasts  with  those  of  a  more  recent  study  by  Wu  et  al. 
[16]. 

Wu  et  al.  [16]  examined  the  effects  of  intranasal  exposure  of  adult  rats  to  silica 
nanoparticles  (20  pg  per  rat  daily  for  1  or  7  days).  They  reported  intranasal 
instillation  of  silicon  dioxide  nanoparticles  into  rats,  especially  for  seven  days, 
significantly  increased  levels  of  silicon  dioxide  nanoparticles  in  several  brain 
regions  monitored,  with  the  rank  order:  olfactory  bulb  >  striatum  >  hippocampus 
>  brain  stem  >  cerebellum  >  frontal  cortex  [16].  Evidently,  after  intranasal 
administration,  silicon  dioxide  nanoparticles  were  able  to  cross  the  BBB  and 
became  differentially  accumulated  within  seven  days  in  several  key  brain 
regions,  especially  in  olfactory  bulb,  striatum,  and  hippocampus.  Because  of  their 
importance  in  several  neurodegenerative  diseases,  Wu  et  al.  further  examined 
the  effects  of  these  nanoparticles  on  key  parameters  concerned  with  oxidative 
stress,  inflammatory  response(s),  and  neurotransmitter  metabolism  [16].  They 
noted  that  the  striatum  was  more  vulnerable  than  the  hippocampus  to  the  toxic 
effects  of  silicon  dioxide  nanoparticles  in  terms  of  changes  in  these  parameters 
subsequent  to  the  accumulation  of  such  nanoparticles  in  the  two  brain  regions. 
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Specifically,  in  rats  exposed  to  silicon  dioxide  nanoparticles  for  seven 
consecutive  days,  their  striatal  levels  of  hydrogen  peroxide,  a  by-product  of 
reactive  oxygen  species  (ROS)  generation,  and  MDA,  a  marker  and  end-product 
of  lipid  peroxidation,  were  significantly  increased  while  striatal  level  of  reduced 
glutathione  (GSH)  was  significantly  decreased;  however,  striatal  SOD,  an 
important  antioxidant  enzyme,  was  unchanged  [16].  By  contrast,  in  the 
hippocampus  of  rats  intranasally  instilled  with  silicon  dioxide  nanoparticles  for 
seven  consecutive  days,  only  MDA  levels  were  increased  [16].  Thus,  their 
findings  strongly  suggested  that  intranasal  exposure  of  adult  rats  to  silicon 
dioxide  nanoparticles  selectively  induces  oxidative  stress  in  their  striatum:  Wu  et 
al.  also  confirmed  that  the  nanoparticles  can,  and  do,  induce  oxidative  stress  in 
vitro  in  PC12  cells,  which  constitute  a  model  of  dopaminergic  neurons  (see  Table 
1  and  the  next  subsection  below). 

Wu  et  al.  [16]  also  observed  that  intranasal  instillation  of  silicon  dioxide 
nanoparticles  into  adult  rats  for  seven  consecutive  days  resulted  in  differential 
changes  in  inflammatory  responses  in  the  striatum  (but  not  in  the  hippocampus) 
of  the  treated  rats.  They  detected  significantly  higher  striatal  levels  of  TNF-a,  IL- 
ip,  and  IL6  in  the  treated  rats:  both  TNF-a  and  IL-ip  are  pro-inflammatory 
cytokines,  whose  release  leads  to  the  stimulation  of  expression  of  IL-6  and  IL-8. 
Along  with  the  selective  changes  in  the  striatal  levels  of  cytokines  associated 
with  inflammatory  response (s)  induced  by  intranasal  exposure  of  rats  to  silicon 
dioxide  nanoparticles  for  seven  days,  Wu  et  al.  [16]  also  discerned  a  significant 
decrease  (by  -25%)  in  striatal  dopamine  level  in  the  treated  rats  whereas  their 
hippocampal  glutamate  level  was  not  significantly  altered.  Animal  models 
revealed  that  dopamine  depletion  in  the  striatum  is  associated  with  movement 
disorders  [16]  that  were  reminiscent  of  that  in  Parkinson's  disease.  Consequently, 
their  findings  led  Wu  et  al.  [16]  to  conclude  that  exposure  to  silicon  nanoparticles 
exerts  a  negative  impact  on  the  striatum  and  dopaminergic  neurons  and  may 
pose  a  risk  for  neurodegenerative  diseases.  In  view  of  the  interesting 
observations  and  conclusion  of  Wu  et  al.  [16],  we  would  like  to  propose  that 
accumulation  and  toxicity  of  silicon  dioxide  nanoparticles  in  the  striatum  may 
serve  as  a  model  system  for  parkinsonism  and  Parkinson's  disease.  Clearly,  this 
is  a  research  area  that  merits  further  investigation. 

Despite  the  interesting  differential  changes  in  striatum  and  to  a  much  lesser 
extent  in  the  hippocampus  induced  by  intranasal  instillation  of  silicon  dioxide 
nanoparticles  noted  by  Wu  et  al.  [16],  those  researchers  did  not  detect  any 
noticeable  changes  in  the  general  behavior  of  the  treated  rats.  Nevertheless,  Wu 
et  al.  [16]  cautioned  that  more  extensive  and  specialized  neurobehavioral  testing 
is  needed  to  clearly  delineate  whether  or  not  exposure  of  rats  in  vivo  to  silicon 
dioxide  nanoparticles  definitely  results  in  functional  behavioral  changes  [16]. 


6  I  TOXICITY  OF  SILICON  DIOXIDE  NANOPARTICLES  IN  MAMMALIAN  NEURAL  CELLS 

1 .3.3  Toxicity  in  vitro  of  siiicon  dioxide  nanoparticies  in  mammaiian  neurai 
ceiis 

The  need  for  cell  models  in  vitro  to  screen  cytotoxicity  of  nanoparticies  in 
neural  cells.  Until  recently,  few,  if  any,  studies  have  addressed  the  cytotoxicity  of 
nanoparticies  in  neural  cells.  We  were  the  first  to  propose  the  importance  of 
developing  neural  cell  models  in  vitro  to  facilitate  the  high  throughput  screening 
of  the  putative  toxicity  of  nanoparticies  in  various  neural  cell  types  [12, 17-32]. 

Initially  we  developed  several  types  of  neural  cell  models  in  vitro  consisting  of 
human  astrocytoma  U87  cells  and  human  neuroblastoma  SK-N-SH  cells  for  high 
throughput  screening  of  the  putative  toxicity  of  nanomaterials,  including 
nanoparticies  [12,  17-24].  Even  though  U87  and  SK-N-SH  cells  are  neurotumor 
cells,  they  are  good  models  in  vitro  for  astrocytes  and  neurons,  respectively, 
because  there  is  good  evidence  that  the  structure  and  functions  of  U87  and  SK-N- 
SH  cells  closely  resemble  their  counterparts  in  normal  brain,  [17-24,  26].  We  have 
initiated  a  series  of  studies  to  systematically  examine  the  putative  cytotoxic 
effects  of  nanoparticies  of  metallic  and  non-metallic  oxides  in  astrocytes  and 
neurons  employing  U87  (astrocytes-like)  and  SK-N-SH  (neurons-like)  cells  [12, 
17-26].  We  have  also  modified  the  ''standard"  cell  survival  (i.e.,  MTT)  assay  so 
that  the  assay  can  be  used  to  assess  the  effects  of  nanoparticies  on  cell  survival 
with  improved  accuracy  by  minimizing  the  interference  by  nanoparticies  in  the 
assay  [22,23]. 

We  have  further  developed  several  types  of  co-culture  models  of  astrocytes  and 
neurons  employing  U87  and  SK-N-SH  cells  to  facilitate  mechanistic  elucidation 
of  the  protection  by  astrocytes  conferred  on  neurons  against  agents  (including 
toxic  nanoparticies)  that  induce  neurodegeneration  [20-22,  26,30] . 
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Table  1.  In  vitro  studies  of  nanosilica  toxicity  in  neural  cells 


Silica 

form  (Size) 

Cells  Used 
(Exposure  time 
in  hours) 

Endpoints  and  Findings 

Ref. 

Colloidal 

SiOj-NP 
(25  nm) 

SK-N-SH 

U87 

(48) 

-  1  cell  survival  (significant  decrease  at  25,  50, 100  jug/  ml) 

- 1  LDH  release 

-  t  cell  survival  when  co-cultured  with  U87  cells 

-  Altered  cellular  morphology 

[17,18, 

20] 

Mesoporous 
Nanomaterials 
MCM-41  (5-30  nm ) 
•AP-T 

•MP-T 

Spherical  silica 
nanoparticles  Si02 
(5-30  nm ) 

SK-N-SH 

(24) 

-  Cytotoxicity  of  nanoparticles 

MCM-41  >MP-T> AP-T  «  Si02  (cytotoxicity  of  nanoparticles  in  descending 
order  of  toxicity) 

-  More  adsorptive  surface  area  of  the  particle  resulted  in  higher  toxicity 

[33] 

Amorphous 
Si02-NP 
(50  &  70  nm) 

SK-N-SH , 

N2a 

(4) 

-  Internalized  nanoparticles  into  the  cytoplasm  and  localized  in  nuclei 
-Induced  aberrant  clusters  of  protein  aggregates  in  the  nucleoplasm 

[35] 
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Table  1.  In  vitro  studies  of  nanosilica  toxicity  in  neural  cells  (cont.) 


Silica 

form  (Size) 

Cells  Used 
(Exposure  time 
in  hours) 

Endpoints  and  Findings 

Ref. 

Mesoporous 

nanomaterials 

(MSNs) 

•MCM-41 

•SBA-15 

Solid-cored 

Silica  microsphere 
(SMS) 

(300  -  350  nm) 

SK-N-SH 
(3,  24  and  51) 

-  SBA-15 

inhibitory  effect  on  cell  survival  at  50  and  100  pg/  mL  and  cytotoxic  at 

200  pg/mL  (3  hr) 

recovery  in  cell  viability  (27  hr  and  51  hr) 

-  MCM-41 

toxicity  during  the  short  exposure  (3  hr) 
recovery  in  cell  viability  (  51  hr)  except  at  200  pg/  mL 
-SMS 

not  toxic  except  at  200  pg/  mL  ( 3  hr) 
toxic  (27  hr  and  51  hr) 

functionalization  of  amine  group  decreases  toxicity 

L34J 

Si-NP 

(prepared  by  sol  gel 
method) 

(150-200  nm) 

primary  culture 
of  rat 
microglia 
(24) 

-  Internalization  by  microglia  at  all  concentrations  tested 

-  Not  cytotoxic  and  did  not  alter  phagocytosis 

-  t  in  intracellular  production  of  ROS  and  RNS 
- 1  IL-lp  level 

- 1  TNF-a  gene  expression 
- 1  COX-2  gene  expression  at  36.4  pg/ml 

136J 
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Table  1.  In  vitro  studies  of  nanosilica  toxicity  in  neural  cells  (cont.) 


Silica 

form  (Size) 

Cells  Used 
(Exposure  time 
in  hours) 

Endpoints  and  Findings 

Ref. 

Colloidal 

U87 

- 1  cell  survival  (significant  decrease  at  25,  50, 100  jiig/  ml) 

112J 

SiOj-NP 
(25  nm) 

(48) 

-  t  citrate  synthase  and  malate  dehydrogenase  activities 

-  1  expression  of  cytochrome  C  oxidase  subunit  II,  j  expression  of  NADH 

dehydrogenase  subunit  6  and  j  expression  of  phosphorylated  ERK 

-  Cells  became  more  enlarged  and  swollen 

SiO^-NP 

15  nm 
(92  nm  with 

FBS 

protein) 

PC12 

(24) 

- 1  cell  survival,  t  LDH  release, 

-  Oxidative  stress 

t  ROS  production,  t  MDA,  j  GSH  and  j  SOD  activity 

-  Rounded  shaped  and  reduced  length  of  extended  neurites 

-  Apoptosis 

double  stained  with  PI-  and  FITC-Iabeled  annexin  V 

1  the  expression  of  bcl2,  t  the  expression  of  p53,  p21,  p-p53,  Gadd45  and 
bax 

-  Cell  cycle  arrest  at  100  and  200  pg/ml 

[16] 
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Table  1.  In  vitro  studies  of  nanosilica  toxicity  in  neural  cells  (cont.) 


Silica 

form  (Size) 

Cells  Used 
(Exposure  time 
in  hours) 

Endpoints  and  Findings 

Ref. 

Colloidal 

SiOj-NP 
(25  nm) 

Schwann  cells 
(R3), 

DRG  neurons 
(50B11) 

(36  and  48) 

-  1  cell  survival 

DRG  neurons  <  Schwann  cells 

-  Internalized  nanoparticles  (Schwann  cells  and  DRG  neurons) 

-  Enlarged  and  swollen  nuclei  (Schwann  cells  and  DRG  neurons) 

-  Oxidative  stress 

Schwann  cells 
j  GSH  and  j  Mn-SOD  (R3) 

DRG  neurons 

Multi-phasic  effect  on  GSH  and  t  Mn-SOD 

-  1  expression  of  NADH  dehydrogenase  subunit  6  and  t  expression  of 

succinate  dehydrogenase  fc  subunit 

-  1  expression  of  p-ERK  (Schwann  cells  and  DRG  neurons) 

-  Did  not  change  the  expression  of  ERK 

[28,31, 

37] 

Abbreviations:  COX-2,  cyclooxygenase  2;  DRG,  dorsal  root  ganglion;  FITC,  fluorescein  isothiocyanate;  GSH,  reduced  glutathione;  IL,  interleukin;  LDH,  lactate 
dehydrogenase;  MDA,  malondialdehyde  (end  product  of  lipid  peroxidation);  N2a,  mouse  neuroblastoma  cell  line;  NMR,  nuclear  magnetic  resonance;  PC12, 
pheochromocytoma  cells;  PI,  propidium  iodide;  Ref.,  references;  RNS,  reactive  nitrogen  species;  ROS,  reactive  oxygen  species;  SEM,  scanning  electron  microscopy; 
Si02-NP,  silicon  dioxide  nanoparticles;  SK-N-SH,  human  neuroblastoma  cell  line;  TEM,  transmission  electron  microscopy;  TNF,  tumor  necrosis  factor;  U87,  human 
astrocytoma  cell  line;  XRD,  X-ray  diffraction. 
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Because  the  putative  cytotoxic  effects  of  nanoparticles  of  metallic  and  non- 
metallic  oxides  in  neural  cells  of  the  peripheral  nervous  system  (PNS)  are 
unknown,  we  have  recently  developed  cell  models  in  vitro  consisting  of  Schwann 
cells  and  dorsal  root  ganglion  (DRG)  neurons  to  facilitate  the  systematic 
investigation  of  the  effects  of  such  nanoparticles  on  the  PNS  [27-29,  31,32].  The 
results  of  our  recent  and  ongoing  studies  clearly  demonstrate  that  our  cell 
models  in  vitro  constitute  excellent  cell  culture  models  for  elucidating 
pathophysiological  mechanisms  of  agents  (including  nanoparticles)  that  can 
induce  peripheral  neuropathy  [27-29,31,32]. 

The  results  of  our  previous  and  ongoing  studies  clearly  demonstrate  that  the  cell 
models  we  have  developed  allow  the  systematic  and  mechanistic  investigations 
of  putative  cytotoxicity  of  nanoparticles  of  metallic  and  non-metallic  oxides  in 
neural  cells  derived  from  both  the  central  and  the  peripheral  nervous  systems 
[12,  17-32].  Furthermore,  they  also  strongly  suggest  that  our  models  can  be 
applied  to  screen  the  cytotoxicity  of  nanomaterials  other  than  nanoparticles  of 
metallic  and  non-metallic  oxides  in  neural  cells  of  central  and  peripheral  nervous 
systems  [12,  17-32].  We  will  discuss  in  the  next  subsection  the  findings  of  our 
studies  and  compare  them  with  those  of  other  researchers. 

Cellular  and  molecular  mechanisms  underlying  the  cytotoxicity  in  vitro  of 
silicon  dioxide  nanoparticles  in  neural  cells.  The  results  of  the  studies  to  date 
concerning  the  cytotoxicity  in  vitro  of  silicon  dioxide  nanoparticles  in  neural  cells 
are  summarized  and  compared  as  shown  in  Table  1. 

We  were  the  first  to  initiate  a  series  of  studies  to  systematically  investigate  the 
cytotoxic  mechanisms  of  silicon  dioxide  nanoparticles  on  mammalian  (including 
human)  neural  cells  [12,17,18,20,22].  Our  initial  finding  that  silicon  dioxide 
nanoparticles  induced  cytotoxicity  on  human  neuroblastoma  SK-N-SH  (neurons¬ 
like)  and  human  astrocytoma  U87  (astrocytes-like)  cells  by  lowering  their 
survival  [17]  prompted  us  to  further  elucidate  the  mechanisms  underlying  the 
cytotoxicity  of  silicon  dioxide  nanoparticles  in  neurals  cells  [12,18].  Necrosis 
appeared  to  be  one  cytotoxic  effect  induced  by  the  nanoparticles  in  both  SK-N- 
SH  (neurons-like)  and  U87  (astrocytes-like)  cells  as  indicated  by  the  increases  in 
lactate  dehydrogenase  (LDH)  release  from  the  cells  into  the  surrounding 
medium  (Table  1)  [17,18].  The  dose-related  changes  in  cellular  morphology  in 
U87  and  SK-N-SH  cells  induced  by  silicon  dioxide  nanoparticles  paralleled  the 
dose-related  decreases  in  the  survival  of  those  cells  induced  by  the  nanoparticles 
[17,18].  Interestingly,  when  SK-N-SH  (neurons-like)  cells  were  co-cultured  on  a 
monolayer  of  U87  (astrocytes-like)  cells  and  exposed  to  silicon  dioxide 
nanoparticles,  the  survival  of  both  cell  types  was  improved  compared  to  the 
survival  of  both  cell  types  when  they  were  cultured  alone  as  monotypic  culture 
and  exposed  to  silicon  dioxide  nanoparticles  (Table  1)  [20]. 
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We  investigated  further  the  cytotoxic  mechanisms  underlying  the  dose-related 
decreases  in  survival  of  U87  cells  induced  by  silicon  dioxide  nanoparticles  [12]. 
We  found  the  activities  of  citrate  synthase  and  malate  dehydrogenase  in 
nanoparticles-treated  U87  cells  were  increased,  possibly  due  to  an  energetic 
compensation  in  surviving  cells  (Table  1)  [12].  By  contrast,  the  expression  of 
mitochondrial  DNA-encoded  cytochrome  C  oxidase  subunit  II  and  NADH 
dehydrogenase  subunit  6  and  the  cell  signaling  protein  phosphorylated  ERK  (p- 
ERK)  was  altered  in  the  nanoparticles-treated  U87  cells  (Table  1)  [12].  Thus,  we 
were  the  first  to  report  on  the  effects  of  silicon  dioxide  nanoparticles  on 
expression  of  mitochondrial  DNA-encoded  protein  and  on  expression  of  cell 
survival  signaling  protein  (i.e.,  ERK)  [12].  Our  findings  suggest  that  silicon 
dioxide  nanoparticles  induces  disruption  of  mitochondrial  DNA-encoded 
protein  expression,  leading  to  decreased  mitochondrial  energy  production  in  U87 
cells;  the  nanoparticles  also  induced  decreases  in  cell  survival/ proliferation 
signaling  in  those  cells  [12]. 

Different  types  of  nanosilica  particles  exert  dissimilar  cytotoxic  effects  on  neural 
cells.  Di  Pasqua  et  al.  [33]  and  Tao  et  al.  [34]  demonstrated  that  mesoporous  silica 
(MCM  41)  nanoparticles  are  more  toxic  to  SK-N-SH  cells  compared  to  spherical 
silica  (including  silicon  dioxide)  nanoparticles  (Table  1).  They  also  found  that 
functional  groups  on  silica  nanoparticles  play  major  roles  in  determining  the 
toxicity  of  silica  nanoparticles:  for  example,  grafting  aminopropyl  group (s)  on 
mesoporous  silica  nanoparticles  decreased  the  cytotoxicity  of  MCM-41  in  SK-N- 
SH  cells  [33].  Thus,  it  is  imperative  to  consider  whether  or  not  and  how  the 
surface  of  the  nanoparticles  may  influence  their  properties  while  selecting 
nanosilica  for  biomedical  and  biotechnological  applications. 

In  elegant  studies  in  vitro,  Chen  and  von  Mikecz  [35]  demonstrated  that 
amorphous  silica  nanoparticles  (50  &  70  nm)  entered  several  cell  types  including 
neuronal  cells  (i.e.,  N2a  and  SK-N-SH  cells),  translocated  into  their  nuclei,  and 
altered  nuclear  functions  in  a  matter  of  hours  (Table  1)  [35].  However,  silica 
particles  of  sizes  between  200  nm  and  5  pm  neither  penetrated  into  the  nuclei  nor 
modified  nuclear  function  and  architecture  of  the  cells  [35].  Furthermore,  this 
group  noted  that  once  they  penetrated  into  the  nuclei  of  the  cells,  silica 
nanoparticles  with  an  average  diameter  of  50  nm  induced  the  formation  of 
aberrant  protein  aggregates  in  their  nuclei  [35].  The  protein  aggregates,  whose 
formation  was  induced  by  the  silica  nanoparticles,  contained  essential 
components  of  nuclear  protein  machines  such  as  coactivators  of  transcription, 
unmutated  polyQ  proteins,  and  members  of  the  ubiquitin  proteasome  systems 
(UPS)  [35].  Their  interesting  observations  led  von  Mikecz  and  co-workers  to 
propose  that  the  components  of  the  UPS  are  recruited  to  silica-nanoparticles- 
induced  nuclear  inclusions  to  break  down  aggregated  proteins  [35].  Moreover, 
even  when  silica  nanoparticles  did  not  alter  cell  viability  or  enhance  cell  death, 
silica  nanoparticles  induced  repression  of  gene  expression,  ultimately  leading  to 
decreased  cellular  replication  and  irreversible  inhibition  of  cell  proliferation  [35]. 
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This  group  of  researchers  therefore  concluded  that  through  the  induction  of 
intranuclear  protein  aggregation  that  contains  proteins  with  polyQ  stretches, 
silica  nanoparticles  trigger  a  subnuclear  pathology  that  closely  mimics  molecular 
events  characteristic  of  formation  of  insoluble  protein  inclusions  in 
neurodegenerative  aggregation  diseases  [35].  Chen  and  von  Mikecz  further 
advocated  that  ''silica  nanoparticles  have  emerged  as  excellent  tools  for  proof -of- 
principle  studies,  in  this  case,  establishment  of  cell-based  models  for 
degenerative  protein  aggregation  diseases"  [35]. 

Silicon  dioxide  nanoparticles  can  induce  alterations  in  mitochondrial  oxidative 
metabolism  and  induce  oxidative  stress.  For  example,  silicon  dioxide 
nanoparticles  induced  cell  death  in  U87  (astrocytes-like)  cells  by  disturbing  their 
mitochondrial  function  (Table  1)  [12].  Wu  et  al.  [16]  observed  that  treatment  of 
PC12  cells  (a  model  of  dopaminergic  neurons  in  vitro)  with  silicon  dioxide 
nanoparticles  led  to  increased  LDH  release,  enhanced  ROS  production,  increased 
MDA  production  but  decreased  levels  of  GSH  and  SOD,  and  ultimately 
decreased  cell  survival  [16].  Additionally,  their  mechanistic  studies  with  PC12 
cells  also  revealed  that  at  doses  higher  than  50  jug/mL,  the  number  of  apoptotic 
PC12  cells  increased  markedly  [16].  They  attributed  this  apoptotic  effect  induced 
by  silicon  dioxide  nanoparticles  to  the  G2/M  cell  cycle  arrest  in  conjunction  with 
increased  protein  expression  of  p53,  phospho-p53  (p-p53),  p21,  Gadd45,  and  bax, 
but  decreased  protein  expression  of  bcl-2  because  both  p21  and  Gadd45  are 
proteins  that  are  down-stream  from  p53  in  regulating  cell  cycle  whereas  the 
increase  in  bax/bcl-2  ratio  favors  apoptosis  [16].  Along  with  those  observations, 
they  also  found  that  silicon  dioxide  nanoparticles  induced  decreases  in 
dopamine  levels  and  expression  of  tyrosine  hydroxylase  (TH,  a  rate-limiting 
enzyme  in  dopamine  synthesis)  [16].  (However,  the  authors  erroneously  stated 
that  silicon  dioxide  nanoparticles  upregulated  the  expression  of  TH  in  dose- 
dependent  manner  [see  Ref.  16,  p.  4485].)  Interestingly,  and  relevant  to  this 
discussion  of  the  mechanistic  actions  of  silicon  dioxide  nanoparticles  on  neural 
cells,  the  findings  of  Wu  et  al.  in  PC12  cells  in  vitro  (i.e.,  enhanced  ROS 
production,  increased  MDA  production  but  decreased  levels  of  GSH  and 
dopamine)  confirmed  what  they  observed  in  the  striatum  of  rats  after  intranasal 
instillation  of  silicon  dioxide  nanoparticles  into  those  rats  in  vivo  [16]. 
Consequently,  their  parallel  studies  in  vivo  and  in  vitro  strongly  suggest  that 
many  -  if  not  most  -  of  the  mechanisms  underlying  the  cytotoxicity  of  silicon 
dioxide  nanoparticles  in  neural  cells  in  vitro  may  also  occur  in  the  cytotoxicity  of 
silicon  dioxide  nanoparticles  in  neural  cells  in  vivo  [16]. 

The  effects  of  silica  nanoparticles  in  primary  cultures  of  rat  microglia  in  vitro  [36] 
appear  to  somewhat  differ  from  the  effects  of  these  nanoparticles  in  PC12  cells  in 
vitro  [16]  and  in  the  rat  striatum  after  intranasal  instillation  of  the  nanoparticles 
in  vivo  [16].  Choi  et  al.  [36]  were  the  first  to  observe  that  over  a  24-hour  period, 
exposure  of  rat  microglial  cells  in  primary  culture  in  vitro  to  silica  nanoparticles 
resulted  in  the  entry  of  nanparticles  into  those  cells  via  endocytosis  and  other 
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nanoparticle  uptake  mechanisms  [36].  Similar  to  the  effects  of  silicon  dioxide 
nanoparticles  in  PC12  cells  in  vitro  [36]  and  to  the  same  effects  in  the  rat  striatum 
after  intranasal  instillation  of  the  nanoparticles  in  vivo  [16],  Choi  et  al.  also  noted 
that  these  nanoparticles  induce  oxidative  stress  in  rat  microglial  cells  in  vitro  by 
enhancing  their  production  of  ROS  and  reactive  nitrogen  species  (RNS)  and 
altering  their  expression  of  proinflammatory  genes  (i.e.,  increase  in  COX-2  but 
decrease  in  tumor  necrosis  factor-a  expression)  (Table  1)  [36].  However,  even  at 
the  highest  treatment  concentration  of  40,000  nanoparticles  per  |liL  (i.e.,  7.28 
|Lig/  mL)  for  24  hours,  silica  nanoparticles  did  not  significantly  lower  the  survival 
of  microglial  cells  in  vitro  [36].  Nevertheless,  Choi  et  al.  [36]  did  suggest  that 
continuous  production  of  ROS  by  microglia  induced  by  the  silica  nanoparticles 
could  induce  deleterious  effects  on  neurons  in  their  vicinity  and  the  dysfunction 
induced  by  the  nanoparticles  may  not  allow  the  microglia  to  sustain  neuronal 
health. 

Because  the  putative  cytotoxic  effects  of  silicon  dioxide  nanoparticles  in  neural 
cells  in  the  peripheral  nervous  system  (PNS)  are  largely  unknown,  we  have 
employed  our  in  vitro  model  of  Schwann  cells  to  systematically  investigate  the 
putative  cytotoxicity  of  silicon  dioxide  nanoparticles  on  neural  cells  derived  from 
the  PNS  [25,27,28,31,37].  We  are  the  first  to  report  on  the  effects  of  silicon  dioxide 
nanoparticles  on  neural  cells  in  the  PNS  [28,37].  Results  of  our  ongoing  studies 
have  demonstrated  that  silicon  dioxide  nanoparticles  exerted  cytotoxic  effect  on 
Schwann  cells  by  lowering  their  survival  (Table  1)  [28,37].  Light  microscopic 
examination  revealed  that  treatment  of  Schwann  cells  with  the  nanoparticles 
induced  dose-related  changes  in  cellular  morphology,  consistent  with  the 
nanoparticles-induced  progressive  decrease  in  cell  viability  and  increase  in 
uptake  of  nanoparticles.  Furthermore,  employing  flow  cytometry,  we  noted  the 
cytotoxicity  of  silicon  dioxide  nanoparticles  could  be  attributed,  at  least  in  part,  to 
the  uptake  of  the  nanoparticles  by  Schwann  cells  [28,37].  Treatment  with  silicon 
dioxide  nanoparticles  also  induced  increased  LDH  release,  decreased  glutathione 
level,  and  altered  morphology  and  expression  of  Mn-superoxide  dismutase, 
NADH  dehydrogenase  subunit  6,  and  succinate  dehydrogenase  in  Schwann  cells 
[28,37].  Thus,  our  findings  are  compatible  with  the  observation  that  silicon 
dioxide  nanoparticles  induce  decreases  in  survival  of  neural  cells  derived  from 
the  central  nervous  system  and  the  decreases  in  cell  survival  can  be  attributed,  at 
least  in  part,  to  the  nanoparticles-induced  oxidative  stress  [12,16,28,36,37]. 

The  effects  of  silicon  dioxide  nanoparticles  on  dorsal  root  ganglion  (DRG) 
neurons,  an  in  vitro  model  of  DRG  neurons  in  PNS  in  vivo  [27-29,  31,32],  only 
show  a  few  similarities  to  those  noted  in  the  Schwann  cells  in  vitro  (Table  1). 
Treatment  of  silicon  dioxide  nanoparticles  altered  the  morphology  of  DRG 
neurons:  their  nuclei  were  swollen  and  their  processes  decreased  in  number  and 
they  became  rounded  whereas  untreated  DRG  neurons  were  spindle-shaped  [28- 
37].  Treatment  of  DRG  neurons  with  silicon  dioxide  nanoparticles  did  not  induce 
any  necrotic  cell  damage  or  necrotic  cell  death  at  concentrations  from  0.1  to  150 
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|ig/mL  but  induced  oxidative  stress  by  decreasing  glutathione  levels  (Table  1) 
[28,37].  Nevertheless,  when  we  treated  DRG  neurons  with  the  nanoparticles  at 
the  highest  concentration  employed  (i.e.,  200  pg/mL),  they  showed  significant 
increases  in  LDH  release  into  the  surrounding  medium,  suggesting  that  the 
nanoparticles  did  induce  necrotic  damage  and/or  cell  death  in  DRG  neurons  at 
that  concentration  [28,37].  Thus,  the  results  of  our  current  and  ongoing  studies 
strongly  suggest  that  silicon  dioxide  nanoparticles  induce  differential  effects  on 
neural  cells  in  the  PNS. 

1.4  PATHOPHYSIOLOGICAL  IMPLICATIONS  OF  TOXICITY  OF  SILICON 
DIOXIDE  NANOPARTICLES  IN  MAMMLIAN  NEURAL  CELLS 

Even  though,  to  date,  the  literature  on  the  effects  of  silicon  dioxide  nanoparticles 
on  mammalian  neural  cells  is  rather  limited,  the  results  of  published  and 
ongoing  studies  appear  to  coalesce  into  a  recognizable  pattern  (see  Tables  1) 
which  allows  us  to  draw  some  tentative  generalizations  regarding 
pathophysiological  implications  of  toxicity  of  silicon  dioxide  nanoparticles  in 
mammalian  neural  cells.  However,  in  this  review,  we  can  only  very  briefly 
discuss  four  such  generalizations. 

(i)  Because  silicon  dioxide  nanoparticles  can  readily  cross  the  blood-brain  barrier 
(BBB)  (also  see  section  1.2  above),  once  the  nanoparticles  penetrate  into  the 
central  (or  for  that  matter,  the  peripheral)  nervous  system,  they  can  directly 
influence  neural  cells  therein.  Consequently,  whether  the  effects  of  silicon 
dioxide  nanoparticles  on  neural  cells  are  deleterious  critically  depends  on  the 
extent  of  the  accumulation  of  the  nanoparticles  in  the  nervous  tissue. 

(ii)  Evidence  is  accumulating  that  silicon  dioxide  nanoparticles  appear  to  exert 
differential  effects  on  neural  cells.  It  is  well  recognized  that  glial  cells  protect 
neurons  from  a  variety  of  pathophysiological  assaults  [26,30].  Therefore,  it  is 
conceivable  that  in  addition  to  the  direct  cytotoxic  effect  on  neurons  exerted  by 
silicon  dioxide  nanoparticles,  the  nanoparticles  can  exert  indirect  toxic  effects  on 
neurons  through  their  actions  on  glial  cells,  ultimately  compromising  the  ability 
of  glial  cells  to  maintain  neuronal  health  and  well  being. 

(iii)  As  alluded  to  above  (see  subsections  1.3.2  and  1.3.3  above),  silicon  and 
aluminum  were  found  to  be  co-localized  in  the  cores  of  senile  plaques  in  the 
cortex  of  Alzheimer's  disease  (AD)  patients  [14]  and  accumulated  silicon  and 
aluminum  were  also  found  in  lipofuscin  granules  in  patients  who  died  of  AD 
[15].  Moreover,  when  directly  introduced  into  the  brains  of  rats  and  mice  in  vivo, 
silica  nanoparticles  induced  inflammatory  responses  in  astrocytes  and 
degeneration  of  axons  and  axon  terminals  in  the  vicinity  of  the  astrocytes  [13]. 
These  early  observations  [13-15],  together  with  more  recent  reports  (see  Table  1) 
of  toxic  effects  of  silicon  dioxide  nanoparticles  on  mammalian  neural  cells  in  vivo 
and  in  vitro,  strongly  suggest  that  the  neurotoxicity  of  silicon  dioxide 
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nanoparticles  may  assume  pathophysiological  and  perhaps  even  pathogenetic 
importance  in  neurodegenerative  diseases  such  as  Alzheimer's  disease. 

(iv)  We  have  mentioned  earlier  that  their  important  findings  led  Wu  et  al.  [16]  to 
conclude  exposure  to  silicon  dioxide  nanoparticles  exerts  negative  health  impact 
on  the  striatum  in  general  and  on  dopaminergic  neurons  in  particular  and  may 
therefore  pose  a  risk  for  neurodegenerative  diseases.  Our  review  of  the  literature 
on  toxicity  of  silicon  dioxide  nanoparticles  in  mammalian  neural  cells  has  also 
prompted  us  to  propose  that  accumulation  and  toxicity  of  silicon  dioxide 
nanoparticles  in  the  striatum  may  serve  as  a  model  system  for  parkinsonism  and 
Parkinson's  disease.  Furthermore,  Chen,  von  Mikecz  and  their  associates  [35] 
elegantly  demonstrated  that  upon  entering  neural  cells,  silicon  dioxide 
nanoparticles  can  enter  their  nuclei  and  induce  the  formation  of  aberrant  protein 
aggregates  therein.  Because  such  aberrant  protein  aggregates  are  highly 
reminiscent  of  those  noted  in  the  brain  in  neurodegenerative  diseases,  Chen  and 
von  Mikecz  [35]  therefore  proposed  that  "silica  nanoparticles  have  emerged  as 
excellent  tools  for  proof-of-principle  studies,  in  this  case,  establishment  of  cell- 
based  models  for  degenerative  protein  aggregation  diseases." 


1.5  CONCLUSIONS  AND  PROSPECTS  FOR  FUTURE  RESEARCH 

In  this  concise  review,  we  have  summarized  and  discussed  the  literature  on  the 
toxicity  of  silicon  dioxide  nanoparticles  on  mammalian  neural  cells  in  vivo  and  in 
vitro.  Despite  the  fact  that,  to  date,  the  studies  published  in  this  literature  are 
rather  limited  in  number,  a  clear  and  consistent  "picture"  is  slowly  emerging 
regarding  the  mechanisms  underlying  the  toxicity  of  silicon  dioxide 
nanoparticles  in  neural  cells.  As  we  have  emphasized  earlier,  one  major  reason 
why  this  literature  is  scant  is  that  until  recently,  there  was  a  lack  of  suitable  cell 
models  in  vitro  for  high  throughput  screening  of  the  cytotoxicity  of  silicon 
dioxide  nanoparticles  —  and  for  the  matter  the  cytotoxicity  of  nanoparticles  in 
general  —  in  mammalian  neural  cells.  We  were  the  first  to  develop  neural  cell 
models  in  vitro  consisting  of  various  neural  cell  types  derived  from  both  the 
central  and  the  peripheral  nervous  systems  so  as  to  allow  the  high  throughput 
screening  of  the  cytotoxicity  of  silicon  dioxide  nanoparticles  in  mammalian 
neural  cells  [12, 17-32]. 

Based  on  a  critical  review  of  the  literature  as  well  as  current  and  ongoing  studies, 
we  can  tentatively  arrive  at  the  following  conclusions,  (i)  Far  from  being 
harmless,  silicon  dioxide  nanoparticles  can  and  do  induce  differential 
cytotoxicity  on  mammalian  neural  cells,  (ii)  Some  of  the  recognized  mechanisms 
underlying  the  toxicity  of  silicon  dioxide  nanoparticles  in  neural  cells  include, 
but  are  not  limited  to,  oxidative  stress,  inflammatory  responses,  necrotic  damage 
and  cell  death,  apoptosis,  formation  of  aberrant  nuclear  protein  aggregates  and 
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altered  mitochondrial  metabolism,  (iii)  Perhaps  the  most  interesting  and  also 
intriguing  conclusion  is  that  silicon  dioxide  nanoparticles  can  serve  as  versatile 
tools  for  elucidating  pathophysiological  and  molecular  mechanisms  underlying 
neurodegenerative  diseases  such  as  Alzheimer's  disease  and  Parkinson's  disease. 
Moreover,  our  current  and  ongoing  studies  also  strongly  suggest  that  these 
nanoparticles  can  also  be  fruitfully  exploited  to  elucidate  mechanisms 
underlying  peripheral  neuropathy. 

As  evident  from  this  concise  review,  there  are  still  much  to  be  discovered 
concerning  the  toxicity  of  silicon  dioxide  nanoparticles  in  mammalian  neural 
cells.  The  availability  of  various  models  in  vitro  consisting  of  various  neural  cell 
types  derived  from  both  the  central  as  well  as  the  peripheral  nervous  system 
greatly  facilitate  both  the  high  throughput  screening  of  the  cytotoxicity  of  silicon 
dioxide  nanoparticles  and  systematic  investigation  of  the  underlying  cellular  and 
molecular  mechanisms.  Clearly,  these  are  interesting  and  exciting  areas  that 
merit  further  and  systematic  investigation. 
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13  Synonyms 

14  Interdependence  between  manganese  and  other  metal 

15  ions;  Manganese-metal  ion  interactions 

16  Definition 

17  Manganese  and  its  interrelation  with  other  metal  ions 

18  in  health  and  disease  refers  to  how  the  level  and 

19  metabolism  of  manganese  in  an  organ  are  related  to 

20  the  levels  and  metabolism  of  other  metal  ions  in  the 

21  same  organ  in  a  healthy  individual  and  how  disease 

22  states  exert  modulatory  effects  on  such  interrelations. 

23  Introduction 

24  To  understand  the  “state  of  the  art”  regarding  manga- 

25  nese  (Mn)  and  its  interrelation  with  other  metal  ions  in 

26  health  and  disease,  one  needs  to  appreciate  the 


advantages  and  the  limitations  of  the  approaches  that  27 
critically  drive  the  advances  of  this  multidisciplinary  28 
field.  As  have  been  emphasized  earlier,  “Ideally,  if  one  29 
can  demonstrate  directly  the  mechanisms  that  causally  30 
link  the  metabolism  of  manganese  to  those  of  other  31 
metals,  then  one  can  define  the  physiological  . . .  situ-  32 
ations  or  conditions  that  show  interdependence  33 
between  Mn  and  other  metal  ions.  However,  largely  34 
because  of  methodological  limitations  as  well  as  lim-  35 
itations  of  experimental  approaches,  the  data  in  the  36 
literature  and  those  of  ongoing  studies  are  better  or  37 
more  accurately  defined  as  depicting  the  interrelations  38 
between  Mn  and  other  metal  ions.  This  conceptual  39 
distinction  should  be  borne  in  mind  when  one  assesses  40 
the  advances  in  the  topic  areas  to  be  discussed. . .”  (Lai  4i 
et  al.  2000).  42 

The  scope  of  this  entry  is  limited  to  a  summary  43 
discussion  of  the  interrelations  between  Mn  and  other  44 
elements  after  chronic  exposure  of  animals  or  humans  45 
to  Mn  because  distributions  of  ►  Mn  in  brain  regions  46 
and  in  peripheral  organs  usually  reflect  chronic  rather  47 
than  acute  exposure  to  this  metal.  Several  aspects  of  48 
this  topic  not  covered  in  this  entry  because  of  space  49 
limitations  have  been  discussed  in  some  detail  in  one  50 
or  another  of  our  previous  publications  (Chan  et  al.  51 
1983;  Lai  et  al.  1984,  1985a,  c,  1999,  2000;  Leung  52 
et  al.  2011;  Wright  et  al.  201 1).  53 

Interdependence  Between  Manganese  and  54 
Other  Metals  in  Absorption  55 

Because  manganese  (Mn)  is  an  essential  trace  metal,  56 
intake  of  this  metal  is  usually  via  food  intake  and  57 
intake  via  the  drinking  water  (Underwood  1977;  Lai  58 
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et  al.  1984,  2000).  Respiratory  exposure  of  Mn  to 
humans  is  rare  except  under  poorly  controlled  indus¬ 
trial  environments  such  as  manganese  mining,  steel 
mills,  and  metal  soldering  in  a  confined  space.  Conse¬ 
quently,  the  major  findings  to  date  employing  animal 
models  concerning  the  interdependence  between  Mn 
and  other  metals  are  centered  upon  intestinal  absorp¬ 
tion  and  subsequent  organ  distribution.  Several  gener¬ 
alizations  are  evident:  intestinal  Mn  absorption 
depends  on  dietary  iron  (Fe).  Low-dietary  Fe  enhances 
Mn  absorption  whereas  high-dietary  Fe  lowers  Mn 
absorption  (Lai  et  al.  1985c,  2000).  Similarly,  high¬ 
dietary  Mn  intake  results  in  lowered  Fe  absorption  (Lai 
et  al.  1985c,  2000).  Furthermore,  inclusion  of  essential 
and  nonessential  trace  metals  in  the  drinking  water  of 
rats  and  mice  can  alter  accumulation  of  essential  trace 
metals  (including  Mn)  in  their  peripheral  organs  (see 
Lai  et  al.  2000  for  discussion). 

Interrelations  Between  Manganese  and 
Other  Metals  in  Several  Peripheral  Organs 

A  developmental  rat  model  had  been  developed  so  that 
the  organ  distribution  of  multiple  metals  and  other 
elements  could  be  systematically  analyzed  based  on 
dietary  intake.  Furthermore,  by  exposing  rats  in  utero 
to  manganese  (added  as  the  chloride  form  in  the  drink¬ 
ing  water)  and  continuously  until  they  were  employed 
for  analysis,  the  effects  of  Mn  on  the  distributions  of 
other  trace  metals  and  electrolytes  in  various  organs 
during  development  and  aging  can  be  systematically 
investigated  employing  versatile  techniques  such  as 
instrumental  neutron  activation  analysis  (INAA) 
(Chan  et  al.  1983;  Lai  et  al.  1984,  1999,  2000).  Those 
series  of  studies  constitute  the  largest  and  most  com¬ 
plete  sets  of  data  in  the  Mn-metal  interaction  literature 
(Chan  et  al.  1983;  Lai  et  al.  1985a,  1985c,  1999,  2000; 
Leung  et  al.  2011;  Wright  et  al.  201 1). 

The  relative  distribution  of  trace  metals  in  different 
peripheral  organs  subsequent  to  their  intestinal  absorp¬ 
tion  reflects  the  amount  of  metal-binding  molecules 
(e.g.,  proteins  and  nucleic  acids)  in  each  organ  and 
the  organ’s  storage  capacity  (Lai  et  al.  2000).  In  rats, 
the  rank  order  of  the  relative  abundance  of  trace  metals  in 
peripheral  organs  is  Fe  ^  Zn  >  Cu  >  Al  >  Mn  >  Se. 
The  rank  order  of  Fe  level  in  peripheral  organs  is  spleen 
::$>  liver  >  lung  >  heart  kidney.  The  rank  order  of 
Zn  level  is  liver  ::$>  kidney  >  spleen  lung  heart. 


The  rank  order  of  Cu  level  is  kidney  ^  liver  io5 
heart  >  spleen  >  lung.  The  rank  order  of  Mn  level  io6 
is  liver  ^  kidney  ^  spleen  heart  >  lung  whereas  i07 
that  for  Se  is  kidney  >  liver  >  spleen  >  io8 
lung  =  heart.  However,  the  rank  order  of  the  level  io9 
of  the  nonessential  metal  Al  is  spleen  >  liver  >  no 
heart  >  kidney  ~  lung.  in 

In  adult  (i.e.,  120-day-old)  rats,  chronic  Mn  treat-  112 
ment  induces  dose-related  differential  elevation  in  Mn  113 
in  heart,  kidney,  spleen,  and  liver  (Lai  et  al.  1985c,  114 
2000) .  Associated  with  the  differential  elevation  of  Mn  1 1 5 
in  the  peripheral  organs  is  a  shift  in  the  patterns  of  116 
organ  distribution  of  trace  metals  (Lai  et  al.  1985c,  117 
2000).  For  example,  in  Mn-treated  rats,  Fe  levels  are  118 
increased  in  spleen  and  lung  whereas  Zn  level  is  119 
decreased  in  liver  and  Cu  level  is  decreased  in  spleen,  120 
compared  to  corresponding  levels  in  untreated  rats  (Lai  121 
et  al.  1985c,  2000).  However,  the  organ  distributions  of  122 
several  other  metals  are  also  affected  by  chronic  man-  123 
ganese  exposure.  (Because  of  space  limitation,  those  124 
findings  will  not  be  discussed  here:  see  Lai  et  al.  1985c,  125 
2000  for  additional  details.)  126 

Based  on  the  findings  discussed  above,  two  gener-  127 
alizations  can  be  arrived  at:  (1)  Dietary  intake  of  trace  128 
metals  and  electrolytes  and  their  subsequent  organ  129 
distribution  is  under  regulatory  control  even  though  130 
the  mechanisms  mediating  the  control  are  far  from  131 
being  understood.  (2)  Increasing  the  levels  of  Mn  in  132 
dietary  intake  (e.g.,  via  addition  of  manganese  salt  in  133 
the  drinking  water)  ultimately  alters  the  patterns  of  134 
organ  distribution  of  trace  metals.  135 

Regional  Differences  in  Distribution  of  Trace  i36 
Metals  in  Brain  137 

In  the  adult  rat,  whole  brain  levels  of  trace  metals  differ  i38 
and  the  rank  order  of  levels  of  several  trace  metals  is  139 
Fe  >  Zn  >  Al  >  Cu  >  Se  Mn  (Lai  et  al.  1985c,  i4o 
2000).  Additionally,  brain  levels  of  several  trace  i4i 
metals  (e.g.,  Fe,  Cu,  Mn,  and  Se)  are  altered  in  the  142 
aged  rat  brain  compared  to  the  corresponding  levels  in  143 
the  young  adult  rat  brain  (Lai  et  al.  1985c,  2000).  On  i44 
the  other  hand,  each  trace  metal  has  its  own,  almost  145 
unique,  brain  regional  distribution.  i46 

In  development,  various  regions  of  the  mammalian  147 
brain  undergo  structural  changes  concomitant  with  i48 
increases  in  glial  cell  numbers  and  migrations  of  grow-  149 
ing  and  maturing  neurons  (Lai  et  al.  2000).  Although  150 
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151  not  yet  fully  understood,  these  developmental  struc- 

152  tural  and  cellular  changes  ultimately  give  rise  to  each 

153  trace  metal  exhibiting  its  characteristic  regional  distri- 

154  bution  in  the  adult  brain  (Lai  et  al.  1985c,  2000).  For 

155  example,  in  the  adult  rat,  Fe  level  is  higher  in  hippo- 

156  campus,  hypothalamus,  pons  and  medulla,  and  cere- 

157  bellum  than  in  midbrain,  striatum,  and  cerebral  cortex. 

158  Zn  level  is  higher  in  hippocampus  and  cerebral  cortex 

159  than  in  the  other  regions  whereas  Cu  level  is  highest  in 

160  hypothalamus,  intermediate  in  striatum,  midbrain,  and 

161  cerebellum  but  lowest  in  hippocampus,  pons  and 

162  medulla,  and  cerebral  cortex.  Se  level  is  highest  in 

163  hippocampus,  midbrain,  and  hypothalamus,  interme- 

164  diate  in  cerebellum  and  cerebral  cortex,  but  lowest  in 

165  striatum  and  pons  and  medulla.  Mn  level  is  highest  in 

166  midbrain,  cerebellum,  and  pons  and  medulla,  interme- 

167  diate  in  cerebral  cortex  and  hypothalamus,  but  lowest 

168  in  striatum  and  hippocampus.  The  level  of  the  nones- 

169  sential  trace  metal,  Al,  unlike  those  of  the  essential 

170  metals  (e.g.,  Fe,  Zn,  Cu,  Mn,  Se)  is  lower  in  cerebral 

171  cortex  than  those  in  other  regions. 

172  Distributions  of  electrolytes  are  also  somewhat  dif- 

173  ferent  from  those  of  trace  metals  (Lai  et  al.  1985c, 

174  2000).  In  the  adult  rat,  Ca  level  is  lower  in  cerebral 

1 75  cortex  and  midbrain  than  in  the  other  regions.  Mg  level 

176  is  also  lower  in  cerebral  cortex  than  those  in  other 

177  regions. 

178  Interrelations  Between  Manganese  and 

179  Other  Metals  in  Brain 

180  To  facilitate  the  investigation  of  the  interrelations 

181  between  manganese  and  other  trace  metals  and  elec- 

182  trolytes  in  brain  and  other  organs,  a  model  of  chronic 

183  and  life-span  exposure  of  rats  to  manganese  had  been 

184  developed  (Lai  et  al.  1984,  1985b).  Chronic  Mn  expo- 

185  sure  was  carried  out  by  adding  MnCl2.4H20  into  the 

186  drinking  water  given  to  the  rats.  Four  groups  of  rats 

187  were  studied:  the  control  group  was  given  just  the 

188  double-distilled  water;  group  A  was  given  1  mg  of 

189  MnCl2.4H20  per  mL  of  double-distilled  water;  group 

190  B  was  given  10  mg  of  MnCl2.4H20  per  mL  of  double- 

191  distilled  water;  and  group  C  was  given  20  mg  of 

192  MnCl2.4H20  per  mL  of  double-distilled  water  (Lai 

193  et  al.  1984,  1985b).  The  rats  were  exposed  to  Mn  in 

194  utero  via  their  mothers’  circulation;  postnatally,  they 

195  were  exposed  to  Mn  via  their  mothers’  milk;  and  from 

196  around  weaning  (i.e.,  21/22  days  postnatal)  onward. 


they  were  directly  exposed  to  Mn  in  the  drinking  water  197 
(Lai  et  al.  1984,  1985b).  When  the  rats  attained  full  i98 
adulthood  (i.e.,  at  120  days  of  age),  they  were  eutha-  199 
nized  and  their  organ  removed  (Lai  et  al.  1984, 1985b).  200 
Each  rat  brain  was  dissected  into  the  following  seven  201 
regions:  cerebellum,  cerebral  cortex,  hippocampus,  202 
hypothalamus,  midbrain,  pons  and  medulla,  and  stria-  203 
turn  (Lai  et  al.  1984,  1985b).  The  contents  of  trace  204 
metals  and  other  elements  in  each  brain  region  were  205 
determined  employing  instrumental  neutron  activation  206 
analysis  (INAA)  (Chan  et  al.  1983;  Lai  et  al.  1985c,  207 
1999,  2000).  By  combining  the  versatile  technique  of  208 
INAA  with  the  animal  model  of  chronic  and  life-span  209 
exposure  to  Mn,  a  comprehensive  metallomic  database  210 
had  been  collected  of  levels  of  trace  metals  and  other  21 1 
essential  and  nonessential  elements  in  all  the  brain  212 
regions  in  the  four  groups  of  rats  (one  control  and  213 
three  Mn- treated  groups,  namely.  A,  B,  and  C)  (Chan  214 
et  al.  1983;  Lai  et  al.  1985c,  1999,  2000).  The  data  215 
were  taken  from  the  comprehensive  metallomic  data-  21 6 
base  and  then  analyzed  so  as  to  allow  the  interpretation  217 
of  how  Mn  can  interact  with  trace  and  major  elements  21 8 
in  discrete  rat  brain  regions  (Leung  et  al.  2011;  Wright  219 
et  al.  201 1).  The  level  of  each  trace  metal  or  element  in  220 
each  brain  region  in  the  Mn-treated  rat  was  compared  221 
with  the  corresponding  level  (set  as  100%)  in  the  same  222 
region  in  the  untreated  (i.e.,  control)  rat  and  the  differ-  223 
ence  ranked  as  %  increase  or  %  decrease  relative  to  the  224 
value  in  the  control  animal.  For  ease  of  visual  compar-  225 
ison,  the  rank  orders  of  increases  or  decreases  of  levels  226 
were  color-coded  (Tables  1  and  2)  (Leung  et  al.  2011;  227 
Wright  et  al.  2011).  228 

As  evident  from  the  rank-order  patterns  of  the  229 
regional  distributions  of  trace  metals  (Table  1)  and  230 
electrolytes  (Table  2)  in  the  seven  brain  regions  in  231 
the  rats  treated  with  the  three  doses  of  Mn,  several  232 
generalizations  regarding  how  Mn  interacts  with  233 
other  trace  metals  and  other  elements  can  be  arrived  234 
at.  (1)  Because  the  distributions  of  trace  metals  and  235 
other  elements  in  the  adult  rat  brain  show  region-  236 
specific  differences,  their  patterns  of  distribution  in  237 
the  untreated  normal  rat  brain  are  significantly  altered  238 
by  Mn  treatment  and  such  alterations  can  be  generally  239 
correlated  with  the  dose  of  Mn  administered  (Tables  1  240 
and  2).  (2)  Mn  treatment  leads  to  selective,  region-  241 
specific  increases  in  the  accumulation  of  some  trace  242 
and  major  elements  (Tables  1  and  2).  (3)  Mn  treatment  243 
results  in  selective,  region- specific  decreases  in  the  244 
accumulation  of  other  trace  and  major  elements  245 
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246  (Tables  1  and  2).  (4)  By  contrast,  Mn  treatment  gives 

247  rise  to  both  increases  and  decreases  in  the  accumula- 

248  tion  of  some  other  trace  and  major  elements,  and  these 

249  fluctuations  in  their  accumulation  are  dependent  on 

250  both  brain  region  in  question  and  the  dose  of  Mn 

251  administered  (Tables  1  and  2). 

252  As  may  be  expected,  upon  chronic  Mn  treatment, 

253  Mn  levels  show  the  largest  region- specific  increases 

254  among  all  the  trace  metals  that  were  investigated  and 

255  showed  increases  (Table  1).  Among  the  trace  metals 

256  examined  showing  region- specific  increases  in  their 

257  levels  induced  by  Mn  treatment,  the  rank  order  of 

258  their  relative  changes  compared  with  each  other  is 

259  Mn  >  Hg  >  Cu  >  Se  (Table  1).  Because  all  these 

260  trace  metals  are  neurotoxic  when  taken  in  excess,  this 

261  finding  suggests  that  increased  brain  regional  Mn  accu- 

262  mulation  consequent  to  Mn  treatment  results  in 

263  increased  regional  accumulation  of  Hg  (a  nonessential 

264  toxic  metal),  Cu,  and  Se,  ultimately  leading  to 

265  a  cumulative  toxicity  due  to  all  three  metals  and  per- 

266  haps  even  neurodegeneration. 

267  Among  the  trace  metals  and  other  elements  show- 

268  ing  region- specific  decreases  in  their  levels  induced  by 

269  Mn  treatment,  the  rank  order  of  their  relative  changes 

270  compared  with  each  other  is  F  >  V  >  Br  >  A1  >  Mo 

271  (Table  1).  The  functional  roles  of  F,  V,  Br,  and  Mo  in 

272  mammalian  brain  are  poorly  defined.  Nevertheless,  Al, 

273  a  nonessential  trace  metal  in  mammals,  is  known  to  be 

274  neurotoxic  (Lai  et  al.  2000).  Thus,  this  finding  suggests 

275  that  Mn  accumulation  consequent  to  Mn  treatment 

276  induces  region- specific  decreases  in  Al  accumulation, 

277  leading  to  a  lowering  of  neurotoxicity  due  to  Al. 

278  Among  the  trace  metals  and  other  elements  show- 

279  ing  region- specific  fluctuations  (i.e.,  both  trends  of 

280  increases  and  decreases)  in  their  levels  induced  by 

281  Mn  treatment,  the  rank  order  of  their  relative  changes 

282  compared  with  each  other  is  Cr  >  Zn  >  Co  >  Rb  >  I 

283  (Table  1).  The  functional  roles  of  Cr,  Rb,  and  I  in 

284  mammalian  brain  are  not  defined.  Zn  is  an  essential 

285  trace  metal:  its  decreases  and  increases  in  brain 

286  regional  accumulation  induced  by  Mn  treatment 

287  could  lead  to,  respectively,  deficiency  and  toxicity 

288  states  (Lai  et  al.  2000).  On  the  other  hand,  the  only 

289  known  role  of  Co  in  mammals  is  that  it  is  a  component 

290  in  vitamin  B 1 2  and  is  required  in  ultra- trace  quantities. 

291  However,  it  is  neurotoxic  when  taken  in  excess.  Thus, 

292  the  decreases  and  increases  in  brain  regional  accumu- 

293  lation  of  Co  induced  by  Mn  treatment  could  give  rise 


to,  respectively,  vitamin  B12  deficiency  and  Co  294 
neurotoxicity.  295 

Brain  Fe  level  approaches  those  of  major  elements  296 
and  electrolytes  such  as  Ca  (Lai  et  al.  1985c,  2000).  Fe  297 
interacts  with  Mn  in  intestinal  absorption  (see  above):  298 
thus,  consistent  with  this  notion  is  the  observation  that  299 
in  Mn- treated  rats,  the  largest  increase  in  Fe  levels  are  300 
noted  in  hypothalamus,  striatum,  and  cerebellum  301 
(Table  2),  and  these  are  the  same  regions  that  show  302 
the  highest  accumulation  of  Mn  (Table  1).  Because  Fe  303 
is  neurotoxic  when  taken  and/or  accumulated  in  304 
excess,  this  observation  suggests  that  the  increase  in  305 
Fe  accumulation  could  accentuate  the  neurotoxicity  of  306 
the  accumulated  Mn,  possibly  leading  to  enhanced  307 
neurodegeneration  (Lai  et  al.  2000).  308 

Similar  to  Fe,  two  electrolytes  (namely,  Na  and  Cl)  309 
show  region-specific  increases  in  their  levels  induced  310 
by  Mn  treatment,  the  rank  order  of  their  relative  311 
changes  compared  with  each  other  is  Fe  >  Na  >  Cl  312 
(Table  2).  This  finding  suggests  that  increases  in  Na  313 
and  Cl  accumulation  induced  by  Mn  treatment  could  314 
result  in  altered  ionic  balance  in  neural  cells.  315 

Unlike  the  trace  metals,  none  of  the  electrolytes  31 6 
exhibit  predominantly  region- specific  decreases  in  317 
their  levels  induced  by  Mn  treatment  (Table  2).  31 8 

Three  other  electrolytes  exhibit  region- specific  flue-  31 9 
tuations  (i.e.,  both  trends  of  increases  and  decreases)  in  320 
their  levels  induced  by  Mn  treatment,  the  rank  order  of  321 
their  relative  changes  compared  with  each  other  is  322 
Ca  >  K  >  Mg  (Table  2).  It  is  interesting  to  note  that  323 
Mn  treatment  results  in  increased  Ca  accumulation  in  324 
midbrain,  pons  and  medulla,  and  striatum  but  325 
decreased  accumulation  in  cerebellum  and  hippocam-  326 
pus  (Table  2),  suggesting  in  Mn-treated  rats,  midbrain,  327 
pons  and  medulla,  and  striatum  are  the  regions  that  328 
are  prone  to  calcification  and  Ca-mediated  329 
neurodegeneration  (Lai  et  al.  2000).  On  the  other  330 
hand,  the  Mn-treatment-induced  fluctuations  in  331 
regional  K  may  lead  to  altered  neuronal  excitability  332 
and  conduction,  while  the  fluctuations  in  regional  Mg  333 
could  result  in  some  alterations  in  key  protein  func-  334 
tions  (e.g.,  receptor-gaited  ion  channels  and  protein  335 
kinases)  in  which  Mg  plays  important  roles.  336 

In  addition  to  the  findings  discussed  above,  chronic  337 
and  life-span  Mn  treatment  also  modulates  on  the  338 
region- specific  distributions  of  trace  metals  and  elec-  339 
trolytes  during  development  and  aging.  Some  of  those  340 
findings  have  been  discussed  previously  and  will  not  341 
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342  be  reiterated  here  (see  Lai  et  al.  1985c,  1999,  2000  for 

343  detailed  discussion). 

344  Taken  together,  the  region- specific  interactions 

345  between  Mn  and  other  trace  metals  and  other  elements 

346  (Tables  1  and  2)  may  have  pathophysiological  impli- 

347  cations  in  neurodegenerative  and  other  neurological 

348  diseases  (see  below). 

349  Interrelations  Between  Manganese  and 

350  Other  Metals  in  Brain  in  Human  Health  and 

351  Diseases 

352  While  Mn  can  interact  with  trace  elements  (e.g.,  F,  V, 

353  Br,  Al,  Mo)  leading  to  region-specific  decreases  in 

354  their  accumulation,  the  health  impact  of  the  Mn- 

355  induced  decreases  is  largely  unknown  as  the  functional 

356  roles  of  these  trace  elements  in  brain,  with  the  excep- 

357  tion  of  Al,  are  unknown.  Of  some  health  concern  are 

358  the  Mn  interactions  where  brain  regional  levels  of  trace 

359  metals  become  increased:  these  trace  metals  include 

360  Mn,  Hg,  Cu,  Se,  Fe,  and  Zn.  The  available  evidence 

361  suggests  that  the  accumulation  of  these  metals  may 

362  have  pathophysiological  implications  in  several  neu- 

363  rodegenerative  and  other  neurological  diseases  and  the 

364  implications  are  briefly  summarized  below. 

365  High  brain  levels  of  Mn,  Ca,  and  Al  are  found  in 

366  Alzheimer’s  disease  (AD).  In  AD  patients,  plasma 

367  levels  of  Al,  Cd,  Hg,  and  Se  are  increased  (see  Lai 

368  et  al.  2000  for  discussion).  Fe  is  also  elevated  in  mul- 

369  tiple  regions  of  the  AD  brain.  Fe  in  the  cores  and  rims 

370  of  senile  plaques  of  amygdala  of  AD  patients  is  ele- 

371  vated  and  Fe  (like  Cu  and  Zn)  can  accelerate  aggrega- 

372  tion  of  (3-amyloid  peptide,  a  hallmark  of  AD 

373  neuropathology  (see  Lai  et  al.  2000  for  discussion). 

374  Additionally,  Zn  level  is  increased  in  different  regions 

375  of  the  AD  brain  (see  Lai  et  al.  2000  for  discussion). 

376  Consequently,  Fe,  Zn,  Al,  and  Cu  have  been  proposed 

377  to  be  responsible  for  inducing  cell  death,  especially 

378  neuronal  cell  death,  in  the  AD  brain  because  of  (a) 

379  formation  of  reactive  oxygen  species,  (b)  other  metal- 

380  mediated  cytotoxic  effects,  or  (c)  a  combination  of 

381  mechanisms  (see  Lai  et  al.  2000  for  discussion). 

382  Chronic  ►  Mn  toxicity  in  humans  shows  signs  and 

383  symptoms  that  are  reminiscent  of  those  noted  in 

384  Parkinson’s  disease  (PD)  and  dystonia  (Lai  et  al. 

385  2000).  Some  but  not  all  studies  have  demonstrated  an 

386  increased  brain  level  of  Mn  in  PD.  However,  increased 


levels  of  Fe  and  Zn  are  found  in  the  substantia  nigra  of  387 
PD  patients.  388 

In  several  neurological  diseases  other  than  AD  and  389 
PD,  brain  metabolism  of  Mn  and  other  metals  are  also  390 
disturbed.  Pick’s  disease  is  associated  with  increases  in  391 
brain  Mn,  Fe,  and  Na  and  decreases  in  brain  Cr  and  Se.  392 
In  amyotrophic  lateral  sclerosis  (ALS)  brain,  levels  of  393 
Al  and  Ca  are  elevated.  These  findings  suggest  Mn  394 
may  interact  with  other  metals  in  Pick’s  disease  and  395 
in  ALS  (see  Lai  et  al.  2000  for  discussion).  396 

In  some  metabolic  encephalopathies  (e.g.,  dialysis  397 
encephalopathy,  chronic  renal  failure  without  dialysis,  398 
and  hepatic  coma),  brain  Al  is  elevated.  Thus,  Al  399 
neurotoxicity  is  implicated  in  these  encephalopathies.  4oo 
There  is  also  good  evidence  that  Mn  level  is  elevated  in  4oi 
globus  pallidus  of  patients  with  liver  cirrhosis,  thereby  402 
implicating  ►  Mn  in  brain  in  hepatic  encephalopathy  403 
(see  Lai  et  al.  2000  for  discussion).  404 

Conclusions  and  Prospects  for  Future  405 

Investigation  406 

There  have  been  significant  advances  in  our  under-  407 
standing  of  manganese  and  its  interrelations  with  408 
other  metal  ions  in  health  and  disease.  The  advances  409 
in  the  last  25  years  have  been  built  upon  the  skillful  4io 
exploitation  of  the  versatile  technique  of  instrumental  41 1 
neutron  activation  analysis  (INAA)  in  conjunction  412 
with  a  rat  model  of  chronic  and  life-span  exposure  to  413 
Mn  in  constructing  and  assembling  a  comprehensive  41 4 
metallomic  database  containing  the  distributions  of  415 
over  20  trace  and  major  elements  in  seven  discrete  41 6 
brain  regions  and  in  multiple  peripheral  organs  in  rats  417 
during  their  life  span  (i.e.,  from  early  postnatal  devel-  4i8 
opment  until  aging).  This  comprehensive  database  also  419 
contains  the  distributions  of  some  20  trace  and  major  420 
elements  in  seven  discrete  brain  regions  and  in  multi-  421 
pie  peripheral  organs  in  rats  continuously  exposed  to  422 
three  doses  of  Mn  over  their  life  span.  The  gradual  423 
mining  and  analyses  of  selected  sets  of  data  within  this  424 
comprehensive  metallomic  database  have  allowed  us  425 
to  arrive  at  a  number  of  fundamental  conclusions  as  to  426 
how  Mn  interacts  with  other  trace  and  major  elements  427 
in  various  regions  of  the  rat  brain  and  in  various  428 
peripheral  organs.  429 

(1)  Mn  interacts  with  multiple  trace  elements  (espe-  430 
daily  Fe)  in  the  process  of  intestinal  absorption.  431 
(2)  Each  trace  and  major  element  has  its  own,  almost  432 
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433  unique,  brain  regional  distribution.  (3)  The  patterns  of 

434  distributions  of  trace  and  major  elements  in  the 

435  untreated  rat  brain  show  region- specific  differences, 

436  and  these  patterns  are  significantly  altered  by  Mn  treat- 

437  ment  in  an  approximately  dose-related  manner.  (4)  The 

438  patterns  of  brain  regional  distributions  of  trace  and 

439  major  elements  in  the  adult  rats  and  the  modulations 

440  by  chronic  Mn  treatments  thereon  have  implications  in 

441  health  and  disease,  especially  in  regard  to  several  neu- 

442  rodegenerative  (e.g.,  Alzheimer’s  disease  and 

443  Parkinson’s  disease)  and  other  neurological  diseases. 

444  (5)  However,  the  cellular  and  molecular  mechanisms 

445  underlying  how  Mn  interacts  with  other  trace  and 

446  major  elements  in  brain  and  other  organs  are  almost 

447  totally  unknown.  (6)  Nevertheless,  the  continued  min- 

448  ing  and  systematic  analyses  of  discrete  segments  of  the 

449  comprehensive  metallomic  database  are  beginning  to 

450  facilitate  the  formulation  of  discrete,  testable  hypoth- 

451  eses  regarding  such  cellular  and  molecular  mecha- 

452  nisms  and  lead  to  novel  and  productive  research. 

453  Thus,  these  endeavors  promise  to  break  new  grounds 

454  in  our  understanding  of  how  trace  and  major  elements 

455  interact  in  biological  systems. 
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ti  1  Mn  and  Its  Interrelation  with  Other  Metal  Ions  in  Health  and  Disease,  Table  1  Changes  in  levels  of  trace  metals  and  other 
elements  in  brain  regions  in  adult  female  rats  after  chronic  treatment  with  Mn  compared  with  corresponding  levels  in  untreated  (i.e., 
control)  rats.  The  Mn-treated  groups  consisted  of  group  A  (1  mg  of  MnCl2.4H20  per  mL  of  double-distilled  water),  group  B  (10  mg  of 
MnCl2.4H20  per  mL  of  double -distilled  water),  and  group  C  (20  mg  of  MnCl2.4H20  per  mL  of  double-distilled  water).  The  data  were 
derived  from  the  comprehensive  metallomic  database.  The  level  of  each  trace  metal  or  element  in  each  brain  region  in  the  Mn-treated 
rat  was  compared  with  the  corresponding  level  (set  as  100%)  in  the  same  region  in  the  untreated  (i.e.,  control)  rat  and  the  difference 
ranked  as  %  increase  or  %  decrease  relative  to  the  value  in  the  control  animal.  For  ease  of  visual  comparison,  the  rank  orders  of 
increases  or  decreases  of  levels  were  color-coded  as  follows:  Those  levels  showing  %  higher  than  corresponding  values  in  control  rats 
were  color-coded  as:  red,  0-25%;  purple,  25-50%;  and  brown,  >50%.  Those  levels  showing  %  decrease  compared  with 
corresponding  values  in  control  rats  were  color-coded  as:  yellow,  0%  to  —25%;  green,  —25%  to  —50%;  and  blue,  >—50%.  Those 
levels  that  were  the  same  as  corresponding  values  in  control  rats  were  coded  in  black  and  those  levels  that  were  not  detectable  (i.e., 
below  the  limits  of  detection)  by  the  INAA  technique  were  not  color-coded  (i.e.,  white) 
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t2  1  Mn  and  Its  Interrelation  with  Other  Metal  Ions  in  Health  and  Disease,  Table  2  Changes  in  levels  of  iron  and  electrolytes  in 
brain  regions  in  adult  female  rats  after  chronic  treatment  with  Mn  compared  with  corresponding  levels  in  untreated  (i.e.,  control)  rats. 
The  Mn-treated  groups  consisted  of  group  A  (1  mg  of  MnCl2.4H20  per  mL  of  double-distilled  water),  group  B  (10  mg  of 
MnCl2.4H20  per  mL  of  double-distilled  water),  and  group  C  (20  mg  of  MnCl2.4H20  per  mL  of  double-distilled  water).  The  data 
were  derived  from  the  comprehensive  metallomic  database.  The  level  of  each  trace  metal  or  element  in  each  brain  region  in  the  Mn- 
treated  rat  was  compared  with  the  corresponding  level  (set  as  100%)  in  the  same  region  in  the  untreated  (i.e.,  control)  rat  and  the 
difference  ranked  as  %  increase  or  %  decrease  relative  to  the  value  in  the  control  animal.  For  ease  of  visual  comparison,  the  rank 
orders  of  increases  or  decreases  of  levels  were  color-coded  as  follows:  Those  levels  showing  %  higher  than  corresponding  values  in 
control  rats  were  color-coded  as:  red,  0-25%;  purple,  25-50%;  and  brown,  >50%.  Those  levels  showing  %  decrease  compared  with 
corresponding  values  in  control  rats  were  color-coded  as:  yellow,  0%  to  —25%;  green,  —25%  to  —50%;  and  blue,  >—50%.  Those 
levels  that  were  the  same  as  corresponding  values  in  control  rats  were  coded  in  black  and  those  levels  that  were  not  detectable  (i.e., 
below  the  limits  of  detection)  by  the  INAA  technique  were  not  color-coded  (i.e.,  white) 
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Abstract.  Lifelong  exposure  to  environmental  factors  can  influence  the  risk  of  developing  diseases;  environmental  stresses  can 
ultimately  lead  to  cell  death  and  have  been  thought  to  be  the  cause  of  many  neurological  diseases.  Our  daily  diet  is  one  of  the 
important  environmental  factors  that  can  seriously  affect  the  development  and  proper  function  of  the  brain.  In  this  study,  we 
investigated  how  30  elements  and  electrolytes  that  were  consumed  in  a  regular  diet  over  a  lifetime  would  affect  the  distribution  of 
these  elements  in  the  brain  of  rats.  We  also  investigated  how  excessive  concentrations  of  contaminant  in  drinking  water,  such  as 
Mn,  may  affect  the  accumulation  of  elements  in  the  brain.  Our  results  indicated  that  increased  consumption  of  Mn  would 
enhance  the  retention  of  heavy  metals  such  Hg  and  Se  in  the  brain  and  is  believed  to  be  pivotal  in  many  neurological  disorders 
such  as  Parkinson’s  and  Alzheimer’s  disease. 


Key  words:  Brain;  heavy  metals;  electrolytes;  distribution;  metallomic;  neurological  diseases 
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1.  Introduction 

Many  of  the  metals  around  us  are  essential  for  life,  but  others  are  known  to  be  highly  toxic;  even  the  essential  metals 
can  be  toxic  when  their  intakes  are  too  high.  For  example,  metals  such  as  chromium,  cobalt,  copper,  manganese, 
and  zinc  are  essential  for  life.  But,  an  excess  intake  of  these  can  be  toxic.  Some  metals  such  as  arsenic,  cadmium, 
lead,  mercury,  and  even  vanadium  (which  are  found  all  throughout  our  environment)  are  toxic  to  humans.  Some  of 
these  toxic  metals  are  even  capable  of  forming  covalent  bonds  with  carbon,  which  result  in  metal-organic 
transformation.  This  transformation  affects  the  mobility  and  toxicity  of  the  element.  Exposure  to  metal  exists  all 
around  us.  Elements  come  from  natural  processes  such  as  volcanoes,  water,  bacterial  activity,  and  also  from 
anthropogenic  sources  such  as  automobile  exhaust,  agricultural  fertilizers,  industrial  activities,  and  many  other 
sources.  It  has  been  shown  that  in  highly  industrialized  areas  the  exposure  to  elements  is  extremely  high. 

The  brain  is  a  specialized  organ  of  the  body  that  metabolizes  and  accumulates  metals  as  part  of  its  normal 
function.  But  in  a  rich  metal  environment,  loss  of  metalloproteins  and  loss  of  defense  against  oxidative  stress 
caused  by  one  or  more  of  these  metals  could  be  responsible  for  neurodegeneration  disorders  such  as  Parkinson’s 
disease  (PD)  and  Alzheimer’s  disease  (AD).  The  intake  of  these  metals  occurs  by  ingestion  of  food,  water,  and 
inhaling  the  air.  The  elemental  distribution  in  the  different  brain  regions  vary  for  each  element.  Some  of  these 
elements  are  even  known  to  increase  or  decrease  in  brains  that  have  a  neurodegenerative  disorder. 

Elements  Studied 

Of  the  90  plus  naturally-occurring  elements,  26  are  known  to  be  essential  for  humans  and  animals  (Underwood, 
1977).  These  consist  of  11  major  elements  or  macro -elements.  They  are:  C,  H,  O,  N,  S,  Ca,  P,  K,  Na,  Cl,  and  Mg. 
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Fifteen  elements  are  known  as  trace  elements  or  micro -nutrients.  They  include:  Fe,  Zn,  Cu,  Mn,  Ni,  Co,  Mo,  Se,  Cr, 
I,  F,  Sn,  Si,  V,  and  As.  The  molecular  bases  for  the  essential  element  selection  and  rejection  have  not  been 
elucidated,  however.  Major  elements,  such  as  Na,  K,  Ca,  and  Mg,  are  required  for  bodily  functions  such  as  body 
fluid  buffer,  active  transport,  ionic  balance,  electrical  transmission,  and  tissue  development  as  well  as  the 
composition  of  body  fluids  and  structures.  Trace  elements  act  primarily  as  a  catalyst  in  enzyme  systems  in  cells 
where  they  serve  a  wide  range  of  functions  from  weak  ionic  effects  to  highly  specific  associations  such  as 
metalloenzymes.  In  addition,  the  protein-metal  interactions  may  increase  the  stability  of  the  protein  moiety  to 
metabolic  turnover. 

The  following  are  some  of  the  more  studied  elements  discussed  in  this  paper.  Others  do  exist,  but  not 
much  has  been  done  with  them  in  research.  As  it  can  be  seen  metals  are  found  normally  in  the  brain,  but  too  much 
of  them  is  not  a  good  thing.  An  increase/decrease  could  cause  a  major  change  and  lead  to  a  neurological  disorder. 

Calcium 

Calcium  (Ca)  is  the  fifth  most  abundant  element  found  in  the  earth’s  crust.  Ca  occurs  most  commonly  in 
sedimentary  rocks  in  the  minerals  calcite,  dolomite,  and  gypsum.  Ca  is  essential  for  life  in  most  living  organisms, 
including  humans.  Ca  has  been  shown  to  be  elevated  in  the  brains  of  patients  with  AD:  it  concentrates  in  the 
amyloid  plaques.  These  plaques  are  one  of  the  neuropathological  hallmarks  of  AD.  However,  PSAPP  mice  (a 
mouse  model  of  AD)  appear  to  accumulate  less  Ca  in  their  plaques  compared  to  their  surrounding  brain  tissue 
(Belavaria  ect,  2005). 

Copper 

Copper  (Cu),  like  most  elements,  is  mined  from  the  earth’s  crust.  Furthermore,  Cu  is  recycled.  Cu  is  commonly 
used  in  electrical  applications,  piping,  many  household  products  (e.g.,  sinks,  plumbing,  and  pots),  architectural 
applications,  coin-making,  and  chemical  applications.  Cu  has  been  found  to  be  vital  in  human  and  plant  life.  Cu  is 
introduced  into  the  body  mostly  via  food  intake.  Some  foods  that  are  high  in  Cu  are  oysters,  beef  or  lamb  liver, 
brazil  nuts,  cocoa,  black  pepper,  lobster,  sunflower  seeds,  green  olives,  avocados,  and  wheat  bran.  The  brain 
contains  approximately  7.3%  of  the  total  body  Cu  supply. 

Cu  has  been  an  extensively  studied  metal  in  the  brain  (Popescu  ect,  2009).  In  a  normal  brain,  Cu  is 
distributed  in  similar  ways  in  the  central  and  subcortical  white  matter  of  the  cerebellum  of  both  young  and  old 
brains;  however,  the  periphery  of  the  dentate  nucleus  is  rich  in  Cu  (Zhang  ect,  2009).  The  higher  Cu  concentrations 
are  mostly  found  in  the  cortex  and  hippocampus  (Popescu  ect,  2009).  A  normal  aging  brain  has  been  shown  to  have 
increased  Cu  levels,  especially  in  the  substantia  nigra  and  in  some  cerebellar  regions  (Bolognin  ect,  2009). 
However,  when  the  levels  of  Cu  in  the  cortex  and  hippocampus  increase,  Wilson’s  disease  is  said  to  result  (Gerlach 
ect,  1994).  In  AD,  there  is  an  abnormal  brain  Cu  distribution,  with  large  amounts  in  the  amyloid  plaques  but  a 
deficiency  in  the  neighboring  brain  tissue.  Other  researchers  also  reported  Cu  to  increase  in  the  senile  plaques 
(Bolognin  ect,  2009).  These  findings  suggest  the  involvement  of  Cu  in  AD  is  multifactorial  and  complex. 

Iron 

Iron  (Fe)  is  one  of  the  most  common  metals  found  in  everyday  use.  Fe  makes  up  about  5%  of  the  earth’s  crust.  The 
earth’s  core  is  believed  to  consist  largely  of  an  iron-nickel  alloy  constituting  35%  of  the  mass  of  the  earth  as  a 
whole.  Because  of  this  distribution,  Fe  is  thought  to  be  the  most  abundant  element  on  earth.  Some  popular  food 
items  rich  in  Fe  include  red  meat,  fish,  poultry,  beans,  vegetables,  black-eyed  peas,  wheat,  and  cereals. 

Fe  is  another  extensively  studied  metal  in  the  brain.  Fe  is  necessary  for  normal  brain  function  (e.g.,  in 
learning  and  memory)  (Kienzl  ect,  1995).  In  a  normal  brain,  Fe  is  distributed  in  similar  ways  in  central  and 
subcortical  white  matter  of  the  cerebellum  of  both  young  and  old  brains;  in  the  cerebellar  cortex,  there  are  high  Fe 
levels,  and  the  periphery  of  the  dentate  nucleus  is  also  rich  in  Fe  (Zhang  ect,  2009).  Fe  appears  to  increase  rapidly  in 
the  young  brain  and  then  remains  stable  until  the  later  years;  increases  in  Fe  in  the  substantia  nigra  and  globus 
pallidus  have  been  reported  (Bolognin  ect,  2009).  Regions  where  brain  Fe  is  high  include  substantia  nigra,  globus 
pallidus,  red  nucleus,  caudate  nucleus,  and  the  putamen  (Leskovjan  ect,  2009). 

Like  Cu  and  Ca,  Fe  has  been  shown  to  be  elevated  in  brains  of  patients  with  AD.  Elevated  Fe  is  found  in 
the  amyloid  plaques  (Belavaria  ect,  2005).  Fe  is  also  moderately  increased  in  the  parietal  cortex  in  AD  patients 
(Srivastava  ect,  2002).  In  patients  with  Attention  Deficit  Hyperactivity  Disorder  (ADHD),  Fe  has  been  shown  to 
increase  in  the  substantia  nigra  (Berg  ect,  2001). 
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Magnesium 

Magnesium  (Mg)  is  the  8*  most  abundant  element  in  the  earth’s  crust  and  in  found  also  in  seawater.  Mg  is 
commonly  used  in  structural  building  materials,  automotive  parts,  electronic  devices,  aerospace  construction, 
photography,  and  fireworks.  Mg  is  an  essential  metal  in  human  and  plant  life  (Yokel  ect,  2009).  Human  Mg 
deficiency  has  been  linked  to  the  development  of  asthma,  ADHD,  and  osteoporosis.  Foods  that  are  high  in  Mg 
include  spices,  nuts,  cereals,  coffee,  cocoa,  tea,  and  vegetables.  In  neurodegenerative  disorders  such  as  AD  and  PD, 
Mg  does  not  appear  to  play  a  major  role.  For  example.  Mg  levels  in  the  cerebellum  and  parietal  cortex  do  not  differ 
between  patients  with  AD  and  normal  humans  (Srivastava  ect,  2002). 

Manganese 

Manganese  (Mn)  is  found  in  the  earth’s  crust  and  in  seawater.  It  is  often  found  with  Fe.  Some  of  the  more  common 
usages  of  Mn  are  in  steel,  aluminum  alloys,  alkaline  batteries,  coins,  and  pigments.  Some  popular  foods  that  contain 
Mn  include  tea,  spinach,  grains,  rice,  eggs,  nuts,  olive  oil,  green  beans,  and  fish. 

The  majority  of  the  human  body’s  Mn  is  found  in  liver  and  kidneys;  nevertheless,  Mn  is  an  important 
element  for  normal  brain  development  and  function  (Yokel  ect,  2009).  In  the  aging  brain,  Mn  has  been  shown  to 
redistribute  itself  in  different  brain  regions,  including  hypothalamus,  thalamus,  and  corpus  callosum  (Bolognin  ect, 
2009).  High  brain  Mn  concentrations  are  related  to  PD.  There  has  been  much  research  indicating  that  human 
striatum,  globus  pallidus,  and  substantia  nigra  show  increases  in  Mn  levels  and  are  thought  to  be  target  sites  for  Mn 
neurotoxicity.  The  globus  pallidus  and  pituitary  glands  are  other  regions  where  Mn  preferentially  accumulates. 
High  exposures  to  Mn  results  in  increases  in  Mn  in  the  olfactory  epithelium  and  olfactory  bulb  (Dorman  ect,  2006). 
It  is  noteworthy  that  Mn  levels  in  the  cerebellum  are  similar  in  AD  and  normal  brains  while  Mn  increases  in  the 
parietal  cortex  of  AD  brains  (Srivastava  ect,  2002). 

Potassium 

Potassium  (K)  occurs  in  nature  as  an  ionic  salt  and  is  essential  for  humans  and  other  animals.  It  is  found  dissolved 
in  seawater  and  in  other  minerals.  Some  common  food  sources  of  Potassium  include  orange  juice,  potatoes, 
bananas,  avocados,  tomatoes,  broccoli,  apricots,  and  many  other  fruits. 

Exposure  to  Potassium  is  not  known  to  cause  neurodegenerative  disorders.  For  example,  the  concentrations 
of  Potassium  are  similar  between  AD  and  control  brains  (Hung,  2010;  Leskovjan,  2009). 

Sodium 

Sodium  (Na)  is  considered  an  essential  element  for  human  life.  It  is  found  in  nature  as  a  compound  and  never  alone, 
just  Na.  The  most  common  way  it  is  found  is  in  salt  deposits.  The  most  common  form  of  sodium  that  we  know  and 
use  is  sodium  chloride,  table  salt.  It  does  have  other  uses  as  well.  Over  or  under  exposure  to  sodium  has  not  yet 
been  shown  to  cause  neurological  disorders.  It  has  been  noted  that  sodium  has  been  shown  to  increase  in  every  part 
of  the  brain  in  AD  patients. 

What  Was  Done 

In  the  past,  research  has  been  done  on  the  effects  of  the  different  elements  on  the  brain  and  the  neurological 
disorders  that  they  may  cause.  None  though,  have  looked  into  as  many  metals  that  will  be  presented  here  at  one 
time.  Also,  manganese  has  not  yet  been  deployed  at  different  stages  in  a  developing  rat  brain. 

In  this  study,  we  investigated  30  elements  (including  electrolytes)  and  how  dietary  intake  on  a  life-time 
basis  would  affect  their  concentration  and  distribution  in  various  regions  of  the  rat  brain  (hypothalamus,  cerebellum, 
pons  and  medulla,  striatum,  mid-brain,  cerebral  cortex,  and  hippocampus)  and  discussed  their  health  implications. 
The  30  elements  of  interest  were:  Al,  As,  Ba,  Br,  Ca,  Cd,  Cl,  Co,  Cr,  Cu,  F,  Fe,  Hg,  I,  K,  La,  Mg,  Mn,  Mo,  Na,  Rb, 
S,  Sb,  Sc,  Se,  Si,  Sm,  Sr,  V,  and  Zn.  In  the  past,  research  has  primarily  focused  on  the  effects  of  different  elements 
on  the  brain  and  the  neurological  disorders  they  may  cause.  None  of  those  studies,  however,  have  examined 
simultaneously  as  many  elements  in  a  single  study  as  we  have  presented  here.  The  objective  of  this  paper  is  to 
characterize  the  levels  of  major  and  selected  trace  elements  in  various  regions  of  the  rat  brain  during  several  critical 
stages  of  development.  Because  during  the  first  8-9  days  of  age  postnatal,  the  rat  hippocampus  is  extremely  difficult 
to  visually  distinguish  from  the  overlying  cerebral  cortex,  we  had  included  the  hippocampus  tissue  together  with  the 
cerebral  cortex  for  analysis  in  the  case  of  5-day-old  tissue  samples.  The  four  postnatal  age  groups  of  rats  we  have 
studied  include  the  following: 
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I.  5  days  old; 

II.  10  days  old; 

III.  22/23  days  old;  and 

IV.  120  days  old  (i.e.,  adult). 

When  manganese  was  administered,  the  following  levels  were  added  to  the  drinking  water  (This  will  be  the 
same  nomenclature  used  on  the  Figures): 

Control:  120  days  old  adult  female  Wistar  rat  (Porton  Strain) 

A  group:  Life-long  manganese  treatment  with  1  mg/ml  Mn^"^  in  drinking  water 
B  group:  Life-long  manganese  treatment  with  10  mg/ml  Mn^"^  in  drinking  water 
C  group:  Life-long  manganese  treatment  with  20  mg/ml  Mn^"^  in  drinking  water 

As  our  well  being  is  largely  impacted  by  the  environment  we  are  living  in,  dietary  intake  is  definitely  a 
major  factor  that  posts  a  long-term  effect  on  our  health.  This  paper  provides  some  insight  into  how  our  diet  and 
pollutants  in  our  diet  may  affect  our  neurological  health.  Consequently,  our  experimental  results  may  allow  us  to 
take  some  preventative  measures  in  determining  how  best  to  optimize  and  gauge  our  dietary  intake  of  major  and 
trace  elements  for  the  betterment  of  our  health. 

Humans  vs.  Rats 

While  humans  and  rats  are  not  identical  neurologically  and  physiologically,  there  are  more  similarities  between  the 
two  species  as  far  as  brain  structure  and  functions  are  concerned.  The  four  stages  of  the  postnatal  development  of 
the  rat  chosen  in  this  study  closely  parallel  the  postnatal  development  of  humans. 

2.  Experimental  Methods 

Wistar  rats  of  the  Portion  strain  (Animal  Breeding  Unit,  Carshalton,  and  Surrey,  U.K.)  bred  in  the  Institute  of 
Neurology,  University  of  London,  United  Kingdom  were  used.  All  animals  were  kept  on  a  12-hour  light/1 2-hour 
dark  cycle  with  free  access  to  food  and  water.  Elemental  concentrations  in  the  rat  food  pellets  had  been  determined 
(Table  1  below). 

Table  1  Elemental  Concentration  of  Rat  Food  Pellet 


Element 

Concentration  (in  mg/g) 

Ca 

6.39  +  1.68 

Cl 

2.31+0.49 

Fe 

0.25  +  0.05 

K 

5.36  +  0.95 

Mg 

1.17  +  0.32 

Na 

1.48  +  0.32 

Concentration  (in  pg/g) 

A1 

98.06  +  8.05 

Br 

10.57  +  2.26 

Co 

0.20  +  0.04 

Cr 

1.50  +  0.44 

Cu 

7.21+2.12 

F 

ND(5.00) 

Hg 

ND  (0.25) 

I 

ND  (0.50) 

Mn 

49.34  +  8.65 
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Mo 

2.80  +  0.45 

Se 

ND  (0.25) 

Rb 

12.73+2.61 

V 

ND  (0.50) 

Zn 

47.73  +4.11 

Thirty  trace  and  major  elements  in  different  brain  regions  of  rats  at  the  four  different  age  groups  (i.e.,  I  through  IV 
as  defined  above)  were  analyzed  by  instrumental  neutron  activation  analysis  (INAA)  (Chan  ect,  1983).  The  samples 
were  irradiated  by  thermal  neutrons  using  three  different  sets  of  conditions  depending  on  the  nuclear  characteristics 
of  the  elements  of  interest  (Chan  ect,  1983).  Not  all  30  elements  were  reported  in  the  results  because  those  not 
reported  herein  were  either  below  the  detection  limits  of  our  INAA  technique  (Chan  ect,  1983)  or  the  elements  were 
not  retained  by  the  brain  tissue.  All  values  listed  are  mean  ±  S.D.;  ND  =  not  detectable,  and  values  in  brackets  are 
the  maximum  elemental  concentrations  present  in  the  diet. 

As  already  noted  above,  in  age  group  I,  the  hippocampus  tissue  had  been  included  in  the  cerebral  cortex 
and  analyzed  as  such. 

All  the  standard  materials  and  samples  for  INAA  were  freeze-dried  and  pelleted.  Dried  samples  (rat  brain 
regions)  were  homogenized  using  a  Glen  Creston  polystyrene  ball-mill  and  pelleted.  Other  details  of  standard  and 
sample  preparations  were  as  described  previously  (Chan,  1981;  Lee,  2010). 

Standards  and  samples  were  irradiated  in  a  100  KW  ‘Consort’  Reactor  Mark  II  at  the  Imperial  College 
Reactor  Centre.  Irradiated  standards  and  samples  were  then  analyzed  for  their  elemental  contents  by  gamma  ray 
spectrometry  using  various  Ge(Li)  detectors  and  ND6600  Multichannel  Analyzer  (Nuclear  Data  Inc.,  Schaumburg, 
Illinois,  USA).  Details  of  the  elemental  determinations  were  described  in  the  methodology  paper  by  Chan  et  al. 
(1983). 


All  laboratory  chemicals  used  were  of  analytical  grade  (BDH  Chemicals  Limited,  U.K.)  and  single  element 
standards  of  trace  elements  were  obtained  from  AAS  (Ventron  Division,  Limited,  U.K.);  other  elemental  standards 
for  F,  Cl,  Br,  and  P  were  obtained  from  Hopkin  and  Williams  Chemical  Ltd.,  U.K.  Water  for  solution  preparations 
and  feeding  was  double-distilled. 

3.  Manganese 

For  some  experiments,  manganese  was  added  to  the  rat’s  water.  The  purpose  was  to  study  the  effects  the  manganese 
had  on  the  other  elements  that  were  in  the  brain.  The  results  of  this  will  be  shown  later.  A  brief  description  of 
manganese  was  given  above,  but  do  to  the  extent  of  discussion  with  manganese  a  more  detailed  description  is 
needed. 


Manganese  was  first  discovered  by  Johan  G.  Gahn  in  1774  by  reduction  of  the  dioxide  with  carbon.  The 
name,  manganese,  comes  from  the  Latin  word  ‘magnes,’  which  means  magnet.  Manganese  is  a  gray-white,  brittle, 
hard,  metal.  Pure  manganese  exists  in  four  allotropic  forms.  The  metal  makes  up  approximately  0.1%  of  the  Earth’s 
crust.  This  makes  it  the  12*  most  abundant  element  found  in  the  Earth’s  crust.  The  metal  is  used  extensively  to 
produce  a  variety  alloys,  such  as  steel.  In  fact  without  manganese  steel  would  be  said  not  to  exist.  It  is  also  used  in 
pigments,  cell  batteries,  and  can  be  added  as  an  additive  in  gasoline  to  increase  the  octane  rating.  (Manganese  ect, 
2008) 


Manganese  is  also  known  to  be  an  important  element  in  our  daily  diet.  The  metal  helps  the  body  convert 
protein  and  fat  to  energy.  Some  other  benefits  of  manganese  are  a  reduction  in  fatigue  levels,  help  improve 
memory,  prevent  the  incidence  and  severity  of  osteoporosis,  promote  normal  bone  growth,  and  help  to  maintain 
healthy  nervous,  immune,  and  reproductive  systems.  (Manganese,  2005)  In  our  diet  we  can  find  manganese  in 
plants  and  animals.  These  foods  include  avocados,  nuts,  seaweed,  tea,  raisins,  spinach,  pineapple,  blueberries, 
beans,  whole  grains,  and  other  green  leafy  vegetables. 
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In  the  body,  the  largest  manganese  quantities  are  found  in  bones,  liver,  kidney,  and  pancreases.  One 
interesting  thing  to  note  about  manganese  in  the  body  is  that  decreasing  levels  of  manganese  are  tied  with  increasing 
levels  of  iron.  This  leads  us  to  believe  that  manganese  absorption  is  tied  to  iron  absorption.  Currently  there  is  no 
recommended  dietary  allowance  of  manganese,  but  it  has  been  shown  that  2.5  -  5.0  milligrams  is  safe  for  humans 
1 1  years  old  and  older.  However,  not  enough  manganese  can  lead  to  manganese  deficiencies.  These  deficiencies 
can  include  seizures,  convulsions,  eye  problems,  heart  disorders,  high  cholesterol,  memory  loss,  osteoporosis, 
contractions,  hypertension,  and  atherosclerosis.  (Manganese,  2005)  Too  much  manganese  is  rare  due  to  the  fact  that 
manganese  is  one  of  the  least  toxic  trace  minerals  in  the  body.  However,  exposure  to  high  manganese  levels  has 
been  recorded  and  linked  to  impaired  motor  skills  and  cognitive  disorders.  A  fatal  dose  is  said  to  be  10  grams. 
When  Manganese  is  abnormally  concentrated  in  the  brain,  especially  in  the  basal  ganglia  (composed  of  the 
striatum),  neurological  disorders  could  result  due  to  high  concentrations.  (Amano  ect,  2004) 

4.  Results 

Table  6  and  Figure  3b  show  the  elemental  concentration  distribution  for  the  brain  as  a  whole  as  an  adult  (120  days) 
and  old  (750  days).  Table  6  is  in  mg/g  and  pg/g.  Ca,  Cl,  Fe,  K,  Mg,  and  Na  are  in  mg/g  while  the  others  are  in  pg/g. 
This  is  the  same  for  Figure  3a  as  well.  The  amount  of  manganese  added  to  the  water,  for  the  old  treated,  was  1 
mg/ml.  Both  the  table  and  the  figure  display  the  same  information,  just  in  different  formats.  In  Table  6,  the 
percentages  shown  are  found  by  dividing  the  control  (120  days)  with  the  old  control  (720  days)  and  the  old  treated. 
Figure  3b  shows  an  enlarged  scale  of  3a  to  clarify  what  happens  on  the  lower  concentration  levels.  No  information 
is  available  on  a  breakdown  of  the  different  parts  of  the  older  brain  as  shown  before  for  the  younger  brains. 

Comparison  of  Older  Brains 

The  following  describes  what  is  being  shown  in  the  table  and  figure  below.  An  emphasis  has  been  placed  on  the 
older  (750  days)  brains. 

From  both  the  table  and  figure  it  can  be  seen  that  a  majority  of  the  elements  decrease  as  the  brain  increases 
in  age.  This  is  seen  especially  with  manganese  and  selenium.  It  has  been  shown  that  high  levels  of  Mn  have  been 
found  in  AD  and  PD  brains.  (Dorman  ect,  2006)  Maybe  the  decrease  shown  is  the  body’s  way  of  decreasing  the 
levels  of  Mn  naturally.  Selenium  is  important  in  humans  for  cellular  function.  In  large  doses  it  is  toxic.  Large  doses 
are  considered  to  be  greater  than  4000  micrograms  per  day.  This  can  lead  to  selenosis.  Selenium  deficiency  is 
extremely  rare  in  humans.  This  is  probably  due  to  the  fact  that  selenium  is  found  in  many  foods  that  humans 
consume  such  as  meat,  fish,  eggs,  nuts,  and  mushrooms. 

The  elements  that  do  increase  dramatically  are  calcium,  copper,  and  iron.  Without  calcium,  the  brain  could 
age  more  quickly  than  normal  and  it  could  lead  to  the  inability  to  make  quick  judgments.  As  people  age  the  ability 
to  make  quick  judgments  does  decrease  so  the  increase  in  calcium  could  be  a  good  thing.  As  was  stated  in  previous 
sections  many  regions  of  the  brain  have  been  shown  to  have  abnormal  copper  distributions  during  AD  and  high 
accumulations  have  been  related  to  Wilson’s  disease.  High  accumulations  of  copper  in  the  brain  have  been  shown 
to  be  the  primary  cause  of  Wilson’s  disease  (Gerlach  ect,  1994).  Increased  brain  iron  has  been  found  in  several 
neurodegenerative  disorders  although  it  has  not  been  defined  as  the  main  cause  (Lee  ect,  2010).  Lower  levels  of 
iron  in  the  brain  could  help  decrease  the  chance  of  neurodegenerative  disorders  (This  has  not  been  proven  in 
research). 

When  manganese  is  added  to  the  water  it  can  be  seen  that  a  majority  of  the  elements  decrease  when 
compared  to  the  control  and  old  control.  This  is  seen  especially  in  selenium.  This  decrease  in  selenium  can  be  a 
good  thing  but,  as  mentioned  above,  selenium  is  important  for  cellular  function.  Calcium,  copper,  and  iron  are 
greater  than  the  control  (120  days)  although,  are  not  as  high  as  the  old  control.  The  possible  effects  of  the  higher 
concentrations  were  discussed  above. 


Page  6  of  9 


Table  6  Comparison  of  Adult  Brain  to  Old  Brain  in  Table  Format 


Above  Control 
0  to  25%  red 
25  to  50%  purple 
>  50%  brown 


Key: 

Under  Control 
0  to  -25%  yellow 
-25%  to  -50%  green 
<  50%  blue 


In  Figure  3a  the  abbreviations  that  are  used  are  the  following: 

AC:  Adult  Control  (120  days  old) 

OC:  Old  Control  (750  days  old) 

OT:  Old  Treated  (750  days  old)  -  Life-long  manganese  treatment  with  1  mg/ml  Mn^"^  in  drinking  water 
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Figure  3a  Comparison  of  Adult  Brain  to  Old  Brain 
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Figure  3b  Same  as  Figure  3a,  with  enlarged  scale 
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5.  Conclusion 

Our  results  strongly  suggest  that  the  metallomic  distributions  in  the  rat  brain  change  markedly  during  the  latter  years 
of  life.  In  conjunction  with  the  reports  in  the  literature,  our  findings  also  suggest  that  brain  regional  metallomic 
distribution  can  be  influenced  by  dietary  intake  of  metals  and  other  elements  and  may  contain  pathophysiological 
implications  in  several  key  neurodegenerative  diseases  such  as  Parkinson’s  disease  and  Alzheimer’s  disease.  This  is 
especially  seen  when  the  manganese  was  added  to  the  water  of  the  rats. 

Our  results  also  show  that  as  the  brain  ages  it  dispenses  of  the  metals  and  electrolytes  that  could  cause  harm 
to  the  brain.  This  is  especially  seen  in  the  levels  of  manganese.  However  on  the  flip  side  the  brain  also  adds  to  the 
essential  elements  that  are  needed  for  brain  development  and  memory.  This  is  seen  in  the  levels  of  calcium. 

There  are,  though,  some  elements  that  the  brain  does  not  deal  with,  but  should.  An  example  of  this  is 
shown  in  copper.  The  levels  of  copper  increased  as  the  brain  aged  and  copper  is  shown  to  be  one  of  the  primary 
causes  of  Wilson’s  disease.  The  added  levels  of  manganese  in  the  water  did  help  lower  the  copper  levels.  However, 
much  more  research  needs  to  be  done  to  see  if  this  would  actually  help. 

A  metallomic  distribution  model  of  various  regions  of  the  rat  brain  can  be  developed  based  on  our 
experimental  results  and  statistical  analysis.  Nevertheless,  much  remains  to  be  discovered  regarding  the  brain 
functional  significance  of  metallomic  distribution  during  development. 
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Abstract.  Lifelong  exposure  to  environmental  factors  can  influence  the  risk  of  developing  diseases;  environmental  stresses  can 
ultimately  lead  to  cell  death  and  have  been  thought  to  be  the  cause  of  many  neurological  diseases.  Our  daily  diet  is  one  of  the 
important  environmental  factors  that  can  seriously  affect  the  development  and  proper  function  of  the  brain.  In  this  study,  we 
investigated  how  30  elements  and  electrolytes  that  were  consumed  in  a  regular  diet  over  a  lifetime  would  affect  the  distribution  of 
these  elements  in  seven  regions  of  the  brain  of  rats.  We  also  investigated  how  excessive  concentrations  of  contaminant  in 
drinking  water,  such  as  Mn,  may  affect  the  accumulation  of  elements  in  the  brain.  Our  results  indicated  that  increased 
consumption  of  Mn  would  enhance  the  retention  of  heavy  metals  such  Hg  and  Se  in  the  brain  that  is  believed  to  be  pivotal  in 
many  neurological  disorders  such  as  Parkinson’s  and  Alzheimer’s  disease. 


Key  words:  Brain;  heavy  metals;  electrolytes;  distribution;  metallomic;  neurological  diseases 
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1.  Introduction 

Many  of  the  metals  around  us  are  essential  for  life,  but  others  are  known  to  be  highly  toxic;  even  the  essential  metals 
can  be  toxic  when  their  intakes  are  too  high.  For  example,  metals  such  as  chromium,  cobalt,  copper,  manganese, 
and  zinc  are  essential  for  life.  But,  an  excess  intake  of  these  can  be  toxic.  Some  metals  such  as  arsenic,  cadmium, 
lead,  mercury,  and  even  vanadium  (which  are  found  all  throughout  our  environment)  are  toxic  to  humans.  Some  of 
these  toxic  metals  are  even  capable  of  forming  covalent  bonds  with  carbon,  which  result  in  metal -organic 
transformation.  This  transformation  affects  the  mobility  and  toxicity  of  the  element.  Exposure  to  metal  exists  all 
around  us.  Elements  come  from  natural  processes  such  as  volcanoes,  water,  bacterial  activity,  and  also  from 
anthropogenic  sources  such  as  automobile  exhaust,  agricultural  fertilizers,  industrial  activities,  and  many  other 
sources.  It  has  been  shown  that  in  highly  industrialized  areas  the  exposure  to  elements  is  extremely  high. 

The  brain  is  a  specialized  organ  of  the  body  that  metabolizes  and  accumulates  metals  as  part  of  its  normal 
function.  But  in  a  rich  metal  environment,  loss  of  metalloproteins  and  loss  of  defense  against  oxidative  stress 
caused  by  one  or  more  of  these  metals  could  be  responsible  for  neurodegeneration  disorders  such  as  Parkinson’s 
disease  (PD)  and  Alzheimer’s  disease  (AD).  The  intake  of  these  metals  occurs  by  ingestion  of  food,  water,  and 
inhaling  the  air.  The  elemental  distribution  in  the  different  brain  regions  vary  for  each  element.  Some  of  these 
elements  are  even  known  to  increase  or  decrease  in  brains  that  have  a  neurodegenerative  disorder. 

Elements  Studied 

Of  the  90  plus  naturally-occurring  elements,  26  are  known  to  be  essential  for  humans  and  animals  (Underwood, 
1977).  These  consist  of  11  major  elements  or  macro -elements.  They  are:  C,  H,  O,  N,  S,  Ca,  P,  K,  Na,  Cl,  and  Mg. 
Eifteen  elements  are  known  as  trace  elements  or  micro -nutrients.  They  include:  Ee,  Zn,  Cu,  Mn,  Ni,  Co,  Mo,  Se,  Cr, 
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I,  F,  Sn,  Si,  V,  and  As.  The  molecular  bases  for  the  essential  element  selection  and  rejection  have  not  been 
elucidated,  however.  Major  elements,  such  as  Na,  K,  Ca,  and  Mg,  are  required  for  bodily  functions  such  as  body 
fluid  buffer,  active  transport,  ionic  balance,  electrical  transmission,  and  tissue  development  as  well  as  the 
composition  of  body  fluids  and  structures.  Trace  elements  act  primarily  as  catalyst  in  enzyme  systems  in  cells 
where  they  serve  a  wide  range  of  functions  from  weak  ionic  effects  to  highly  specific  associations  such  as 
metalloenzymes.  In  addition,  the  protein-metal  interactions  may  increase  the  stability  of  the  protein  moiety  to 
metabolic  turnover. 

The  following  are  some  of  the  more  studied  elements.  Others  do  exist,  but  not  much  has  been  done  with 
them  in  research.  As  it  can  be  seen  metals  are  found  normally  in  the  brain,  but  too  much  of  them  is  not  a  good  thing. 
An  increase/decrease  could  cause  a  major  change  and  lead  to  a  neurological  disorder. 

Aluminum 

Aluminum  (Al)  is  one  of  the  more  widely  distributed  metals  in  the  environment.  Approximately  8%  of  the  earth’s 
crust  is  Al.  The  exposure  of  Al  normally  occurs  through  air,  food,  and  water  (Kuman  &  Gill,  2009).  The  brain 
contains  approximately  1%  of  the  body’s  total  Al;  however,  Al  has  no  known  function  in  normal  mammalian  brain. 

During  the  life-span  of  a  normal  human  brain,  its  Al  levels  appear  to  increase  around  age  40,  and  then 
plateau  at  about  age  70.  The  Al  levels  then  begin  to  increase  again  from  age  80  to  90.  The  globus  pallidus  (GP), 
substantia  nigra  (SN)  and  the  nucleus  ruber  appear  to  be  the  highest  Al  levels  in  the  normal  human  brain  (Bolognin 
ect,  2009).  The  levels  of  Al  increase  in  the  grey  matter  in  patients  with  dialysis  encephalopathy  (Schafer  ect,  2006). 
Also,  Al  accumulations  in  the  brain  have  been  found  to  increase  in  patients  with  renal  failure.  Following  oral 
exposure  to  this  metal,  retention  of  Al  was  reported  in  the  hippocampus.  This  region  of  the  brain  is  rich  in 
cholinergic  neurons.  These  and  other  observations  suggest  that  Al  has  neuro toxin  properties.  Furthermore, 
following  chronic  exposure,  Al  has  been  shown  to  accumulate  in  all  regions  of  the  rat  brain.  There  is  evidence  of  a 
relationship  between  the  high  levels  of  Al  and  increased  risk  of  neurodegenerative  disorders,  including  AD  and  PD 
(Kuman  &  Gill,  2009). 

Arsenic 

Arsenic  (As)  is  found  in  the  soil  and  can  be  transferred  to  water  sources  from  the  soil.  Arsenic  is  introduced  into  the 
body  by  drinking  contaminated  water  or  consuming  marine  species  (known  to  be  high  in  arsenic).  Arsenic  is  also 
found  in  wood  preservatives,  in  the  production  of  semiconductors  and  glass,  and  in  pesticides. 

Arsenic  is  known  to  induce  damage  to  brain  cells.  The  metal  is  noted  to  pass  from  the  maternal  to  fontal 
tissue  across  the  transplacental  barrier.  Arsenic  is  known  to  cause  disturbances  in  lipid  peroxidation,  generation  of 
nitric  oxide,  reactive  oxygen  species,  and  apoptosis.  (Florea  ect,  2006) 

Boron 

Boron  (B)  is  normally  found  in  the  soil.  The  semiconductor  industry  uses  boron  as  a  dopant,  while  boron  is  also 
used  in  light  structural  materials  (e.g.  fiberglass),  insecticides,  preservatives,  and  reagent  for  chemical  synthesis. 
Boron  is  essential  for  plant  growth.  The  lack  of  boron  can  cause  deficiencies  in  plants  while  too  much  boron  can  be 
toxic  to  the  plants.  Boron  is  also  necessary  for  the  health  of  rats. 

In  research,  boron’s  physiological  role  in  humans  has  not  yet  been  fully  studied.  It  is  known  that  Boron  is 
shown  to  moderately  increase  in  the  parietal  cortex  of  the  brain  in  AD  brains  when  compared  to  normal  brains. 
(Srivastava  ect,  2002) 

Calcium 

Calcium  (Ca)  is  the  fifth  most  abundant  element  found  in  the  earth’s  crust.  Ca  occurs  most  commonly  in 
sedimentary  rocks  in  the  minerals  calcite,  dolomite,  and  gypsum.  Ca  is  essential  for  life  in  most  living  organisms, 
including  humans.  Ca  has  been  shown  to  be  elevated  in  the  brains  of  patients  with  AD:  it  concentrates  in  the 
amyloid  plaques.  These  plaques  are  one  of  the  neuropathological  hallmarks  of  AD.  However,  PSAPP  mice  (a 
mouse  model  of  AD)  appear  to  accumulate  less  Ca  in  their  plaques  compared  to  their  surrounding  brain  tissue 
(Belavaria  ect,  2005). 

Carbon 
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Carbon  is  best  known  as  graphite,  diamond,  or  amorphous  carbon.  Carbon  is  also  found  in  coal,  gas,  and  oil 
reserves.  Carbon  is  present  in  all  known  life  forms;  and  in  the  human  body,  carbon  is  the  second  most  abundant 
element  by  mass  after  oxygen. 

It  was  not  found  the  role  of  Carbon  in  neurologic  disorders.  Carbon  has  been  noted  to  be  about  half  its 
normal  values  in  the  AD  brains  when  compared  to  normal  brains.  (Dorman  ect,  2006) 

Cadmium 

Cadmium  is  produced  mainly  as  a  byproduct  from  mining,  smelting,  and  refining  sulfide  ores  of  zinc.  Cadmium  is 
used  in  nickel-cadmium  batteries  and  cadmium  telluride  solar  panels.  The  use  of  cadmium  has  been  decreasing  due 
to  its  high  toxicity  and  carcinogenicity.  There  are  many  environmental  and  health  concerns  associated  with 
cadmium.  Traces  of  cadmium  naturally  occur  in  phosphate,  and  have  been  shown  to  transmit  in  food  through 
fertilizer  applications. 

Cadmium  (Cd)  has  been  found  to  not  be  essential  to  the  human  body.  Cadmium  has  been  found  though  to 
be  in  the  initiation  of  cancer  and  the  progression  of  cancer.  No  research  was  found  on  cadmium  studies  in  the  brain. 
(Hung  ect,  2010) 

Chromium 

Chromium  (Cr)  is  also  found  in  the  earth’s  crust  and  is  mined  as  chromite  ore.  Because  of  chromium’s  high 
corrosion  resistance  and  hardness,  it  is  added  to  nickel  to  create  stainless  steel:  this  is  the  most  common  application 
of  Cr.  It  is  also  used  in  dyes  and  pigments,  as  a  gasoline  additive,  and  in  the  tanning  of  leather.  The 
pathophysiological  role  of  Cr  has  not  been  elucidated.  However,  Cr  has  been  shown  to  moderately  increase  in  the 
parietal  cortex  of  patients  with  AD  when  compared  to  that  in  normal  brains  (Srivastava  ect,  2002). 

Copper 

Copper  (Cu),  like  most  elements,  is  mined  from  the  earth’s  crust.  Furthermore,  Cu  is  recycled.  Cu  is  commonly 
used  in  electrical  applications,  piping,  many  household  products  (e.g.,  sinks,  plumbing,  and  pots),  architectural 
applications,  coin-making,  and  chemical  applications.  Cu  has  been  found  to  be  vital  in  human  and  plant  life.  Cu  is 
introduced  into  the  body  mostly  via  food  intake.  Some  foods  that  are  high  in  Cu  are  oysters,  beef  or  lamb  liver, 
brazil  nuts,  cocoa,  black  pepper,  lobster,  sunflower  seeds,  green  olives,  avocados,  and  wheat  bran.  The  brain 
contains  approximately  7.3%  of  the  total  body  Cu  supply. 

Cu  has  been  an  extensively  studied  metal  in  the  brain  (Popescu  ect,  2009).  In  a  normal  brain,  Cu  is 
distributed  in  similar  ways  in  the  central  and  subcortical  white  matter  of  the  cerebellum  of  both  young  and  old 
brains;  however,  the  periphery  of  the  dentate  nucleus  is  rich  in  Cu  (Zhang  ect,  2009).  The  higher  Cu  concentrations 
are  mostly  found  in  the  cortex  and  hippocampus  (Popescu  ect,  2009).  A  normal  aging  brain  has  been  shown  to  have 
increased  Cu  levels,  especially  in  the  substantia  nigra  and  in  some  cerebellar  regions  (Bolognin  ect,  2009). 
However,  when  the  levels  of  Cu  in  the  cortex  and  hippocampus  increase,  Wilson’s  disease  is  said  to  result  (Gerlach 
ect,  1994).  In  AD,  there  is  an  abnormal  brain  Cu  distribution,  with  large  amounts  in  the  amyloid  plaques  but  a 
deficiency  in  the  neighboring  brain  tissue.  Other  researchers  also  reported  Cu  to  increase  in  the  senile  plaques 
(Bolognin  ect,  2009).  These  findings  suggest  the  involvement  of  Cu  in  AD  is  multifactorial  and  complex. 

Iron 

Iron  (Fe)  is  one  of  the  most  common  metals  found  in  everyday  use.  Fe  makes  up  about  5%  of  the  earth’s  crust.  The 
earth’s  core  is  believed  to  consist  largely  of  an  iron-nickel  alloy  constituting  35%  of  the  mass  of  the  earth  as  a 
whole.  Because  of  this  distribution,  Fe  is  thought  to  be  the  most  abundant  element  on  earth.  Some  popular  food 
items  rich  in  Fe  include  red  meat,  fish,  poultry,  beans,  vegetables,  black-eye  peas,  wheat,  and  cereals. 

Fe  is  another  extensively  studied  metal  in  the  brain.  Fe  is  necessary  for  normal  brain  function  (e.g.,  in 
learning  and  memory)  (Kienzl  ect,  1995).  In  a  normal  brain,  Fe  is  distributed  in  similar  ways  in  central  and 
subcortical  white  matter  of  the  cerebellum  of  both  young  and  old  brains;  in  the  cerebellar  cortex,  there  are  high  Fe 
levels,  and  the  periphery  of  the  dentate  nucleus  is  also  rich  in  Fe  (Zhang  ect,  2009).  Fe  appears  to  increase  rapidly  in 
the  young  brain  and  then  remains  stable  until  the  later  years;  increases  in  Fe  in  the  substantia  nigra  and  globus 
pallidus  have  been  reported  (Bolognin  ect,  2009).  Regions  where  brain  Fe  is  high  include  substantia  nigra,  globus 
pallidus,  red  nucleus,  caudate  nucleus,  and  the  putamen  (Leskovjan  ect,  2009). 

Like  Cu  and  Ca,  Fe  has  been  shown  to  be  elevated  in  brains  of  patients  with  AD.  Elevated  Fe  is  found  in 
the  amyloid  plaques  (Belavaria  ect,  2005).  Fe  is  also  moderately  increased  in  the  parietal  cortex  in  AD  patients 
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(Srivastava  ect,  2002).  In  patients  with  Attention  Deficit  Hyperactivity  Disorder  (ADHD),  Fe  has  been  shown  to 
increase  in  the  substantia  nigra  (Berg  ect,  2001). 

Lead 

Lead  (Pb)  is  one  of  the  oldest  and  most  studied  environmental  toxins.  Lead  paints  in  old  houses  remain  a  common 
source  of  exposure.  Lead  though  is  also  found  in  building  materials,  glass,  batteries,  gasoline  additives,  and  many 
others  sources.  Too  much  lead  is  not  a  good  thing. 

Lead  is  known  to  be  very  toxic  to  the  brain.  Lead  poisoning  has  been  linked  to  memory  and  learning 
deficit.  Lead-exposure  is  found  in  the  cerebral  cortex,  cerebellum,  and  the  hippocampus.  Lead  can  also  cause  brain 
damage  in  children  even  at  low  exposure  levels.  (Florea  ect,  2006) 

Magnesium 

Magnesium  (Mg)  is  the  8*  most  abundant  element  in  the  earth’s  crust  and  in  found  also  in  seawater.  Mg  is 
commonly  used  in  structural  building  materials,  automotive  parts,  electronic  devices,  aerospace  construction, 
photography,  and  fireworks.  Mg  is  an  essential  metal  in  human  and  plant  life  (Yokel  ect,  2009).  Human  Mg 
deficiency  has  been  linked  to  the  development  of  asthma,  ADHD,  and  osteoporosis.  Foods  that  are  high  in  Mg 
include  spices,  nuts,  cereals,  coffee,  cocoa,  tea,  and  vegetables.  In  neurodegenerative  disorders  such  as  AD  and  PD, 
Mg  does  not  appear  to  play  a  major  role.  For  example.  Mg  levels  in  the  cerebellum  and  parietal  cortex  do  not  differ 
between  patients  with  AD  and  normal  humans  (Srivastava  ect,  2002). 

Manganese 

Manganese  (Mn)  is  found  in  the  earth’s  crust  and  in  seawater.  It  is  often  found  with  Fe.  Some  of  the  more  common 
usages  of  Mn  are  in  steel,  aluminum  alloys,  alkaline  batteries,  coins,  and  pigments.  Some  popular  foods  that  contain 
Mn  include  tea,  spinach,  grains,  rice,  eggs,  nuts,  olive  oil,  green  beans,  and  fish. 

The  majority  of  the  human  body’s  Mn  is  found  in  liver  and  kidneys;  nevertheless,  Mn  is  an  important 
element  for  normal  brain  development  and  function  (Yokel  ect,  2009).  In  the  aging  brain,  Mn  has  been  shown  to 
redistribute  itself  in  different  brain  regions,  including  hypothalamus,  thalamus,  and  corpus  callosum  (Bolognin  ect, 
2009).  High  brain  Mn  concentrations  are  related  to  PD.  There  has  been  much  research  indicating  that  human 
striatum,  globus  pallidus,  and  substantia  nigra  show  increases  in  Mn  levels  and  are  thought  to  be  target  sites  for  Mn 
neurotoxicity.  The  globus  pallidus  and  pituitary  glands  are  other  regions  where  Mn  preferentially  accumulates. 
High  exposures  to  Mn  result  in  increases  in  Mn  in  the  olfactory  epithelium  and  olfactory  bulb  (Dorman  ect,  2006). 
It  is  noteworthy  that  Mn  levels  in  the  cerebellum  are  similar  in  AD  and  normal  brains  while  Mn  increases  in  the 
parietal  cortex  of  AD  brains  (Srivastava  ect,  2002). 

Mercury 

Mercury  (Hg)  is  found  in  deposits  throughout  the  world,  mostly  as  cinnabar  (a  common  ore  of  Hg).  The  more 
common  uses  of  Hg  are  in  barometers,  thermometers,  dental  products  (e.g.,  fillings),  and  electrical  equipment  (e.g., 
computers,  telephones,  etc.)  (Florea  ect,  2006).  Exposures  to  Hg  most  commonly  occur  from  the  consumption  of 
marine  species  (Cannino  ect,  2008).  Other  exposures  to  Hg  may  be  from  exhaust  of  coal -burning  power  plants, 
cement  production,  batteries,  and  gold  production.  The  role  of  Hg  in  neurological  diseases  such  as  AD  and  PD  has 
been  controversial.  Mercury  can  cross  the  blood-brain  and  blood-placental  barriers.  It  is  then  retained  by  the  brain 
for  years  (Rooney  ect,  2007).  Mercury  tends  to  accumulate  in  lipid-rich  regions  of  the  brain.  Human  exposure  to 
Hg  usually  results  in  kidney  and  neurological  disorders  (Florea  ect,  2006). 

Platinum 

Platinum  (PI)  is  mostly  found  in  today’s  environment  in  catalytic  converters  of  cars,  jewelry,  laboratory  equipment, 
and  electrical  contacts.  Once  platinum  is  soluble  it  can  contaminate  the  water,  soil,  sediments,  and  animals,  which 
in  turn  contaminate  food.  (Florea  ect,  2006) 

The  role  of  platinum  was  not  found  in  neurologic  disorders.  One  thing  to  note  about  platinum  is  that 
platinum  drugs  cisplatin,  carboplatin  and  oxaliplatin  are  the  most  useful  anticancer  agents  available.  (Florea  ect, 
2006)  The  side  effects  of  these  drugs  have  not  been  related  to  neurological  disorders. 

Nickel 
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The  large  majority  of  nickel  comes  from  nickel  mines;  the  rest  come  from  byproducts  from  other  mining  activities. 
Because  nickel  is  corrosion-resistant  it  is  commonly  used  in  the  manufacture  of  coins,  magnets,  batteries,  and 
household  utensils. 

Exposure  to  nickel  as  a  gas  (Ni(CO)4)  is  highly  toxic  to  humans.  Other  nickel  exposure  to  humans  occurs 
in  miners,  pierced  ears,  and  the  items  themselves  that  are  made  of  nickel.  Once  nickel  is  exposed  to  the  human  brain 
it  becomes  well  retained  in  the  tissues  even  after  long  periods  of  time.  (Zhang  ect,  2009)  Not  much  has  been  done  to 
study  the  effects  of  this.  (Florea  ect,  2006) 

Potassium  &  Rubidium 

Potassium  (K)  occurs  in  nature  as  an  ionic  salt  and  is  essential  for  humans  and  other  animals.  It  is  found  dissolved 
in  seawater  and  in  other  minerals.  Some  common  food  sources  of  K  include  orange  juice,  potatoes,  bananas, 
avocados,  tomatoes,  broccoli,  apricots,  and  many  other  fruits. 

Rubidium  (Rb)  is  not  essential  for  humans,  but  is  readily  taken  up  by  the  body.  It  is  found  commonly 
mixed  in  with  other  elements,  especially  K.  Rb  is  found  in  some  plants  as  well.  Some  common  uses  of  Rb  are  in 
fireworks,  lasers,  chemical  applications,  and  electronic  transmission.  Rb  is  found  in  some  brain  tumors. 

Exposure  to  K  and  Rb  is  not  known  to  cause  neurodegenerative  disorders.  Eor  example,  the  concentrations 
of  K  and  Rb  are  similar  between  AD  and  control  brains  (Hung,  2010;  Leskovjan,  2009). 

Sodium 

Sodium  (Na)  is  considered  an  essential  element  for  human  life.  It  is  found  in  nature  as  a  compound  and  never  alone, 
just  Na.  The  most  common  way  it  is  found  is  in  salt  deposits.  The  most  common  form  of  sodium  that  we  know  and 
use  is  sodium  chloride,  table  salt.  It  does  have  other  uses  as  well.  Over  or  under  exposure  to  sodium  has  not  yet 
been  shown  to  cause  neurological  disorders.  It  has  been  noted  that  sodium  has  been  shown  to  increase  in  every  part 
of  the  brain  in  AD  patients. 

Silicon 

Silicon  is  the  second  most  abundant  element  found  in  the  Earth’s  crust,  right  after  oxygen.  It  is  found  in  the  form  of 
quartz  (silicon  dioxide).  The  most  common  place  is  in  gold  mines  and  volcanic  exhalations.  Silicon  is  used 
primarily  in  semiconductor  devices  (microchips),  glasses,  ceramics,  cements,  and  as  a  sealing  agent. 

Exposure  to  silicon  has  not  yet  shown  to  cause  neurological  disorders.  It  has  been  noted  that  silicon  has 
shown  higher  concentration  in  the  parietal  cortex  of  AD  brains.  (Srivastava  ect,  2002) 

Tellurium 

Tellurium  is  one  of  the  rarest  elements  found  in  the  Earth  crust.  It  is  most  often  found  in  gold  mining.  Tellurium  is 
used  in  alloys  (steel  and  copper)  to  improve  machinability,  solar  panels,  and  in  semiconductors. 

Exposure  to  tellurium  has  not  yet  shown  to  cause  neurological  disorders.  It  has  been  noted  that  tellurium 
has  been  shown  to  have  increases  in  the  parietal  cortex  of  the  brain  in  AD  patients  when  compared  to  normal  brains. 
(Srivastava  ect,  2002) 

Tin 

Tin  (Sn)  is  not  found  naturally  by  itself  in  nature.  It  is  extracted  from  a  compound,  cassiterite.  This  is  usually  found 
with  granite  rocks.  One  of  the  most  common  ways  to  mine  tin  is  by  dredging.  Tin  is  commonly  used  as  a  coating 
for  iron  to  prevent  corrosion  and  solder.  Because  tin  is  not  highly  toxic  it  is  coated  over  iron  to  create  tin  cans, 
which  are  used  to  store  food.  Tin  foil  is  also  used  in  the  household  as  well  to  wrap  food. 

Exposure  to  tin  has  not  yet  shown  to  cause  neurological  disorders.  It  has  been  noted  that  tin  has  been  shown 
to  have  increases  in  the  parietal  cortex  of  the  brain  in  AD  patients  when  compared  to  normal  brains.  (Srivastava  ect, 
2002) 

Zinc 

Zinc  (Zn)  is  naturally  found  in  the  earth’s  crust  and  in  seawater.  It  is  normally  found  with  Fe  and  Cu  deposits.  Zn  is 
commonly  used  in  batteries,  production  of  brass,  bronze,  rubber,  in  pigments,  fire  retardant,  nuclear  weapons, 
automobile  engines,  and  agricultural  fungicides.  The  most  common  food  source  of  Zn  is  red  meats. 

Zn  is  another  essential  element  in  mammals.  Zn  is  distributed  in  similar  ways  in  the  central  and  subcortical 
white  matter  of  both  young  and  old  brains;  the  interior  of  the  dentate  nucleus  and  the  cerebellar  cortex  contain  high 
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levels  of  Zn  (Zhang  ect,  2009).  The  regions  of  the  normal  brain  rich  in  Zn  include  the  hippocampus,  amygdala,  and 
the  cortex.  As  the  brain  ages,  its  Zn  distribution  changes,  just  in  the  regions  mentioned  above.  Nevertheless,  little 
or  no  decrease  in  brain  Zn  has  been  reported  in  aging  humans  or  rats  (Bolognin  ect,  2009).  Zn  is  found  to  be 
elevated  in  human  amyloid  plaques  while  PSAPP  mice  (an  AD  mouse  model  that  does  not  show  neurodegeneration) 
only  had  a  29%  increase  of  Zn  in  their  plaques  compared  to  the  Zn  in  brain  tissue  surrounding  the  plaques 
(Belavaria  ect,  2005).  The  potential  role  of  Zn  as  a  cofactor  in  the  pathogenesis  of  AD  was  strengthened  when  Zn 
enrichment  was  found  in  senile  plaques  and  a  Zn  elevation  in  the  neuropil  of  AD  patients  as  compared  to  those  in 
control  individuals  (Bolognin  ect,  2009). 

What  Was  Done 

In  the  past,  research  has  been  done  on  the  effects  of  the  different  elements  on  the  brain  and  the  neurological 
disorders  that  they  may  cause.  None  though,  have  looked  into  as  many  metals  that  will  be  presented  here  at  one 
time.  Also,  manganese  has  not  yet  been  deployed  at  different  stages  in  a  developing  rat  brain. 

In  this  study,  we  investigated  30  elements  (including  electrolytes)  and  how  dietary  intake  on  a  life-time 
basis  would  affect  their  concentration  and  distribution  in  various  regions  of  the  rat  brain  (hypothalamus,  cerebellum, 
pons  and  medulla,  striatum,  mid-brain,  cerebral  cortex,  and  hippocampus)  and  discussed  their  health  implications. 
The  30  elements  of  interest  were:  Al,  As,  Ba,  Br,  Ca,  Cd,  Cl,  Co,  Cr,  Cu,  F,  Fe,  Hg,  I,  K,  La,  Mg,  Mn,  Mo,  Na,  Rb, 
S,  Sb,  Sc,  Se,  Si,  Sm,  Sr,  V,  and  Zn.  In  the  past,  research  has  primarily  focused  on  the  effects  of  different  elements 
on  the  brain  and  the  neurological  disorders  they  may  cause.  None  of  those  studies,  however,  have  examined 
simultaneously  as  many  elements  in  a  single  study  as  we  have  presented  here.  The  objective  of  this  paper  is  to 
characterize  the  levels  of  major  and  selected  trace  elements  in  various  regions  of  the  rat  brain  during  several  critical 
stages  of  development.  Because  during  the  first  8-9  days  of  age  postnatal,  the  rat  hippocampus  is  extremely  difficult 
to  visually  distinguish  from  the  overlying  cerebral  cortex,  we  had  included  the  hippocampus  tissue  together  with  the 
cerebral  cortex  for  analysis  in  the  case  of  5-day-old  tissue  samples.  The  four  postnatal  age  groups  of  rats  we  have 
studied  include  the  following: 

I.  5  days  old; 

II.  10  days  old; 

III.  22/23  days  old;  and 

IV.  120  days  old  (i.e.,  adult). 

When  manganese  was  administered,  the  following  levels  were  added  to  the  drinking  water  (This  will  be  the 
same  nomenclature  used  on  the  Figures): 

Control:  120  days  old  adult  female  Wistar  rat  (Porton  Strain) 

A  group:  Life-long  manganese  treatment  with  1  mg/ml  Mn^"^  in  drinking  water 
B  group:  Life-long  manganese  treatment  with  10  mg/ml  Mn^"^  in  drinking  water 
C  group:  Life-long  manganese  treatment  with  20  mg/ml  Mn^"^  in  drinking  water 

As  our  well  being  is  largely  impacted  by  the  environment  we  are  living  in,  dietary  intake  is  definitely  a 
major  factor  that  posts  a  long-term  effect  on  our  health.  This  paper  provides  some  insight  into  how  our  diet  and 
pollutants  in  our  diet  may  affect  our  neurological  health.  Consequently,  our  experimental  results  may  allow  us  to 
take  some  preventative  measures  in  determining  how  best  to  optimize  and  gauge  our  dietary  intake  of  major  and 
trace  elements  for  the  betterment  of  our  health. 

Humans  vs.  Rats 

While  humans  and  rats  are  not  identical  neurologically  and  physiologically,  there  are  more  similarities  between  the 
two  species  as  far  as  brain  structure  and  functions  are  concerned.  The  four  stages  of  the  postnatal  development  of 
the  rat  chosen  in  this  study  closely  parallel  the  postnatal  development  of  humans. 

2.  Experimental  Methods 

Wistar  rats  of  the  Portion  strain  (Animal  Breeding  Unit,  Carshalton,  and  Surrey,  U.K.)  bred  in  the  Institute  of 
Neurology,  University  of  London,  United  Kingdom  were  used.  All  animals  were  kept  on  a  12-hour  light/1 2-hour 
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dark  cycle  with  free  access  to  food  and  water.  Elemental  concentrations  in  the  rat  food  pellets  had  been  determined 
(Table  1  below). 

Table  1  Elemental  Concentration  of  Rat  Food  Pellet 


Element 

Concentration  (in  mg/g) 

Ca 

6.39  +  1.68 

Cl 

2.31+0.49 

Fe 

0.25  +  0.05 

K 

5.36  +  0.95 

Mg 

1.17  +  0.32 

Na 

1.48  +  0.32 

Concentration  (in  pg/g) 

Al 

98.06  +  8.05 

Br 

10.57  +  2.26 

Co 

0.20  +  0.04 

Cr 

1.50  +  0.44 

Cu 

7.21+2.12 

F 

ND(5.00) 

Hg 

ND  (0.25) 

I 

ND  (0.50) 

Mn 

49.34  +  8.65 

Mo 

2.80  +  0.45 

Se 

ND  (0.25) 

Rb 

12.73+2.61 

V 

ND  (0.50) 

Zn 

47.73  +4.11 

Thirty  trace  and  major  elements  in  different  brain  regions  of  rats  at  the  four  different  age  groups  (i.e.,  I  through  IV 
as  defined  above)  were  analyzed  by  instrumental  neutron  activation  analysis  (INAA)  (Chan  ect,  1983).  The  samples 
were  irradiated  by  thermal  neutrons  using  three  different  sets  of  conditions  depending  on  the  nuclear  characteristics 
of  the  elements  of  interest  (Chan  ect,  1983).  Not  all  30  elements  were  reported  in  the  results  because  those  not 
reported  herein  were  either  below  the  detection  limits  of  our  INAA  technique  (Chan  ect,  1983)  or  the  elements  were 
not  retained  by  the  brain  tissue.  All  values  listed  are  mean  ±  S.D.;  ND  =  not  detectable,  and  values  in  brackets  are 
the  maximum  elemental  concentrations  present  in  the  diet. 

As  already  noted  above,  in  age  group  I,  the  hippocampus  tissue  had  been  included  in  the  cerebral  cortex 
and  analyzed  as  such. 

All  the  standard  materials  and  samples  for  INAA  were  freeze-dried  and  pelleted.  Dried  samples  (rat  brain 
regions)  were  homogenized  using  a  Glen  Creston  polystyrene  ball-mill  and  pelleted.  Other  details  of  standard  and 
sample  preparations  were  as  described  previously  (Chan,  1981;  Lee,  2010). 

Standards  and  samples  were  irradiated  in  a  100  KW  ‘Consort’  Reactor  Mark  II  at  the  Imperial  College 
Reactor  Centre.  Irradiated  standards  and  samples  were  then  analyzed  for  their  elemental  contents  by  gamma  ray 
spectrometry  using  various  Ge(Li)  detectors  and  ND6600  Multichannel  Analyzer  (Nuclear  Data  Inc.,  Schaumburg, 
Illinois,  USA).  Details  of  the  elemental  determinations  were  described  in  the  methodology  paper  by  Chan  et  al. 
(1983). 
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All  laboratory  chemicals  used  were  of  analytical  grade  (BDH  Chemicals  Limited,  U.K.)  and  single  element 
standards  of  trace  elements  were  obtained  from  AAS  (Ventron  Division,  Limited,  U.K.);  other  elemental  standards 
for  F,  Cl,  Br,  and  P  were  obtained  from  Hopkin  and  Williams  Chemical  Ltd.,  U.K.  Water  for  solution  preparations 
and  feeding  was  double-distilled. 

3.  Manganese 

For  some  experiments,  manganese  was  added  to  the  rat’s  water.  The  purpose  was  to  study  the  effects  the  manganese 
had  on  the  other  elements  that  were  in  the  brain.  The  results  of  this  will  be  shown  later.  A  brief  description  of 
manganese  was  given  above,  but  do  to  the  extent  of  discussion  with  manganese  a  more  detailed  description  is 
needed. 


Manganese  was  first  discovered  by  Johan  G.  Gahn  in  1774  by  reduction  of  the  dioxide  with  carbon.  The 
name,  manganese,  comes  from  the  Latin  word  ‘magnes,’  which  means  magnet.  Manganese  is  a  gray-white,  brittle, 
hard,  metal.  Pure  manganese  exists  in  four  allotropic  forms.  The  metal  makes  up  approximately  0.1%  of  the  Earth’s 
crust.  This  makes  it  the  12*  most  abundant  element  found  in  the  Earth’s  crust.  The  metal  is  used  extensively  to 
produce  a  variety  alloys,  such  as  steel.  In  fact  without  manganese  steel  would  be  said  not  to  exist.  It  is  also  used  in 
pigments,  cell  batteries,  and  can  be  added  as  an  additive  in  gasoline  to  increase  the  octane  rating.  (Manganese  ect, 
2008) 


Manganese  is  also  known  to  be  an  important  element  in  our  daily  diet.  The  metal  helps  the  body  convert 
protein  and  fat  to  energy.  Some  other  benefits  of  manganese  is  a  reduction  in  fatigue  levels,  help  improve  memory, 
prevent  the  incidence  and  severity  of  osteoporosis,  promote  normal  bone  growth,  and  helps  to  maintain  healthy 
nervous,  immune,  and  reproductive  systems.  (Manganese,  2005)  In  our  diet  we  can  find  manganese  in  plants  and 
animals.  These  foods  include  avocados,  nuts,  seaweed,  tea,  raisins,  spinach,  pineapple,  blueberries,  beans,  whole 
grains,  and  other  green  leafy  vegetables. 

In  the  body  the  largest  manganese  quantities  are  found  in  bones,  liver,  kidney,  and  pancreases.  One 
interesting  thing  to  note  about  manganese  in  the  body  is  that  decreasing  levels  of  manganese  are  tied  with  increasing 
levels  of  iron.  This  leads  to  believe  that  manganese  absorption  is  tied  to  iron  absorption.  Currently  there  is  no 
recommended  dietary  allowance  or  manganese,  but  it  has  been  shown  that  2.5  -  5.0  milligrams  is  safe  for  humans 
1 1  years  old  and  older.  However,  not  enough  manganese  can  lead  to  manganese  deficiencies.  These  deficiencies 
can  include  seizures,  convulsions,  eye  problems,  heart  disorders,  high  cholesterol,  memory  loss,  osteoporosis, 
contractions,  hypertension,  and  atherosclerosis.  (Manganese,  2005)  Too  much  manganese  is  rare  due  to  the  fact  that 
manganese  is  one  of  the  least  toxic  trace  minerals  in  the  body.  However,  exposure  to  high  manganese  levels  has 
been  recorded  and  linked  to  impaired  motor  skills  and  cognitive  disorders.  A  fatal  dose  is  said  to  be  10  grams. 
When  Manganese  is  abnormally  concentrated  in  the  brain,  especially  in  the  basal  ganglia  (composed  of  the 
striatum),  neurological  disorders  could  result  due  to  high  concentrations.  (Amano  ect,  2004) 

4.  Results 

Figure  i  shows  the  average  mass  of  the  rat  brain  tissues  at  different  aging  stages  with  no  influence  of  treatment.  It 
can  be  seen  that  as  the  rat  ages  the  weight  of  its  brain  increases.  A  similar  process  for  the  human  brain  happens  as 
well.  A  newborn  human  brain  weighs  350-400  grams  (350  -  400  x  10^  mg),  while  the  average  adult  human  brain  is 
about  1,300-1,400  grams  (1.3  -  1.4  x  10^  mg).  This  is  approximately  two  percent  of  the  human’s  overall  mass.  An 
average  rat  brain  weighs  approximately  0.4  grams.  However,  even  though  the  human  brain  weighs  more  than  the  rat 
brain,  the  brain  to  body  weight  ratio  is  the  same,  1/40  (Grobstein  ect,  2001).  The  increase  in  mass  in  both  the  human 
and  rat  brain  is  likely  due  to  the  accumulation  of  different  elements  in  the  brain.  This  is  normal  because  we  do 
accumulate  different  elements  from  our  food,  water,  and  environment  throughout  our  daily  lives. 
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Figure  1  Average  Mass  of  Control  Rat  Brain  Tissues  at  Different  Aging  Stages 

Figure  2  shows  the  average  water  content  of  the  brain  tissues  at  different  aging  stages  with  no  influence  of 
treatment.  Here  it  can  be  seen  that  the  brain  loses  water  as  it  ages.  This  shows  that  the  extra  mass  that  the  brain 
gains  as  it  ages  is  due  to  the  elements  (solid  objects),  not  water  accumulation.  The  average  human  brain  is  actually 
approximately  85%  water.  According  to  research,  as  humans  age  their  percentage  of  water  content  decreases.  A 
newborn  may  have  as  much  as  75%  of  its  weight  composed  of  water.  But,  this  progressively  decreases  as  that  new 
bom  ages.  Most  of  this  decrease  does  occur  during  the  first  10  years.  Also,  one  interesting  thing  to  note  is  that 
obese  humans  have  less  water  than  thin  people  do.  This  is  due  to  the  fact  that  fat  has  less  water  in  it  than  muscle 
does  (Grobstein  ect,  2001).  Therefore,  Figure  2  makes  sense  for  a  human  as  well  as  for  a  rat. 
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Figure  2  Average  Water  Content  (%)  of  Control  Rat  Tissues  at  Different  Aging  Stages 

Later  in  the  paper  it  will  be  seen  that  the  elements  are  measured  by  wet  weight.  It  should  be  noted  that  the  cerebral 
cortex  and  the  hippocampus  were  measured  separately  in  both  Fig  UP©  1  and  Figure  2.  It  will  be  noted  in  the 
paper  if  the  cerebral  cortex  and  hippocampus  were  measured  together  or  apart.  In  the  early  stages  of  development  it 
was  difficult  to  separate  the  sections  of  the  brain  and  get  reasonable  results. 

Various  Levels  of  Manganese 

Tables  2  and  3  show  the  elemental  concentration  in  the  rats  after  120  days  when  administrated  different  levels  of 
manganese  in  their  drinking  water.  Table  2  is  in  mg/g  while  Table  3  is  in  pg/g.  Both  figures  display  the  same 
information,  just  with  different  elements.  The  following  is  a  description  for  each  of  the  sections  of  the  brain  and 
their  relationship  to  Tables  2  and  3. 

Cerebellum 

The  cerebellum  is  the  cauliflower-shaped  section  of  the  brain  located  in  the  lower  part  of  the  brain  next  to  the  brain 
stem.  The  cerebellum  controls  movement,  balance,  posture,  and  coordination.  It  is  also  thought  to  control  emotions 
as  well. 


It  can  be  seen  that,  on  average,  element  concentrations  fluctuate  as  when  administered  different  doses  of 
the  manganese.  This  can  be  seen  in  elements  such  as  copper,  potassium,  and  zinc.  As  discussed  above,  for  some 
elements  this  could  be  good  while  others  not  so  good.  For  example,  sodium  levels  were  found  to  be  higher  in 
patients  with  AD  and  in  our  figures  below  the  sodium  levels  actually  increased  for  all  doses  of  manganese 
administered.  We  do  not  know  the  levels  that  could  cause  AD,  however  an  increase  may  not  be  good.  Sodium 
though  has  not  been  found  in  research  to  be  the  leading  cause  of  AD;  however  sodium  may  have  some  relevance  in 
the  causation  and/or  progression  of  AD. 


Cerebral  Cortex 

The  cerebral  cortex  is  located  on  the  outer  surface  of  the  brain.  The  cerebral  cortex  is  responsible  for  all  intellectual 
functioning  such  as  thinking,  voluntary  movements,  language,  reasoning,  and  perception. 
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It  can  be  seen  that  on  average  manganese  helps  lower  the  elemental  concentrations  in  the  cerebral  cortex, 
especially  at  the  higher  levels  of  manganese.  This  is  especially  seen  in  Fluorine.  Fluorine  was  not  discussed  above 
because  it  is  not  one  of  the  more  studied  elements  in  the  cerebral  cortex,  so  there  is  a  lack  of  information  on  it.  A 
couple  things  to  note  about  fluorine  overdose  and  its  effects  on  the  brain  are  that  it  causes  a  reduction  in  lipid 
content  and  nicotinic  acetrlcholine  receptors,  increased  uptake  of  aluminum,  and  the  formation  of  beta-amyloid 
plaques.  These  beta-amyloid  plaques  are  a  classic  brain  abnormality  in  AD.  (Connett,  2011)  From  this  we  want  a 
lower  fluorine  level  in  the  brain  and  this  can  be  achieved  from  groups  A  and  B. 

Another  element  known  to  play  a  part  in  the  formation  of  AD  is  calcium.  In  Table  2  the  levels  of  calcium 
vary.  The  low  and  high  levels  of  manganese  decrease  the  calcium  in  the  cerebral  cortex.  As  stated  above  one  of  the 
pathological  hallmarks  of  Alzheimer’s  disease  (AD)  is  the  accumulation  of  amyloid  plaques  between  nerve  cells 
(i.e.,  neurons)  in  different  parts  of  the  human  brain  including  the  cerebral  cortex.  Ca  levels  in  human  amyloid 
plaques  in  AD  are  elevated.  Maybe  lower  levels  of  calcium  could  affect  the  amyloid  plaques  makeup,  thus  changing 
the  effect  of  AD. 

Hippocampus 

The  hippocampus  is  located  deep  within  the  temporal  lobe  in  front  of  the  limbic  system.  The  hippocampus  is 
responsible  for  storing  memories  and  is  involved  with  learning  as  well.  It  can  be  seen  that  on  average  manganese 
helps  lower  the  elemental  concentrations  in  the  hippocampus.  This  is  most  noticeable  at  the  higher  levels  of 
manganese. 

One  element  that  it  does  not  decrease  is  Fluorine,  the  levels  increase.  This  is  not  a  good  thing  because  high 
levels  of  fluorine  have  been  known  to  cause  damage  to  the  hippocampus  (Connett,  2011).  Another  element  that 
does  not  decrease  is  copper.  Copper  increases  with  every  dose  of  manganese  administered.  Copper  is  essential  to  a 
healthy  brain,  however  some  research  has  indicated  that  excess  copper  in  the  brain  can  lead  to  Huntington’s  disease. 
Increased  levels  of  iron  are  also  said  to  play  a  part  in  Huntington’s  disease  as  well  (Miller,  2007).  In  Table  2,  the 
lower  levels  of  manganese  increase  the  iron  while  the  higher  levels  decrease  the  iron  levels. 

Hypothalamus 

The  hypothalamus  is  located  in  the  internal  portion  of  the  brain  under  the  thalamus.  It  is  part  of  the  limbic  system. 
The  hypothalamus  controls  body  temperature,  emotions,  thirst,  hunger,  appetite,  digestion  and  sleep.  From  research 
it  appears  that  the  hypothalamus  is  one  of  the  least  studied  areas  of  the  brain.  Here  it  shows  that  about  half  the 
elements  increase  while  the  rest  decrease  in  Table  2  and  3. 

One  interesting  element  is  aluminum.  At  group  A  (1  mg/ml  of  manganese)  the  level  of  aluminum  spikes 
while  at  the  other  doses,  aluminum  decreases.  In  AD  aluminum  levels  have  been  shown  to  increase,  though  not 
necessarily  in  the  hypothalamus.  This  is  shown  in  the  cerebral  cortex  and  hippocampus  as  stated  under  their 
sections.  Other  interesting  ones  are  copper  and  zinc.  At  the  same  doses  they  do  the  same  thing.  For  example  at  A 
and  B  they  increase  while  at  C  they  decrease.  This  could  possible  show  that  there  is  a  copper-zinc  balance  in  the 
hypothalamus  like  there  is  in  the  cerebellum.  Without  more  research  one  can  only  speculate. 

Midbrain 

The  midbrain  is  located  in  the  middle  of  the  brain  in  front  of  the  frontal  lobes  above  the  pons.  The  mid -brain  is 
responsible  for  breathing,  and  reflexes.  On  average  it  appears  that  a  majority  of  the  elements  appear  to  increase  with 
the  dosage  of  manganese.  There  is  not  a  particular  dosage  of  manganese  that  appears  to  increase  or  decrease  the 
elements  for  one  another. 

Some  of  the  more  interesting  elements  are  copper  and  manganese.  The  copper  concentration  increased 
with  every  dosage  of  manganese  that  was  administered.  According  to  research,  high  accumulations  of  copper  have 
been  found  in  patients  with  Alzheimer’s  and  Wilsons.  Whether  or  not  this  is  true,  the  cause  is  yet  to  be  determined. 
However  an  increased  copper  content  in  any  section  of  the  brain  may  not  be  a  good  thing. 

The  manganese  concentration  also  increased  with  every  dosage  of  manganese  that  was  administered.  An 
increase  of  manganese  in  the  mid-brain  is  believed  to  be  a  primary  target  site  for  manganese  neurotoxicity.  It  has 
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also  been  shown  that  high  levels  of  Mn  have  been  found  in  AD  brains.  In  Table  3,  it  is  shown  that  levels  of 
manganese  drop  off  as  the  brain  ages.  If  there  is  more  manganese  in  the  brain  to  start  with,  the  levels  may  not 
necessarily  drop  off.  More  research  here  would  be  needed.  However,  these  high  levels  of  manganese  are  unwanted 
in  the  mid-brain. 

Pons  &  Medulla 

The  pons  is  located  between  the  medulla  and  the  midbrain.  The  medulla  is  located  between  the  pons  and  spinal 
cord.  The  pons  is  responsible  for  motor  control  and  sensory  analysis  while  the  medulla  is  responsible  for 
maintaining  vital  body  functions  such  as  the  heart-rate  and  breathing.  Here  each  element  appears  to  be  their  own. 
Some  increase  with  the  manganese  at  different  levels  while  others  decrease.  The  different  levels  of  manganese  also 
cause  different  concentrations  as  well.  Some  of  the  more  interesting  ones  are  copper  and  iron. 

As  more  manganese  is  added  the  higher  the  copper  concentrations  go.  This  is  not  necessarily  a  good  thing 
because,  as  stated  above,  high  accumulation  of  copper  in  the  brain  has  been  found  in  patients  with  Wilson’s  disease. 
The  last  thing  we  want  to  do  is  add  more  of  an  element  that  could  be  a  factor  in  a  neurological  disorder.  We  are  not 
saying  that  copper  is  the  cause  of  Wilson’s  disease. 

With  iron,  the  manganese  does  not  seem  to  affect  the  iron  concentrations  except  at  group  B  (10  mg/ml  of 
Mn).  As  mentioned  in  other  sections  of  the  brain,  rich  iron  content  has  been  found  in  patients  with  Parkinson’s 
disease.  However  if  the  body  does  not  have  enough  iron  it  cannot  produce  enough  red  blood  cells  and  the  brain  will 
not  get  the  oxygen  that  it  needs  to  survive.  Low  iron  levels  in  the  brain  in  young  people  have  even  been  said  to 
possibly  cause  neurological  disorders,  such  as  poor  memory. 

Striatum 

The  striatum  is  located  in  the  forebrain.  It  is  in  the  sub -cortical  section  of  the  forebrain.  The  striatum  includes  the 
substantia  nigra  and  the  globus  gallidus.  The  striatum  is  responsible  for  modulation  and  planning  of  movement 
pathways  (communication  of  brain  parts)  and  other  cognitive  processes.  It  appears  that  on  average  the  elemental 
concentrations  decrease  with  the  manganese  dosages.  There  are  some  exceptions  though.  Some  of  these  exceptions 
are  manganese  and  selenium. 

The  manganese  levels  increase  with  over  dosage.  This  would  make  sense,  due  to  the  fact  that  we  are  giving 
the  rats  more  manganese.  This  extra  manganese  is  not  necessarily  a  good  thing  because,  as  discussed  above,  chronic 
manganese  toxicity  in  humans  induces  signs  and  symptoms  that  closely  resemble  those  noted  in  PD.  There  is  also  a 
great  deal  of  evidence  that  human  striatum  show  preferential  increases  in  Mn  and  is  believed  to  be  one  of  the 
primary  sites  associated  with  Mn  neurotoxicity  (Dorman  ect,  2006). 

Selenium  is  one  of  the  least  studied  elements  in  the  brain.  In  Table  3,  it  can  be  seen  that  every  level  of 
manganese  caused  the  concentration  of  selenium  to  increase.  In  the  other  sections  of  the  brain  it  was  mentioned  that 
high  or  low  levels  of  selenium  have  been  known  to  cause  any  problems,  mainly  neurological  problems.  Selenium 
toxicity  is  not  well  known.  You  do  not  achieve  this  from  just  eating  or  drinking,  but  by  some  type  of  supplement. 
Selenium  is  necessary  for  boosting  the  immune  system  to  help  prevent  disease.  Some  have  even  argued  that 
selenium  can  help  to  prevent  some  types  of  cancer  and  Parkinson’s  disease.  This  is  a  conservational  issue  though 
(Selenium,  2011). 
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Table  2  Different  Levels  of  Manganese  Compared  to  the  Control 


Table  3  Different  Levels  of  Manganese  Compared  to  the  Control 


Elements 

Region 

Al 

Br 

Co 

Cr 

Cu 

F 

Hg 

A  1  B 

C 

A 

B 

C 

A  1  B  1  C 

A  1  B  1  C 

A  1  B  1  C 

A 

B 

C 

> 

CD 

O 

Key: 

Above  Control  Under  Control 
0  to  25%  red  0  to  -25%  yellow 
25  to  50%  purple  -25%  to  -50%  green 
>  50%  brown  <  50%  blue 
No  data  white 
Same  Black 


Developmental  Stages 

Tables  4  and  5  show  the  elemental  concentration  distribution  for  the  various  brain  regions  at  different  developmental 
stages  when  compared  to  the  control.  Table  4  is  in  mg/g  while  Table  5  is  in  pg/g.  Both  figures  display  the  same 
information,  just  with  different  elements.  The  following  is  a  description  for  each  of  the  sections  of  the  brain  and 
their  relationship  to  Tables  4  and  5. 

Cerebellum 

It  can  be  seen  from  Tables  4  and  5,  that  on  average,  the  concentration  of  the  different  elements  decreases  as  time 
goes  on.  There  was  no  influence  of  treatment  in  Tables  4  and  5.  Some  of  the  more  studied  elements  in  the 
cerebellum  are  the  following: 
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Copper  appears  to  be  evenly  distributed  in  both  younger  and  older  brains  in  both  the  central  and  subcortical 
white  matter  of  the  cerebellum.  The  presence  of  copper  in  the  white  matter  of  the  cerebellum  is  not  unexpected 
because  copper,  iron,  and  zinc  are  essential  for  myelin  synthesis,  structure,  and  maintenance  with  oligodendrocytes 
being  the  main  iron  repository  cells  in  the  brain.  Out  of  all  the  metals,  copper  is  entirely  protein  bound.  There  is 
little  or  no  free  copper  present  in  cells  and  only  trace  amounts  of  the  copper  leach  from  formalin-fixed  tissues 
(Zhang  ect,  2009).  In  Tables  4  and  5,  it  can  be  seen  that  the  copper  concentrations  drop  off  dramatically  after  5  days 
and  then  fluctuates  slightly  for  the  rest  of  the  developments  stages. 

Magnesium  levels  in  the  parietal  cortex  in  AD  patients  do  not  differ  from  those  in  normal  controls 
(Srivastava  ect,  2002).  The  Magnesium  levels  in  Table  4  drop  off  slightly  after  5  days  old  and  then  remain  constant 
for  the  rest  of  the  development  stages.  Similarly,  rubidium  levels  in  AD  brains  do  not  differ  from  those  in  control 
brains  (Cannino  ect,  2008).  Rubidium  also  has  the  same  pattern  in  the  rats  as  did  magnesium.  Consequently,  the 
age-related  changes  in  magnesium  and  rubidium  levels  in  the  cerebellum  may  not  be  good  predictive  values  of 
neurological  diseases  in  later  life.  On  the  other  hand,  the  sodium  levels  in  the  rat  cerebellum  decrease  during  the 
latter  half  of  postnatal  development  as  they  approach  the  adult  level.  On  the  other  hand,  sodium  levels  in  every 
regions  of  the  human  brain  are  significantly  higher  in  the  AD  patients  than  those  in  control  subjects  (Cannino  ect, 

2008) .  These  results  taken  together  suggest  that  dietary  intake  of  sodium  may  have  some  relevance  in  the  causation 
and/or  progression  of  AD.  Interestingly  though  the  levels  of  sodium  appear  only  to  slightly  decrease  throughout  the 
developmental  stages  in  Table  4. 

Zinc  has  also  been  shown  to  be  rich  in  the  cerebellar  gray  and  white  matter.  The  subcortical  white  matter 
of  the  cerebellum  has  been  shown  to  be  the  highest.  This  area  of  the  brain  though  has  a  delicate  zinc/copper 
balance.  This  balance  must  be  maintained  because  zinc  toxicity  has  been  linked  to  multiple  sclerosis  and  cerebellar 
demyelinating  lesions.  (Zhang  ect,  2009)  Zinc  can  be  seen  to  fluctuate  throughout  the  developmental  stages  in  Table 
5.  Interestingly  though  the  copper  and  zinc  concentrations  are  not  the  same.  This  questions  whether  there  is  a 
zinc/copper  balance.  There  is  always  either  more  copper  or  more  zinc.  The  two  are  never  equal. 

Some  elements  are  studied  together  due  to  the  fact  that  they  are  normally  found  together.  In  the  cerebellum 
these  elements  include  the  following:  Iron  and  zinc  have  similar  levels  in  both  younger  and  older  brains  but  have 
higher  levels  in  the  subcortical  white  matter  then  in  the  central  white  matter.  Chromium,  copper,  iron,  nickel,  and 
zinc  have  been  found  to  be  retained  in  fixed  tissues,  such  as  the  cerebellum,  even  after  long  periods  of  storage. 
(Iron,  chromium,  and  copper  all  remain  low  and  relatively  constant  throughout  the  developmental  stages.)  However, 
other  elements  such  as  arsenic,  cadmium,  magnesium,  rubidium,  and  sodium  have  been  shown  to  leach  out  of  fixed 
tissues  over  time  (Zhang  ect,  2009).  It  has  not  shown  if  this  effects  other  element  concentrations  in  the  brain.  (As 
shown  in  Table  5,  Rubidium  decreases  up  until  22/23  days  and  then  begins  to  increase  again.) 

Cerebral  Cortex 

It  can  be  seen  from  Tables  4  and  5,  that  on  average,  about  half  of  the  concentrations  of  the  different  elements 
increase  while  the  other  half  decrease  as  time  goes  on.  Several  elements  in  the  human  cerebral  cortex  have  received 
more  attention  recently;  they  are  described  in  further  details  in  the  following: 

Consequently,  increasing  brain  accumulation  of  Al,  which  is  known  to  be  a  neurotoxin,  could  induce 
neurological  problem(s)  in  the  long  term.  For  example,  Al  shows  a  significantly  higher  level  in  the  parietal  cortex  in 
AD  patients  compared  to  those  in  control  individuals  (Srivastava  ect,  2002).  Similarly,  Al  accumulation  in  brain 
and  other  tissues,  including  bone,  liver,  and  kidney,  has  also  been  shown  to  accompany  renal  failure  (Kuman  &  Gill, 

2009) .  Even  though  the  physiological  role  of  aluminum  in  the  brain  has  not  been  identified,  in  Table  5,  Aluminum 
decreases  through  10  days  old  and  then  spikes  up  at  22/23  days  old  and  then  decreases  for  the  rest  of  the 
developmental  stages.  This  shows  that  as  the  rat  matures  it  accumulates  aluminum  and  then  is  depleted  of  it  in  its 
older  years,  as  suggested  in  the  research.  This  accumulation  also  reflects  dietary  intake  of  the  rat. 

Calcium  (Ca)  levels  in  the  rat’s  cerebral  cortex  do  not  markedly  change  during  postnatal  development 
(Table  4).  On  the  other  hand,  one  of  the  pathological  hallmarks  of  Alzheimer’s  disease  (AD)  is  the  accumulation  of 
amyloid  plaques  between  nerve  cells  (i.e.,  neurons)  in  different  parts  of  human  brains  including  the  cerebral  cortex. 
Ca  levels  in  human  amyloid  plaques  in  AD  are  elevated.  Consistent  with  the  latter  observation  is  the  finding  that,  in 
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PSAAP  mice  (a  mouse  model  of  AD,  which  shows  plaques  but  little  neurodegeneration),  Ca  accumulation  in  their 
plaques  is  less  than  those  in  the  surrounding  brain  tissue  (Belavaria  ect,  2005).  Consequently,  age-related 
accumulation  of  Ca  in  this  brain  region  could  potentially  serve  as  a  marker  for  the  likelihood  of  developing 
neurodegeneration  as  age  advances. 

Chromium  (Cr)  shows  a  moderate  increase  in  the  parietal  cortex  of  AD  patients  compared  to  those  in 
control  subjects  (Srivastava  ect,  2002).  In  rats  cerebral  cortex,  Cr  levels  increase  from  day  10  to  day  22/23  and 
thereafter  decrease  as  adulthood  is  reached  (Table  5).  Nevertheless,  relations  between  brain  Cr  levels  and 
neurological  diseases  have  not  been  firmly  established. 

Copper  (Cu)  in  amyloid  plaques  in  AD  is  elevated  (Bolognin  ect,  2009).  In  PSAAP  mice  (a  mouse  model 
of  AD,  which  shows  plaques  but  less  neurodegeneration)  Cu  accumulation  in  their  plaques  is  less  than  those  in  the 
surrounding  brain  tissue  (Belavaria  ect,  2005).  Consequently,  increasing  Cu  accumulation  in  cerebral  cortex  as  age 
advances  can  potentially  herald  the  onset  of  neurological  problems.  In  Error!  Reference  source  not  found.Table  5 
the  copper  varies  dramatically  as  the  brain  ages. 

The  magnesium  (Mg)  levels  in  rats  cerebral  cortex  fluctuates  during  development  and  levels  off  toward 
adulthood  (Table  4).  Mg  levels  in  parietal  cortex  and  cerebellum  in  AD  patients  do  not  differ  from  those  in  control 
subjects.  Taken  together,  these  observations  suggest  Mg  to  be  more  of  a  predictor  of  neurological  problems  as  age 
advances. 

Manganese  (Mn)  shows  significantly  higher  levels  in  the  parietal  cortex  of  AD  patients  compared  to  those 
in  control  subjects  (Srivastava  ect,  2002).  However,  cerebellar  Mn  levels  in  AD  are  similar  to  those  in  control 
subjects  (Srivastava  ect,  2002).  Table  5  shows  that  Mn  levels  in  cerebral  cortex  of  the  rat  show  a  general  trend  of 
decreasing  as  its  age  increases.  Nonetheless,  whether  this  is  a  generalized  trend  of  an  essential  element  remains  to 
be  established. 

Potassium  (K)  concentrations  in  the  AD  brain  appear  to  be  similar  to  those  in  the  control  brain,  especially 
in  the  regions  examined  (Cannino  ect,  2008),  such  as  the  cerebral  cortex.  K  generally  shows  a  trend  of  age-related 
increases  in  the  rat  cerebral  cortex  (Table  4),  perhaps  reflecting  increases  in  cellular  material  because  intracellular  K 
is  higher  than  extracellular  K. 

Sodium  (Na)  levels  in  the  rat  cerebral  cortex  decreases  with  increasing  age  (Table  4),  reflecting  the  closing 
of  the  blood-brain  barrier  thereby  excluding  the  entry  of  extracellular  Na  into  cells.  On  the  other  hand,  Na  levels  in 
every  region  of  the  AD  brain  are  higher  than  corresponding  levels  in  the  control  brain  (Cannino  ect,  2008). 
Consequently,  age-related  increases  in  brain  sodium  may  be  considered  at  least  a  partial  predictor  of  age-related 
neurological  problems. 

Zinc  (Zn)  is  elevated  in  the  amyloid  plaques  in  AD.  In  PSAPP  mice  (an  AD  mouse  model  that  shows  little 
or  no  neurodegeneration),  there  was  only  a  29%  increase  of  Zn  in  their  plaques  compared  to  the  Zn  in  brain  tissue 
surrounding  the  plaques  (Belavaria  ect,  2005).  By  contrast,  Zn  levels  in  the  rat  cerebral  cortex  markedly  increased 
between  age  22/23  days  and  adulthood  suggesting  that  the  increase  is  associated  with  tissue  growth.  However,  the 
increase  in  brain  Zn  during  brain  aging  may  be  more  predictive  of  onset  and/or  presence  of  neurological  problems 
(Belavaria  ect,  2005). 

Hippocampus 

Developmental  stage  I  is  not  listed  in  tables  4  or  5  for  the  hippocampus  due  to  the  fact  that  it  can  be  found  with  the 
cerebral  cortex.  During  the  early  stages  it  is  difficult  to  separate  the  hippocampus  and  cerebral  cortex. 

In  research,  the  following  has  been  determined  about  the  following  elements: 

Following  oral  exposure  of  rats  to  aluminum  (Al),  its  retention  has  been  noted  in  the  hippocampus  as 
occurs  in  other  brain  regions:  rat  hippocampus  Al  levels  increase  markedly  after  10  days  of  age  (Table  5).  In 
patients  with  PD,  elevated  Al  levels  have  been  found  in  several  brain  regions  including  the  hippocampus,  which  is 
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rich  in  cholinergic  neurons.  This  suggests  that  A1  could  have  neurotoxin  properties.  A1  has  also  been  detected  in 
both  the  senile  plaques  and  neurobibrillary  tangle  bearing  neurons  in  the  brain  of  AD  patients.  This  leads  us  to 
believe  that  A1  may  play  a  part  in  AD.  (Kuman  &  Gill,  2009)  One  thing  to  note  though  is  that  a  number  of  studies 
have  shown  the  cognitive  impairments  that  follow  A1  exposure  do  not  have  consistent  results.  This  suggests  that  A1 
has  different  properties  in  the  brain  that  we  still  do  not  understand.  Consequently,  chronic  accumulation  of  A1  in 
this  brain  region  over  a  life-span  may  lead  to  the  development  of  neurodegenerative  diseases  such  as  PD  because  A1 
is  known  to  be  a  neurotoxin. 

Copper  concentrations  have  been  identified  in  the  hippocampus,  but  have  not  been  extensively  researched, 
just  mentioned.  The  brain  does  maintain  a  tight  regulation  of  brain  copper  transport  because  copper  is  essential  to 
the  integrity  of  a  healthy  brain.  In  Table  5,  the  copper  concentrations  increase  towards  maturity  and  then  drop  off 
once  the  rat  has  reached  adulthood. 

Potassium  (K)  levels  in  the  rat  hippocampus  increase  from  age  day  10  till  adulthood,  likely  reflecting  the 
increase  in  cellular  material  during  this  developmental  period  (Table  4).  However,  in  the  brain  regions  examined  in 
AD,  brain  K  remains  essentially  unchanged  compared  with  corresponding  levels  in  control  subjects  (Cannino  ect, 
2008),  suggesting  that  brain  K  may  not  be  a  good  indicator  of  the  likelihood  of  developing  neurological  diseases 
such  as  AD. 

Rubidium  (Rb)  levels  in  rat  hippocampus  fluctuate  between  age  day  10  and  adulthood  (Table  5).  However, 
Rb  levels  in  the  AD  brain  do  not  differ  from  those  in  the  control  brain  (Cannino  ect,  2008)  suggesting  that  Rb  levels 
in  the  brain  may  not  be  a  good  predictor  for  neurodegenerative  diseases  such  as  AD. 

Sodium  (Na)  levels  in  the  rat  hippocampus  decrease  between  ages  day  10  and  day  22/23  and  level  off  at 
adulthood  (Table  4).  However,  Na  levels  in  every  part  of  the  AD  brain  examined  are  higher  than  corresponding 
levels  in  the  control  brain  (Cannino  ect,  2008). 

Hypothalamus 

The  electrolytes  in  this  rat  brain  region  show  fluctuating  trends  in  the  four  age  groups  investigated,  partly  reflecting 
the  closing  of  the  blood-brain  barrier.  For  example,  sodium  (Na)  and  chlorine  (Cl)  levels  significantly  decrease  in 
the  first  22/23  days  postnatal.  On  the  other  hand  potassium  (K)  levels  markedly  increase  between  day  5  and  day  10 
postnatal.  (Shown  in  Table  4.) 

Although  they  show  some  age-related  fluctuations,  the  essential  trace  elements  copper  (Cu),  selenium  (Se), 
and  zinc  (Zn)  levels  in  the  rat  hypothalamus  significantly  increase  between  postnatal  age  5  days  and  adulthood 
(Table  5).  At  present,  one  can  only  speculate  about  the  functional  significance  of  the  postnatal  increases  of  these 
essential  metals  in  the  rat  hypothalamus  because  of  the  absence  of  relevant  studies. 

Midbrain 

After  reviewing  different  texts,  the  following  can  be  said  about  the  different  elements  located  in  the  midbrain: 

Chlorine,  iron,  bromine,  cobalt,  chromium,  mercury,  iodine,  manganese,  molybdenum,  selenium,  and 
vanadium  all  follow  the  same  pattern  while  all  the  other  elements  vary  in  accumulation.  Overall  accumulation  of 
metals  in  the  brain  stem  does  not  appear  to  be  major.  All  elements  appear  to  level  off  at  adulthood  or  die  off  all 
together,  as  shown  in  Tables  4  and  5.  This  may  be  one  of  the  reasons  why  the  brain  stem  has  not  been  noted  in 
papers  related  to  brain  diseases.  The  midbrain  makes  up  a  piece  of  the  brain  stem,  while  the  pons  and  medulla  make 
up  the  rest. 

One  of  the  more  interesting  elements  that  stand  out  is  copper.  In  the  midbrain,  copper  is  high  at  22/23  days 
but  drops  off  dramatically  afterwards.  Many  of  the  sections  of  the  brain  have  been  shown  to  have  abnormal  copper 
distributions  during  AD  and  high  accumulations  have  been  related  to  Wilson’s  disease.  High  accumulations  of 
copper  in  this  section  of  the  brain  have  not  been  noted  or  have  not  been  a  problem. 
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Another  interesting  element  is  calcium.  In  the  midbrain,  calcium  is  high  in  the  young  brains  and  then 
decreases  off  as  the  brain  ages.  This  could  suggest  that  calcium  is  adding  in  the  process  of  the  growth  and 
development  of  the  brain.  Calcium  is  required  in  the  brain  for  electrical  signals.  Without  it,  the  brain  could  age 
more  quickly  than  normal.  Other  failures  could  lead  to  the  inability  to  make  quick  judgments,  ‘short  circuit’ 
messages  in  the  brain  which  could  cause  involuntary  movement,  and  other  issues. 

Iron  though  has  been  shown  to  increase  in  the  substantia  nigra  (SN  -  located  in  the  midbrain)  in  patients 
with  Parkinson’s  disease.  It  still  remains  to  be  known  whether  this  is  a  cause  of  PD.  Ultrasound  studies  do  argue 
that  iron  plays  an  important  part  forming  the  pathogenesis  of  PD.  PD  does  cause  disturbances  with  iron  uptake, 
storage,  post-transcriptional  control,  and  intracellular  metabolism.  An  imbalance  of  any  of  these  could  cause  cell 
death.  However  iron-related  oxidative  stress  could  promote  a-synuclein  aggregation.  This  links  the  important  role 
of  iron  with  some  of  the  hallmarks  of  PD.  (Berg  ect,  2001)  Brain  iron  is  found  to  be  highest  in  the  substanita  nigra. 
(Leskovjan  ect,  2009)  The  iron  levels  in  Table  4  remain  constant  throughout  the  entire  developmental  stages  for  the 
rat. 


Manganese  increases  in  the  mid-brain  are  believed  to  be  primary  target  sites  for  manganese  neurotoxicity. 
It  has  also  been  shown  that  high  levels  of  Mn  have  been  found  in  AD  brains.  (Dorman  ect,  2006)  As  stated  above, 
the  manganese  appears  to  level  off  at  adulthood  or  die  off  all  together,  as  shown  in  Table  5. 

Sodium  levels  in  every  part  of  the  brain  are  shown  to  be  significantly  higher  in  AD  patients  compared  to 
normal  brains  (Belavaria  ect,  2005).  In  Table  4  it  can  be  seen  that  the  sodium  levels  actually  decrease  in  the  mid¬ 
brain  as  the  brain  ages. 

Pons  &  Medulla 

After  reviewing  different  texts,  the  following  has  been  found  out  about  the  Pons  &  Medulla  relating  to  Tables  4  and 
5: 


One  of  the  more  interesting  elements  that  stand  out  is  copper.  In  the  pons  and  medulla  copper  decreases 
slowly  as  the  brain  ages.  Many  of  the  sections  of  the  brain  have  been  shown  to  have  abnormal  copper  distributions 
during  AD  and  high  accumulations  have  been  related  to  Wilson’s  disease.  High  accumulations  of  copper  in  the 
brain  have  been  shown  to  be  the  primary  cause  of  Wilson’s  disease.  Copper  chelating  therapy  is  one  possible 
treatment  for  Wilson’s  (Gerlach  ect,  1994).  In  Table  5  it  can  be  seen  that  the  levels  of  copper  decrease  throughout 
the  entire  developmental  stages.  Something  (diet  or  environmental  conditions)  must  be  what  is  causing  the  copper 
to  spike  and  cause  Wilson’s  disease. 

Another  interesting  element  is  calcium.  In  the  pons  and  medulla,  calcium  increases  up  to  10  days  and  then 
levels  off  as  the  brain  ages  (See  Table  4).  Calcium  is  required  in  the  brain  for  electrical  signals.  Without  it,  the 
brain  could  age  more  quickly  than  normal.  Other  failures  could  lead  to  the  inability  to  make  quick  judgments,  ‘short 
circuit’  messages  in  the  brain,  which  could  cause  involuntary  movement,  and  other  issues. 

Sodium  levels  in  every  part  of  the  brain  are  shown  to  be  significantly  higher  in  AD  patients  compared  to 
normal  brains  (Belavaria  ect,  2005).  In  Table  4  the  sodium  levels  fluctuate  in  the  pons  and  medulla  as  the  brain 
ages. 


Most  major  and  trace  elements  show  age-related  decreases  in  their  levels  in  rat  pons  and  medulla  as 
adulthood  approaches.  Overall,  the  accumulation  of  metals  in  this  brain  region  is  not  as  quantitatively  marked  as 
those  in  the  other  brain  regions,  possibly  due  to  the  fact  that  this  brain  region  is  full  of  fiber  tracts  rather  than  cell 
bodies.  Moreover,  the  physiological  significance  of  the  distributions  of  metals  in  this  brain  region  is  still  poorly 
understood. 

Striatum 

In  research  the  following  has  been  determined  about  these  elements  in  the  striatum: 
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There  is  recent  evidence  that  iron  (Fe)  plays  a  role  in  the  consolidation  of  long-term  memory.  Brain  Fe 
distribution  overlaps  with  that  of  dopaminergic  neurons.  In  rodent  models  of  neurological  disorders,  Fe  levels  in  the 
substantia  nigra  and  basal  ganglia  increase.  Because  of  those  observations,  increased  striatal  Fe  has  been  suggested 
to  be  responsible  for  neuronal  cell.  Furthermore,  Fe  accumulates  in  the  brain  as  a  function  of  age  (Chan  ect,  1981). 
In  rat  striatum,  Fe  levels  decrease  between  ages  10  days  and  22/23  days  and  level  off  thereafter  (Table  4). 

Brain  Fe  is  highest  in  the  substantia  nigra,  globus  pallidus,  red  nucleus,  caudate  nucleus,  and  putamen. 
Increased  brain  Fe  has  been  found  in  several  neurodegenerative  disorders  although  it  has  not  been  defined  as  the 
main  cause  (Lee  ect,  2010).  Fe  level  in  the  substantia  nigra  increases  in  PD  but  total  Fe  in  the  substantia  nigra  zona 
reticulata  does  not  change  in  either  PD  or  AD  (Leskovjan  ect,  2009).  Thus,  these  findings  suggest  that  an  over 
accumulation  of  iron  in  striatum  may  lead  to  development  of  neurodegenerative  diseases  such  as  PD  and  AD  and 
sources  of  Fe  exposure  could  be  environmental  and  dietary.  However,  it  remains  to  be  determined  if  the  elevated  Fe 
levels  antedate  injury  of  pigmented  neurons  or  constitute  a  consequence  of  neuronal  degeneration  because  the 
increased  Fe  in  the  substantia  nigra  may  contribute  to  oxidative  damage  to  neurons.  Nevertheless,  most  brain  Fe  is 
stored  in  an  inactive  form  bound  to  intracellular  ferritin,  which  is  thought  to  be  mainly  localized  in  microglia  and 
oligodendroglia.  Clearly,  additional  studies  are  needed  to  delineate  the  pathophysiological  role  of  Fe  in 
neurodegenerative  diseases. 

Chronic  manganese  (Mn)  toxicity  in  humans  induces  signs  and  symptoms  that  closely  resemble  those  noted 
in  PD.  There  is  a  great  deal  of  evidence  that  human  striatum,  globus  pallidus,  and  substantia  nigra  show  preferential 
increases  in  Mn  and  are  believed  to  be  the  primary  sites  associated  with  Mn  neurotoxicity.  Moreover,  exposure  to 
high  Mn  leads  to  elevation  of  Mn  levels  in  olfactory  epithelium  and  olfactory  bulb  (Dorman  ect,  2006).  The 
concentration  of  manganese  decreases  dramatically  after  5  days  old  and  never  increases.  This  is  shown  in  Table  5. 

In  every  region  of  the  brain  examined,  brain  sodium  (Na)  is  increased  in  AD  compared  with  corresponding 
levels  in  control  subjects  (Cannino  ect,  2008).  On  the  other  hand,  Na  levels  in  rat  striatum  decrease  during  postnatal 
development  (See  Table  4).  Taken  together,  these  observations  suggest  that  high  Na  accumulation  in  the  brain  may 
lead  to  pathological  states  and  sources  of  the  Na  could  be  environmental  and/or  dietary  in  origin. 
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Table  5  Different  Development  Stages  Compared  to  Control 


Elements 

Region 

Ai 

Br 

Co 

Cr 

Cu 

F 

Key: 

Above  Control  Under  Control 
0  to  25%  red  0  to  -25%  yellow 
25  to  50%  purple  -25%  to  -50%  green 
>  50%  brown  <  50%  blue 
No  data  white 
Same  Black 


5.  Conclusion 

Our  results  strongly  suggest  that  varying  the  elemental  intake  can  have  an  effect  on  the  metallomic  distributions  in 
the  various  regions  of  the  rat  brain.  The  results  also  show,  that  on  average,  the  higher  supplemental  element  produce 
the  same  results  as  the  lower  supplemental  element.  This  shows  that  the  body  has  a  way  of  regulating  the  elements 
on  its  own,  as  was  mentioned  with  some  elements  in  the  above  discussion.  However,  as  shown  in  the  above  tables 
in  this  section  when  you  have  added  a  large  amount  the  body  does  not  regulate  as  well.  You  can  see  by  comparing 
adding  a  small  amount  to  adding  a  larger  amount  of  manganese. 

Our  results  also  strongly  suggest  that  the  metallomic  distributions  in  various  regions  of  the  rat  brain  change 
markedly  during  the  different  stages  of  postnatal  development.  This  suggests  that  as  the  body  ages  it  depletes  or 
adds  the  elements  that  are  necessary  for  growth  and  living.  However,  if  we  alter  from  our  diet  and  increase  the 
consumption  of  certain  elements,  the  body  may  not  handle  this  correctly  and  neurodegenerative  diseases  may  form, 
as  was  shown  in  the  above  section. 

In  summary,  our  findings  and  along  with  reports  in  the  literature,  suggest  that  brain  regional  metallomic 
distribution  can  be  influenced  by  dietary  intake  of  metals  and  other  elements  and  may  cause  pathophysiological 
implications  in  several  key  neurodegenerative  diseases  such  as  Parkinson’s  disease  and  Alzheimer’s  disease.  A 
metallomic  distribution  model  of  various  regions  of  the  rat  brain  can  be  developed  based  on  our  experimental  results 
and  statistical  analysis.  However,  much  remains  to  be  discovered  regarding  the  brains  functional  significance  of 
metallomic  distribution  during  development. 
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Appendix  31.  List  of  published  Abstracts: 


1.  Jaiswal  A,  Wong  YYW,  Bhushan  A,  Daniels  C  &  Lai  JCK  (2010)  A  Noncontact  Co-Culture  Model  of 
Peripheral  Neural  Cells  for  Nanotoxicity,  Tissue  Engineering  and  Pathophysiological  Studies.  NSTI 
Nanotechnology  Conference  and  Expo  -  Nanotech  2010,  June  21-25,  2010,  Anaheim,  CA  (in  Abstracts 
Volume). 

Abstract.  Cell  culture  models  in  vitro  have  long  serve  as  tools  for  the  elucidation  of  the  cellular  and 
molecular  mechanisms  underlying  the  pathophysiology  of  diverse  diseases.  More  recently  these  versatile  model 
systems  have  permeated  into  the  fields  of  toxicology  and  tissue  engineering.  Their  attraction  and  utility  for  use  in 
investigations  in  toxicology  and  tissue  engineering  appear  to  derive  from  the  fact  such  model  systems  are 
particularly  suitable  for  high  throughput  and  mechanistic  studies.  Although  these  models  do  not  exactly  simulate  the 
cellular  architecture  in  tissues  and  organs  in  vivo,  they  have  been  well  accepted  for  studies  employing  a  single  cell 
type.  Their  limitations  notwithstanding,  they  facilitate  gaining  unique  mechanistic  insights  regarding  the  role  of  a 
particular  cell  type,  a  position  not  easily  attainable  employing  whole  organ/tissue  studies. 

On  the  other  hand,  co-culture  cell  systems  consisting  of  two  distinctly  different  but  functionally 
complementary  cell  types  provide  structural  and  functional  perspectives  that  single -cell-type  models  do  not  offer. 
Consequently,  there  is  a  need  for  the  development  for  more  such  model  systems  and  applied  them  to 
nanotoxicological  and  tissue  engineering  studies.  Our  group  have  been  emphasized  the  necessity  of  developing  a 
variety  of  cell  model  systems  using  neural  cells.  We  have  recently  demonstrated  some  of  the  utilities  of  such  model 
systems  in  nanotoxicological  and  tissue  engineering  studies. 

There  have  been,  however,  few  cell  model  systems  developed  employing  peripheral  neural  cell  types  for 
nanotoxicological  and  tissue  engineering  studies.  We  have  therefore  initiated  a  systematic  development  of  this  type 
of  model  systems  using  dorsal  root  ganglion  (DRG)  neurons  and  Schwann  cells.  The  first  model  we  have  developed 
involved  a  non-contact  co-culture  model  of  Schwann  cells  and  DRG  neurons  employing  the  hanging  cell  culture 
insert.  Initially,  we  have  partially  characterized  the  DRG  neurons  and  Schwann  cells  in  single-cell-type  cultures.  In 
ongoing  studies  employing  our  new  co-culture,  non-contact  model,  we  demonstrated  that  the  cell  survival  of  DRG 
neurons  increased  when  co-cultured  with  Schwann  cells  in  this  construct.  Thus,  the  results  from  our  studies  to  date 
as  well  as  those  from  our  ongoing  studies  demonstrate  that  our  non-contact  co-culture  model  is  highly  suitable  for 
both  high  throughput  and  mechanistic  studies  in  nanotoxicological  and  tissue  engineering  research.  Clearly  this 
model  is  also  germane  for  the  investigation  of  mechanistic  issues  associated  with  peripheral  diabetic  neuropathy  and 
other  disease  states  of  the  peripheral  nervous  system. 


2.  Wong  YYW,  Jaiswal  AR,  Dukhande  VV,  Bhushan  A,  Leung  SW  &  Lai  JCK  (2010)  Elucidation  of 

Neuroprotective  Properties  of  Astrocytoma  (Astrocytes-like)  Cells  in  Neural  Cell  Culture  Models  In  Vitro: 
Applications  in  Tissue  Engineering  and  Nanotoxicology.  NSTI  Nanotechnology  Conference  and  Expo  - 
Nanotech  2010,  June  21-25,  2010,  Anaheim,  CA  (in  Abstracts  Volume). 

Abstract.  Evidence  is  accumulating  that  cell  culture  models  in  vitro  facilitate  high  throughput  and  mechanistic 
studies  in  tissue  engineering.  More  recently,  our  group  as  well  as  other  researchers  have  developed  several  cell 
models  for  the  systematic  investigation  of  molecular  mechanisms  underlying  the  putative  cytotoxicity  of 
nanoparticles  and  other  nanomaterials.  These  and  other  studies  have  drawn  wide-spread  interest  in  the  possible 
environmental  and  occupational  health  impact  of  nanoparticles  and  other  nanomaterials. 

As  part  of  a  continuing  effort  to  further  develop  and  characterize  cell  models  for  cellular  and  molecular 
mechanistic  studies,  we  have  extended  our  previous  investigation  employing  neural  cell  models  because  most 
studies  have  traditionally  employed  peripheral  cell  types  but  not  neural  cells. 


Astrocytes  are  known  to  protect  neurons  against  pathophysiological  as  suits  in  vivo  and  in  vitro  although  the 
underlying  mechanisms  are  not  fully  understood.  We  have  previously  developed  several  cell  culture  models  in  vitro 
to  systematically  investigate  several  of  the  putative  neuroprotective  properties  of  astrocytes.  For  example,  we  have 
previously  shown  U-87  (astrocytes -like)  astrocytoma  cells  afford  SK-N-SH  (neurons-like)  neuroblastoma  cells 
against  several  pathophysiological  assaults  such  as  oxidative  stress  induced  by  depletion  of  cellular  glutathione. 

Based  on  the  results  of  our  previous  studies,  we  hypothesized  that  different  stress  factors  can  elicit  and/or 
enhance  the  neuroprotective  effects  of  astrocytes  through  the  activation  of  astrocytic  signaling  and  alteration  of 
astroglial  function.  We  have  initiated  a  series  of  studies  employing  our  cell  models  to  test  this  hypothesis.  The 
results  of  our  ongoing  studies  demonstrate  that  U-87  (astrocytes -like)  astrocytoma  cells  provide  SK-N-SH  (neurons¬ 
like)  neuroblastoma  cells  against  pathophysiological  assaults  (e.g.,  oxidative  stress)  under  several  sets  of  culture 
conditions  not  previously  studied.  Other  studies  are  in  progress  to  further  elucidate  the  cellular  and  molecular 
mechanisms  underlying  these  protective  effects  proffered  by  U-87  (astrocytes-like)  astrocytoma  cells  to  SK-N-SH 
(neurons-like)  neuroblastoma  cells.  Thus,  our  results  may  have  pathophysiological  implications  in  neuroprotection 
but  also  implications  and  applications  in  tissue  engineering  and  nanotoxicological  research. 


3.  Leung  SW,  Gao  W,  Gu  H,  Bhushan  A  &  Lai  JCK  (2010)  Chitosan  Membrane  in  Combinations  with 
Nanoparticles  and  Adriamycin  as  a  Treatment  to  Inhibit  Glioma  Growth  and  Migration.  NSTI 
Nanotechnology  Conference  and  Expo  -  Nanotech  2010,  June  21-25,  2010,  Anaheim,  CA  (in  Abstracts 
Volume). 

Abstract.  Our  previous  and  on-going  studies  indicated  that  U87  cells  cultured  on  chitosan  film/membrane  exhibited 
significantly  slower  growth  and  proliferation  kinetics  compared  to  U87  cells  cultured  in  the  absence  of  chitosan 
film/membrane.  Chitosan  exhibits  anti -microbial  activities  through  its  interaction(s)  with  microbial  cell  surface 
thereby  altering  their  gene  expression  and  cellular  function  and  leading  to  cell  death.  Recent  studies  of  nanometal 
particles  have  revealed  many  properties  that  were  not  previously  expected  in  biological  systems  and  thus  can  be 
explored  for  various  applications  in  biomedical  applications.  In  this  study,  we  hypothesized  that  the  inhibitory 
effect  of  chitosan  would  be  greatly  modulated  if  we  combine  chitosan  with  nanometals  and  adriamycin,  a  common 
drug  for  cancer  therapy.  Our  results  showed  that  combinations  of  metal  nanoparticles,  adriamycin  and  chitosan 
induced  cell  death  at  different  rates,  with  reference  to  U87  cells  cultured  in  the  absence  of  chitosan  and  with 
chitosan  alone.  The  results  showed  potentials  for  pathophysiological  applications  to  inhibit  human  brain  glioma 
migration  and  invasion.  Results  of  similar  treatments  with  different  cancer  and  normal  cells  will  also  be  presented. 


4.  Leung  SW,  Wang  Y,  Gu  H  &  Lai  JCK  (2010)  Biomedical  Applications  of  Modified  Carbon  Glassy 
Electrode  Sensor  with  Nanoparticles  and  Dendrimers.  NSTI  Nanotechnology  Conference  and  Expo  - 
Nanotech  2010,  June  21-25,  2010,  Anaheim,  CA  (in  Abstracts  Volume). 

Abstract.  In  our  previous  reports,  we  studied  the  development  of  biosensor  platform  that  are  capable  of  measuring 
biometabolites  and  environmental  sensitive  species,  such  as  peroxide  and  nitrate/nitrate,  to  concentration  in  the 
order  of  ppb  (parts  per  billion)  or  lower. 

In  our  more  recent  development,  we  modified  our  platform  with  dendrimers  to  enhance  its  performance.  Zero  and 
second  generation  of  dendrimers  were  coated  on  the  surface  of  a  carbon  glassy  platform  electrode  modified  with 
GDH  (glutamate  dehydrogenase)  and  it  was  used  to  measured  ammonium,  a  common  biometabolite,  at  near  neutral 
pH  that  is  common  for  normal  bioactivities. 


The  resulting  electrode  was  tested  with  ammonium  concentrations  ranged  from  0.002  to  0.3  jiM  with  satisfactory 
results.  Measurements  at  lower  concentrations  had  better  resolution  than  at  higher  concentrations  and  it  is  believed 
that  the  lower  concentration  limit  can  be  better  than  the  tested  lower  limit  at  0.002  jiM.  Performance  of  the 
modified  carbon  glassy  electrode  was  compared  with  other  glassy  electrodes  that  were  modified  differently,  and  the 
results  will  be  reported. 

The  biosensor  platform  thus  far  was  proven  to  be  versatile  and  can  be  used  in  many  biomedical  and  environmental 
applications. 


5.  Wright  GL,  Lai  JCK,  Chan  AWK,  Minski  MJ,  Lim  L  &  Leung  SW  (2010)  Metallomic  Distribution  in 
Various  Regions  of  the  Brain  as  Influenced  by  Dietary  Intakes  and  Their  Implications.  ISEIS  2010 
International  Conference  on  Environmental  Informatics,  Beijing,  China,  August  27-29,  2010  (in  Abstracts 
Volume). 

Abstract.  Lifelong  exposure  to  environmental  factors  can  influence  the  risk  of  developing  diseases  according  to 
recent  research  findings.  Environmental  stresses  ultimately  leading  to  neuronal  cell  death  have  been  hypothesized  as 
the  causes  of  the  increased  occurrence  in  developing  Alzheimer’s  and  Parkinson’s  disease.  Our  daily  diet  is 
considered  to  be  one  of  the  most  important  environmental  factors  that  can  seriously  affect  the  development  and 
proper  functions  of  the  brain.  Depending  on  the  concentrations,  metals  and  electrolytes  can  post  some  health 
concerns,  especially  for  a  prolonged  consumption  period.  Eor  example,  it  was  reported  that  excess  amounts  of  iron, 
zinc  and  copper  in  the  human  brain  may  cause  oxidative  damage  and  protein  aggregation;  the  neurotoxicity  induced 
by  these  metals  may  lead  to  cerebral  and/or  cerebellar  degeneration.  Other  reports  showed  that  there  were 
differences  in  concentrations  of  five  different  elements  (aluminum,  zinc,  copper,  manganese,  and  iron)  between 
normal  human  brain  and  brains  of  patients  with  Alzheimer’s  disease.  In  this  study,  we  investigated  30  elements, 
including  electrolytes,  and  how  dietary  intake  on  a  life-time  basis  would  affect  their  concentrations  and  distributions 
in  various  regions  of  the  rat  brain  (hypothalamus,  cerebellum,  pons  and  medulla,  striatum,  mid -brain,  cerebral 
cortex,  and  hippocampus)  and  discussed  their  health  implications.  Information  matrices  of  these  30  different 
elements  (mostly  metals)  and  their  distributions  in  various  regions  of  the  rat  brain  were  analyzed  as  a  function  of 
normal  dietary  intake  at  different  ages  during  development.  Our  results  showed  that  metallomic  distribution  in 
various  regions  of  the  rat  brain  is  age-related.  The  results  may  help  researchers  to  identify  possible  links  between 
daily  dietary  intake  of  metals  and  electrolytes  and  diseases  associated  with  aging  (e.g.,  Alzheimer’s  and  Parkinson’s 
disease)  and  suggest  such  metallomic  distributions  may  be  used  as  neurological  biomarkers  of  exposure  to  heavy 
metals. 


6.  Leung  SW,  Siddhanti  S,  Williams  B,  Chan  AWK,  Minski  MJ,  Daniels  CK  &  Lai  JCK  (2010)  Effects  of 
Dietary  Intake  on  Metal  and  Electrolyte  Distributions  in  Various  Organs.  ISEIS  2010  International 
Conference  on  Environmental  Informatics,  Beijing,  China,  August  27-29,  2010  (in  Abstracts  Volume). 

Abstract.  The  intake  and  concentration  of  metals  and  electrolytes  from  our  diet  are  believed  to  be  affecting  our 
general  health,  in  particular,  the  proper  functions  of  vital  organs.  Eor  example,  in  addition  to  other  genetic  and 
environmental  factors,  consuming  water  with  high  alkalinity  for  prolonged  time  is  suspected  to  lead  to  diseases  such 
as  kidney  stone.  Evidence  has  been  accumulating  that  excessive  metal  intakes  would  lead  to  organ  failures.  Once 
absorbed,  minerals  and  electrolytes  can  travel  freely  throughout  the  body,  and  distribute  at  key  organ  systems  such 
as  the  brain,  lung,  kidney,  etc.  By  conducting  experiments  with  animal  models  (e.g.,  rats),  it  is  possible  to  not  only 
determine  where  the  organ  distribution  of  various  matrices  of  elements  and  minerals  but  also  correlate  such  matrices 
with  the  overall  physiological  and  behavioral  status  of  such  models.  In  this  study,  information  matrices  of  30 
different  elements  (including  heavy  metals  and  some  electrolytes)  and  their  distributions  in  various  vital  organs 
(e.g.,  brain,  lung,  kidney,  liver,  heart,  spleen,  and  uterus)  were  analyzed  as  a  function  of  normal  dietary  intake  at 
adulthood  (120  days  old).  An  elemental  (metal  and  electrolyte)  distribution  model  was  then  formulated  based  on 


experimental  results.  The  study  has  high  impact  to  our  understanding  of  how  environmental  health  would  affect  our 
well  being.  This  study  would  also  provide  insights  on  how  our  diet  would  affect  the  accumulations  of  unwanted 
elements,  such  as  heavy  metals,  in  our  vital  organs.  The  results  may  help  researchers  and  health  practitioner  to 
identify  possible  links  between  daily  diet  (metals  and  electrolytes)  and  diseases,  and  may  also  lead  to  a  better 
understanding  of  diseases  associated  with  aging  such  as  Alzheimer’s  and  Parkinson’s  diseases,  and  other 
neurological  disorders. 


7.  Bhushan  A,  Patil  PP,  Bhardwaj  V,  Lai  MB,  Daniels  CK,  Leung  SW  &  Lai  JCK  (2010)  Cross  Resistance  of 
Magnesium  Oxide  Nanoparticles  to  Cisplatin  in  Leukemia  Cells:  Mechanistic  Studies.  Institution  of 
Mechanical  Engineers  Seminar  on  Nanotechnology  in  Medicine  and  Biotechnology,  October  2010, 

London,  UK  (in  Program  &  Abstracts). 

Abstract.  We  have  presented  an  overview  of  our  studies  on  anti-cancer  drug  resitance  mechanisms  as  well  as 
ongoing  systematic  studies  of  the  nanotoxicity  of  metallic  oxide  nanoparticles.  Our  ongoing  studies  also  suggest  that 
resistant  cancer  cells  may  exhibit  cross-resistant  to  the  cytotoxic  effects  of  metallic  oxide  nanoparticles.  The  latter 
effects  appear  to  be  mediated  by  cell  survival/proliferation  signaling  mechanisms.  Clearly  these  are  important  and 
novel  areas  of  anti-cancer  drug  discovery.  As  such  they  merit  further  investigation.  We  are  currently  pursuing  these 
exciting  new  dormains  of  nanomedicine  and  nanocancer  research. 

8.  Gao  W,  Lai  JCK  &  Leung  SW  (2011)  Effects  of  Chitosan  on  Schwann  Cells  and  Dorsal  Root  Ganglion 
Neurons.  53^^  Annual  Symposium  of  the  Idaho  Academy  of  Science,  March  31 -April  2,  2011,  The  College 
of  Idaho,  Caldwell,  ID.  Journal  of  Idaho  Academy  of  Science,  47(1):  59. 

Abstract.  Chitosan  has  been  studied  as  a  scaffolding  material  for  nerve  regeneration  due  to  its 
biocompatible  nature.  Current  cell  models  involving  primary  cultures  of  peripheral  nervous  system  (PNS)  neural 
cells  used  to  investigate  the  interactions  between  neural  cells  and  chiotsan  have  significant  limitations  because 
primary  cultures  of  PNS  neural  cells  have  a  very  limited  life-span.  In  this  study,  we  have  overcome  such  limitations 
by  employing  immortalized  Schwann  cells  (SI 6)  and  genetically -modified  dorsal  root  ganglion  (DRG)  neurons 
(50B1 1),  which  have  much  longer  life-span  when  cultured  in  vitro.  We  have  elucidated  some  of  the  effects  of 
chitosan  on  the  growth  of  these  two  cell  types  by  employing  the  MTT  assay.  Results  of  our  on-going  studies 
suggested  that  chitosan  had  no  effects  on  the  growth  rate  of  Schwann  cells  up  to  two  weeks.  However,  chitosan 
appeared  to  exert  a  small  inhibitory  effect  on  the  growth  rate  of  DRG  neurons.  These  findings  suggested  that 
chitosan  is  more  biocompatible  with  Schwann  cells  than  with  DRG  neurons.  We  therefore  conclude  that  chitosan 
has  good  biocompatibility  in  PNS  neural  cells  and  may  have  some  potential  to  be  a  suitable  scaffolding  material  to 
support  nerve  regeneration  and  repair. 

9.  Jaiswal  AR,  Lu  S,  Bhushan  A,  Daniels  CK,  Leung  SW  &  Lai  JCK  (2011)  Toxicity  of  Nanoparticles: 
Assessment  Using  Cells  from  Peripheral  Nervous  System.  53^^  Annual  Symposium  of  the  Idaho 
Academy  of  Science,  March  31 -April  2,  2011,  The  College  of  Idaho,  Caldwell,  ID.  Journal  of  Idaho 
Academy  of  Science,  47(1):  60. 

Abstract.  The  diverse  applications  of  nanomaterial,  including  nanoparticles,  have  been  increasing 
exponentially  in  the  last  decade.  Once  they  enter  the  body,  nanoparticles  may  be  toxic  to  one  or  more 
organs.  However,  the  toxicity  of  nanoparticles  in  mammals  has  not  been  systematically  studied  although 
there  is  increasing  concern  about  their  environmental  and  health  impact.  We  have  systematically  elucidated 
the  putative  cytotoxicity  of  nanoparticles  of  silicon  dioxide  (Si02)  and  titanium  dioxide  (Ti02)  in  various 
cell  types.  Here,  we  investigated  the  putative  toxicity  of  the  nanoparticles  in  peripheral  nervous  system 
employing  cell  culture  models  of  Schwann  cells  and  dorsal  root  ganglion  (DRG)  neurons.  The  results  from 
our  ongoing  studies  demonstrate  treatment  with  Si02  or  Ti02  nanoparticles  induced  increases  in  reactive 
oxygen  species  production,  decreases  in  cell  survival,  increases  in  lactate  dehydrogenase  release  and 
changes  in  cellular  morphology.  The  results  from  flow  cytometer  and  microscopic  observation  show  that 
there  is  internalization  of  the  nanoparticles  by  Schwann  cells.  Thus,  results  of  our  ongoing  studies  are 
consistent  with  the  hypothesis  that  Si02  and  Ti02  nanoparticles  are  cytotoxic  to  cells  of  the  peripheral 
nervous  system  and  may  have  health  impact  on  environmental  exposure  to  such  nanoparticles. 


10.  Wong  YYW,  Jaiswal  AR,  Lu  S,  Dukhande  VV,  Bhushan  A,  Daniels  CK,  Leung  SW  &  Lai  JCK  (2011) 

Neuroprotective  Role  of  Pioglitazone,  a  PPARy  Agonist  on  Nanoparticles -Induced  Cytotoxicity  and  Stress 
in  Astrocytes -Like  U87  Astrocytoma  Cells.  53^^  Annual  Symposium  of  the  Idaho  Academy  of  Science, 
March  31-April  2,  2011,  The  College  of  Idaho,  Caldwell,  ID.  Journal  of  Idaho  Academy  of  Science,  47(1): 
73. 

Abstract.  Evidence  has  been  accumulating  that  nanoparticles  have  been  increasingly  employed  in  diverse 
industrial  applications.  Nevertheless,  the  health  impact  of  exposure  to  nanoparticles  has  not  been  fully 
assessed.  Recent  studies  from  our  and  other  laboratories  suggest  that  exposure  to  nanoparticles  induces 
cytotoxic  and  inflammatory  responses  in  lung  tissue  and  cells  from  both  central  and  peripheral  nervous 
systems.  To  systematically  investigate  molecular  mechanisms  underlying  the  putative  cytotoxicity  of 
nanoparticles,  we  have  developed  several  cell  models  in  vitro  for  high  throughput  studies.  For  example,  we 
have  previously  shown  that  astrocytes -like  U87  astrocytoma  cells  can  offer  neuroprotection  to  neurons -like 
SK-N-SH  neuroblastoma  cells  in  the  co-culture  paradigm.  In  the  presented  studies,  we  have  tested  the 
hypothesis  that  nanoparticles -induced  cytotoxic  stress  can  elicit  and/or  enhance  the  neuroprotective  effects 
of  astrocytes  through  the  activation  of  astrocytic  signaling  and  alteration  of  astroglial  function.  Results 
from  our  ongoing  studies  provide  some  support  for  this  hypothesis.  Furthermore,  the  neuroprotection 
proffered  by  the  astrocytoma  cells  may  be  enhanced  in  the  presence  of  pioglitazone,  a  peroxisome 
proliferator-activated  receptors  y  (PPARy)  agonist.  Consequently,  our  results  may  have  pathophysiological 
implications  in  neuroprotection  and  nanotoxicological  research. 

11.  Gao  X,  Assan  D,  Lai  JCK  &  Leung  SW  (2011)  Anaerobic  Biofuel  Cell  Modified  with  NanoParticles  and 
Polymers  for  Biomedical  Applications.  53^^  Annual  Symposium  of  the  Idaho  Academy  of  Science,  March  31- 
April  2,  2011,  The  College  of  Idaho,  Caldwell,  ID.  Journal  of  Idaho  Academy  of  Science,  47(1):  74-75. 

Abstract.  Highly  branched  polymers  and  nano  Au  particles  sol-gel  were  used  to  construct  an  enzymatic  biofuel 
cell  used  in  an  anaerobic  system.  The  anode  and  cathode  of  this  biofuel  cell  were  modified  with  polymers  and 
sol-gel  that  effectively  stabilized  the  enzymes,  lactate  dehydrogenase  (LDH)  and  glutamate  dehydrogenase 
(GDH)  that  were  essential  for  converting  body  substrates  to  energy  and  metabolic  products.  This  sol-gel 
modification  would  enable  further  enzymatic  biofuel  cell  development  that  was  not  possible  due  to  rapid 
deterioration  of  enzymes  that  are  necessary  for  all  biochemical  reactions.  The  anaerobic  biofuel  cell  can  be  the 
power  source  for  biomedical  devices  such  as  pacemaker  and  insulin  pump  that  are  imbedded  in  the  body;  this 
“build-in”  biofuel  cell  can  avoid  many  problems  associated  with  external  power  source. 

12.  Kasarla  V,  Mukka  K,  Tadinada  SM,  Wong  YYW,  Bhushan  A,  Daniels  CK,  Leung  SW  &  Lai  JCK  (201 1) 
Differential  Cytotoxic  Effects  of  Zinc  Oxide  Nanoparticles  on  S16  Schwann  Cells  and  DRG  Neurons.  53rd 
Annual  Symposium  of  the  Idaho  Academy  of  Science,  March  31-April  2,  2011,  The  College  of  Idaho,  Caldwell, 
ID.  Journal  of  Idaho  Academy  of  Science,  47(1):  75. 

Abstract.  Nanoparticles  are  increasing  employed  in  drug  delivery  and  targeting  although  their  putative 
toxicity  is  incompletely  understood.  Our  previously  observation  that  several  metallic  oxide  nanoparticles  exert 
cytotoxic  effects  on  human  neural  and  non-neural  cells  prompted  us  to  hypothesize  that  zinc  oxide  (ZnO) 
nanoparticles  exert  cytotoxicity  on  Schwann  cells  and  dorsal  root  ganglion  (DRG)  neurons  by  decreasing  their 
survival.  To  investigate  this  hypothesis,  we  determined  the  survival  of  S16  Schwann  cells  and  DRG  neurons  after 
treating  them  with  various  concentrations  of  ZnO  nanoparticles  for  48  hours.  Our  results  indicated  that  treatment 
with  ZnO  nanoparticles  decreased  their  cell  survival  in  a  dose-related  manner.  Furthermore,  DRG  neurons  were 
more  susceptible  to  cytotoxicity  of  ZnO  nanoparticles  than  S16  Schwann  cells.  Consequently,  there  is  an  urgent 
need  to  identify  the  mechanisms  underlying  the  differential  cytotoxicity  of  ZnO  nanoparticles  in  these  cell  types. 
Nevertheless,  our  results  may  have  pathophysiological  implications  in  toxicity  of  ZnO  nanoparticles  in  peripheral 
nervous  system. 

13.  Tadinada  SM,  Bhardwaj  V,  Lai  JCK  &  Bhushan  A  (2011)  Role  of  Epidermal  Growth  Factor  Receptor  in 
Pancreatic  Cancer  Resistance.  53^^  Annual  Symposium  of  the  Idaho  Academy  of  Science,  March  31-April  2,  2011, 
The  College  of  Idaho,  Caldwell,  ID.  Journal  of  Idaho  Academy  of  Science,  47(1):  75-76. 


Abstract.  Pancreatic  cancer  (PC)  is  one  of  the  most  aggressive  cancers  with  dismally  low  survival  rate  of  4-5%.  The 
reasons  for  the  low  PC  patients’  survival  rate  are:  late  diagnosis  and  highly  metastatic  and  drug  resistant  nature  of 
PC.  Two  drugs  of  the  anti-metabolite  class,  gemcitabine  (GEM)  and  5-fluorouracil  (5FU),  have  been  approved  for 
the  treatment  of  PC;  however,  the  cancer  cells  soon  acquire  resistance  against  these  drugs  rendering  them 
ineffective.  In  this  study,  we  determined  the  role  of  epidermal  growth  factor  receptor  (EGER)  and  its  downstream 
signaling  molecules  in  drug  resistant  characteristics  of  PC  cells.  We  hypothesized  that  modulation  of  EGER  activity 
affects  the  cytotoxicity  of  GEM  and  5EU  providing  the  PC  cells  with  drug  resistant  characteristics.  We  selected 
GEM  and  5EU  resistant  cell  lines  and  found  that  the  levels  of  activated  EGER  were  altered  in  them  compared  to 
their  parent  cells.  In  addition,  the  resistant  cells  were  differentially  sensitive  to  gefitinib.  Thus,  the  resistant  cells  can 
serve  as  models  to  better  understand  the  mechanisms  of  drug  resistance  in  PC  and  may  be  helpful  in  developing  new 
therapies  for  targeting  drug -resistant  PC  cells. 

14.  Idikuda  V,  Singh  R,  Kumbulla  S,  Jaiswal  AR,  Bhushan  A,  Daniels  CK,  Leung  SW  &  Lai  JCK  (2011) 
Morphological  Changes  of  Schwann  Cells  after  Exposure  to  Magnesium  Oxide  Nanoparticles.  53^^  Annual 
Symposium  of  the  Idaho  Academy  of  Science,  March  31 -April  2,  2011,  The  College  of  Idaho,  Caldwell,  ID.  Journal 
of  Idaho  Academy  of  Science,  47(1):  76. 

Abstract.  Schwann  cells  are  the  supportive  cells  of  neurons  in  the  peripheral  nervous  system  (PNS)  and 
interact  with  them  in  myelin  production  and  axonal  regeneration.  Moreover,  the  processes  extended  by  Schwann 
cells  serve  to  guide  regenerating  nerves  to  their  target  organ.  This  study  focuses  on  examining  the  morphological 
changes  of  cultured  Schwann  cells  after  exposing  them  to  magnesium  oxide  nanoparticles.  Results  of  ongoing 
studies  suggest  that  treatment  with  the  nanoparticles  modulate  on  this  mechanism  of  Schwann  cells.  However,  we 
noted  the  Schwann  cells  extended  maximum  number  of  processes  when  treated  with  0.1-1  pg/ml  of  the 
nanoparticles  whereas  at  higher  exposure  concentrations,  Schwann  cells  and  their  nuclei  appeared  to  be  swollen  and 
their  survival  decreased.  Our  results  are  the  first  to  report  on  morphological  changes  of  these  cells  when  exposed  to 
magnesium  oxide  nanoparticles  and  as  such  may  have  pathophysiological  implications  of  exposure  of  the  PNS  to  the 
nanoparticles. 

15.  Singh  MRM,  Kumbulla  S,  Idikuda  VK,  Jaiswal  AR,  Bhushan  A,  Leung  SW,  Daniels  CK  &  Lai  JCK  (201 1) 
Neurotoxicity  of  Magnesium  Oxide  Nanoparticles  as  Elicited  in  Schwann  Cells.  53^^  Annual  Symposium  of  the 
Idaho  Academy  of  Science,  March  31 -April  2,  2011,  The  College  of  Idaho,  Caldwell,  ID.  Journal  of  Idaho  Academy 
of  Science,  47(1):  77. 

Abstract.  Nanoparticles  have  found  wide  usage  in  semiconductors,  robotics,  pharmaceuticals  and  medical 
sciences.  However,  because  of  their  diverse  and  ever-increasing  applications,  their  potential  environmental  impact 
and  health  risk  have  become  prominent  issues  to  be  addressed.  Nevertheless,  the  health  effects  of  exposure  to 
nanoparticles  are  poorly  understood.  Our  ongoing  study  constitutes  part  of  a  systematic  elucidation  of  putative 
toxicity  of  nanoparticles  in  the  peripheral  nervous  system  (PNS).  Schwann  cells  are  the  principal  glia  of  the  PNS  and 
play  significant  roles  in  supporting  neurons,  the  conduction  of  nerve  impulses,  and  nerve  development  and 
regeneration.  We  monitored  the  putative  cytotoxicity  of  magnesium  oxide  (MgO)  nanoparticles  in  Schwann  cells 
employing  the  MTT  (cell  survival)  assay  and  found  that  survival  of  Schwann  cells  decreased  when  exposed  to  the 
nanoparticles  in  a  dose-  and  time -related  manner.  Thus,  results  of  our  ongoing  study  suggest  that  MgO  nanoparticles 
can  exert  some  neurotoxicity  on  PNS  as  detected  in  Schwann  cells  in  culture  and  may  have  toxicological 
implications  in  environmental  exposure  to  such  nanoparitcles. 

16.  Kumbulla  S,  Idikuda  VK,  Singh  R,  Jaiswal  AR,  Alaydi  L,  Bhushan  A,  Leung  SW,  Daniels  CK  &  Lai  JCK 
(2011)  Comparison  of  Effects  of  Several  Metal-Based  Nanoparticles  on  R3  Schwann  Cells.  53^^  Annual 
Symposium  of  the  Idaho  Academy  of  Science,  March  31 -April  2,  2011,  The  College  of  Idaho,  Caldwell,  ID.  Journal 
of  Idaho  Academy  of  Science,  47(1):  77-78. 

Abstract.  The  increased  use  of  nanotechnology  in  everyday  life  raises  questions  regarding  the  health  pact  of 
nanoparticles.  Because  the  toxicity  of  various  nanoparticles  in  mammalian  cells  has  not  been  elucidated,  our 
ongoing  study  focuses  on  comparing  the  toxicity  of  several  metal -based  and  non-metal-based  nanoparticles  on  the 
peripheral  nervous  system  (PNS).  We  exposed  R3  Schwann  cells,  a  major  PNS  neural  cell  type,  to  magnesium  oxide 
(MgO),  silicon  dioxide  (Si02),  titanium  oxide  (Ti02)  and  zinc  oxide  (ZnO)  nanoparticles  for  24,  36  and  48  hours 


and  monitored  their  cell  survival.  We  found  that  MgO,  Si02,  Ti02  and  ZnO  nanoparticles  induced  cell  death  in  R3 
Schwann  cells  in  a  dose-  and  time -related  manner.  Furthermore,  comparison  of  the  effects  of  these  nanoparticles 
reveals  that  Ti02  and  ZnO  nanoparticles  are  more  toxic  to  R3  Schwann  cells  compared  to  the  other  nanoparticles 
investigated.  Thus,  our  results  may  have  implications  in  pathophysiology  of  metal -based  nanoparticles  in  PNS 
neural  cells  and  in  the  environmental  exposure  to  these  metal -based  nanoparticles. 

17.  Mukka  K,  Kasarla  V,  Tadinada  SM,  Wong  YYW,  Bhushan  A,  Daniels  CK,  Leung  SW  &  Lai  JCK  (2011) 
Exposure  of  Zinc  Oxide  and  Other  Metallic  Oxide  Nanoparticles  Induces  Cytoxicity  and  Morphological  Alterations 
in  Dorsal  Root  Ganglion  Neurons.  53^^  Annual  Symposium  of  the  Idaho  Academy  of  Science,  March  31 -April  2, 
2011,  The  College  of  Idaho,  Caldwell,  ID.  Journal  of  Idaho  Academy  of  Science,  47(1):  78-79. 

Abstract.  The  use  of  nanoparticles  in  industrial  applications  has  been  expanding  and  accelerating  in  the 
last  two  decades.  Nevertheless,  the  occupational  and  health  impact  from  the  exposure  to  such  nanoparticles  is 
poorly  understood.  We  previously  detected  the  cytotoxic  effects  of  several  metallic  oxides  nanoparticles  in  central 
nervous  system  neural  cells  in  vitro.  Because  the  cytotoxic  effects  of  the  nanoparticles  on  the  peripheral  nervous 
system  (PNS)  are  unknown,  we  developed  a  PNS  cell  model  in  vitro  consisting  of  dorsal  root  ganglion  (DRG) 
neurons  to  study  the  effects  of  the  nanoparticles.  We  exposed  these  cells  to  various  concentrations  of  metallic 
oxides  nanoparticles  and  observed  that  their  survival  decreased  as  the  treatment  levels  increased.  Among  those 
studied.  Zinc  oxide  (ZnO)  nanoparticles  were  the  most  effective  in  lowering  survival  of  DRG  neurons  and  in 
inducing  morphological  changes  in  these  neurons.  Thus,  our  results  have  implications  in  the  pathophysiology  of 
cytotoxicity  of  metallic  oxides  nanoparticles  in  peripheral  neurons.  Clearly,  the  molecular  mechanisms  underlying 
the  cytotoxicity  of  ZnO  nanoparticles  merit  further  investigation. 
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Silicon  Dioxide  Nanoparticles  on  Peripheral  Nervous  System  Neural  Cell  Models.  NSTI  Nanotechnology 
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Abstract.  As  cautioned  by  the  US  Environmental  Protection  Agency,  exposure  to  nanomaterials  can  occur 
during  their  manufacture  or  production:  these  industrial  processes  also  may  potentially  give  rise  to  environmental 
pollution  of  such  materials.  Thus,  a  case  in  point  is  the  exposure  to  silicon  dioxide  (Si02)  nanoparticles  because 
Si02  -  including  a  range  of  its  particle  sizes  -  is  increasingly  being  used  in  cosmetics,  food,  and  drug  formulations. 
Si02  was  generally  regarded  as  a  non-toxic  substance  in  view  of  its  numerous  industrial  applications.  Nevertheless, 
there  have  been  reportsthat  Si02  particles  are  not  as  harmless  as  they  were  assumed  to  be.  Consequently,  the  need  is 
increasing  to  examine  the  biocompatibility  of  Si02  particles  ranging  from  the  micro-  to  the  nanometer  sizes. 

There  is  increasing  evidence  that  cell  model  systems  in  vitro  facilitate  the  high  through-put  screening  of 
putative  toxicity  of  a  variety  of  nanomaterials,  including  nanoparticles.  However,  until  recently,  most  of  such  cell 
models  consisted  of  non-neural  cells  such  as  lung,  skin,  and  liver  cells.  Because  of  the  paucity  of  the  literature  on 
employing  neural  cell  types  to  elucidate  the  putative  cytotoxicity  of  nanomaterials,  we  began  developing  several 
human  neural  cell  model  systems  (e.g.,  the  astrocytes -like  U87  astrocytoma  and  neurons-like  SK-N-SH 
neurobias  tom  cells)  to  systematically  investigate  the  putative  cytotoxicity  of  metallic  and  non -metallic  oxide 
nanoparticles.  Our  previous  studies  demonstrated  that  the  nanoparticles  of  several  metallic  and  non-metallic  oxides, 
including  Si02,  exert  differential  cytotoxic  effects  on  our  models.  Nevertheless,  as  far  as  we  are  aware,  the  putative 
cytotoxicity  of  these  nanoparticles  on  neural  cells  derived  from  the  peripheral  nervous  system  (PNS)  has  not  been 
reportedly  studied. 

We  have  recently  developed  two  neural  cell  models  derived  from  the  PNS,  namely  dorsal  root  ganglion 
(DRG)  neurons  and  Schwann  cells.  Our  systematic  studies  have  indicated  that  the  two  in  vitro  cell  models  are 
suitable  not  only  for  elucidating  the  pathophysiological  mechanisms  underlying  diabetic  neuropathy  but  also  for 
nanotoxicology  and  tissue  engineering  studies. 

Because  the  putative  cytotoxic  effects  of  metallic  and  non-metallic  oxide  nanoparticles  in  PNS  neural  cells 
are  largely  unknown,  we  have  employed  our  in  vitro  models  of  DRG  neurons  and  Schwann  cells  to  systematically 
investigate  the  putative  cytotoxicity  of  nanoparticles  of  several  metallic  and  non-metallic  oxides.  Results  of  our 
ongoing  studies  have  revealed  that  Si02  nanoparticles  exert  differential  cytotoxic  effects  on  DRG  neurons  and 


Schwann  cells  by  lowering  their  survival.  Furthermore,  employing  the  flow  cytometry,  we  noted  the  cytotoxicity  of 
Si02  nanoparticles  in  the  two  cell  models  in  vitro  could  be  attributed,  at  least  in  part,  to  the  uptake  of  the 
nanoparticles  by  the  two  cell  types.  Clearly,  these  interesting  cytotoxic  mechanisms  underlying  the  effects  of  the 
nanoparticles  in  the  cell  models  merit  further  investigation. 

All  in  all,  results  of  our  ongoing  studies  strongly  suggest  that  the  DRG  neurons  and  Schwann  cells 
constitute  excellent  cell  model  systems  in  vitro  for  high-throughput  screen  of  cytotoxicity  of  nanoparticles  in  PNS 
neural  cells.  Moreover,  they  may  have  pathophysiological  implications  in  how  exposure  to  Si02  nanoparticles 
impacts  on  the  structure  and  function  of  the  peripheral  nervous  system. 

19.  Lu  S,  Jaiswal  AR,  Wong  YYW,  Bhushan  A,  Leung  SW,  Daniels  CK  &  Lai  JCK  (2011)  Differential 
Cytotoxic  Effects  of  Titanium  Oxide  Nanoparticles  on  Peripheral  Nervous  System  Neural  Cells.  NSTI 
Nanotechnology  Conference  and  Expo  -  Nanotech  2011,  June  13-16,  2011,  Boston,  MA  (in  Abstracts 
Volume). 

Abstract.  Evidence  has  been  accumulating  that  titanium  dioxide  (Ti02)  has  been  employed  in  increasing  number  of 
a  variety  of  industrial  applications  including,  but  not  limited  to,  production  of  paper,  plastics,  cosmetics  and  paints. 
Because  many  of  such  applications  require  fine  grade  or  dust  of  Ti02,  that  requirement  strongly  imply  that 
significant  amounts  of  Ti02  employed  in  the  applications  are  in  the  form  of  micro-  and  nanoparticles.  Thus,  these 
ever-increasing  applications  of  Ti02  in  diverse  industries  raise  the  distinct  possibility  of  elevating  the  occupational 
and  other  environmental  exposure  of  Ti02  micro-  and  nanoparticles  to  humans  and  other  species.  Nevertheless,  the 
health  impact  of  exposure  to  Ti02  nanoparticles  has  not  been  fully  assessed  despite  recent  evidence  suggesting  that 
such  exposure  induces  inflammatory  responses  in  lung  tissue  and  cells. 

In  a  recent  study,  we  have  demonstrated  that  treatment  with  Ti02  micro-  or  nanoparticles  induce  cell  death  in  human 
astrocytes -like  U87  astrocytoma  cells  and  in  normal  human  fibroblasts  in  a  concentration-related  manner.  In 
particular,  these  particles  appeared  to  induce  in  U87  cells  a  cell  death  mode  that  exhibited  both  the  characteristics  of 
apoptosis  and  necrosis.  Thus,  our  earlier  findings  suggest  both  Ti02  micro-  and  nanoparticles  may  post  health 
hazards  to  humans  when  exposed  to  them.  Moreover,  our  previous  study  constituted  part  of  a  systematic  program  of 
developing  cell  models  in  vitro  consisting  of  the  astrocytes -like  U87  astrocytoma  and  neurons-like  SK-N-SH 
neuroblastom  cells  to  elucidate  the  putative  cytotoxicity  of  nanomaterials,  including  nanoparticles. 

Our  previous  findings  in  human  neural  cells  derived  from  the  central  nervous  system  also  prompted  us  to  consider 
the  distinct  possibility  that  exposure  of  neural  cells  derived  from  the  peripheral  nervous  system  (PNS)  to 
nanomaterials  such  as  metallic  and  non-metallic  oxide  nanoparticles  may  induce  cytotoxicity  in  PNS  neural  cells. 
However,  such  effects  in  the  PNS  neural  cells  have  not  been  reportedly  studied.  We  have,  therefore,  developed  two 
PNS  neural  cell  models  in  vitro  consisting  of  dorsal  root  ganglion  (DRG)  neurons  and  Schwann  cells  to  allow  the 
systematic  investigation  of  cytotoxicity  of  such  nanoparticles  in  PNS  neural  cells. 

Our  on-going  studies  indicate  that  treatment  with  Ti02  nanoparticles  induced  differential  cytotoxic  effects  on  DRG 
neurons  and  Schwann  cells.  Treatment  with  the  nanoparticles  lowered  the  survival  of  both  DRG  neurons  and 
Schwann  cells  in  a  dose-  and  time -related  manner.  Moreover,  we  found  that  DRG  neurons  were  more  sensitive  to 
the  effect  of  the  nanoparticles  than  Schwann  cells.  Other  studies  are  in  progress  to  further  characterize  such  effects 
of  the  nanoparticles.  Thus,  our  findings  may  have  pathophysiological  implications  in  the  impact  of  exposure  to  Ti02 
nanoparticles  on  the  structure  and  function  of  the  PNS. 

20.  Wong  YYW,  Jaiswal  AR,  Dukhande  VV,  Bhushan  A,  Leung  SW  &  Lai  JCK  (2011)  New  In  Vitro  Strategy 
of  Astrocytoma  (Astrocytes -like)  Cells  Treated  with  Pioglitazone  (PPAR  gamma  agoinst)  Offers  Neuroprotection 
Against  Nanoparticle-Induced  Cytotoxity.  NSTI  Nanotechnology  Conference  and  Expo  -  Nanotech  2011,  June  13- 
16,  2011,  Boston,  MA  (in  Abstracts  Volume). 

Abstract.  Among  in  vitro  cell  culture  models,  co-cultures  gained  attention  with  accumulating  evidence 
showing  their  capacity  for  high  throughput  studies  and  mechanistic  investigation  in  tissue  engineering  research. 
Recently,  we  and  others  have  developed  several  cell  models  for  the  investigation  of  the  molecular  mechanisms 
underlying  the  cytotoxicity  of  nanoparticles  of  several  metallic  and  non-metallic  oxides.  These  important  findings 
have  raised  the  awareness  for  the  need  to  derive  a  set  of  strategies  whereby  critical  mammalian  cell  types  (e.g., 
neural  cells)  can  be  protected  from  the  cytotoxicity  induced  by  nanoparticles  and  other  nanomaterials. 


As  part  of  our  response  to  the  need  to  devise  a  strategy  to  protect  critical  cell  types  against  the  cytotoxicity 
induced  by  nanomaterials,  we  have  continued  to  develop  cell  models  in  vitro  to  further  elucidate  and  exploit  the 
putative  neuroprotective  properties  of  astrocytes -like  astrocytoma  cells.  Previously,  we  demonstrated  the 
neuroprotection  offered  by  astrocytoma  cells  to  neuroblastma  cells  in  the  direct  co -culture  milieu.  For  example,  we 
have  shown  U-87  (astrocytes-like)  astrocytoma  cells  confer  protection  to  SK-N-SH  (neurons -like)  neuroblastoma 
cells  against  several  pathophysiological  assaults  such  as  oxidative  stress  induced  by  depletion  of  cellular  glutathione 
and  inhibition  of  glycolysis  mediated  by  idoacetate  or  3-bromopyruvate. 

Apart  from  the  protection  against  pathophysiological  assaults,  we  have  also  demonstrated  that  the  addition 
of  peroxisome  proliferator-activated  receptor-gamma  agonist  pioglitazone  in  the  culture  medium  can  amplify  the 
neuroprotective  properties  of  astrocytoma  cells  conferred  on  SK-N-SH  cells  against  manganese  toxicity.  This  study 
aims  to  further  determine  and  identify  the  neuroprotective  properties  of  astrocytes  conferred  on  neurons  employing  a 
novel  in  vitro  co-culture  model. 

U87  astrocytoma  and  SK-N-SH  neuroblastoma  cells  have  been  shown  to  constitute  good  model  systems  in  vitro  for 
astrocytes  and  neurons  due  to  their  close  functional  resemblance  to  normal  astrocytes  and  neurons,  respectively. 
Based  on  the  results  of  our  previous  studies,  the  present  studies  have  tested  the  hypothesis  that  nanoparticle -induced 
cytotoxic  stress  can  elicit  and/or  enhance  the  neuroprotective  effects  of  astrocytes  through  the  activation  of 
astrocytic  signaling  and  alteration  of  astroglial  function.  Furthermore,  the  neuroprotection  can  be  enhanced  in  the 
presence  of  pioglitazone.  Thus,  our  results  may  have  pathophysiological  implications  in  neuroprotection  research 
but  also  implication  and  application  in  nanotoxicological  research. 

21.  Jain  A,  Jaiswal  AR,  Lu  S,  Wong  YYW,  Bhushan  A,  Leung  SW,  Daniels  CK  &  Lai  JCK  (201 1)  Molecular 
Effects  of  Silicon  Dioxide  Nanoparticles  on  Cell  Survival  Signaling  of  Dorsal  Root  Ganglion  (DRG) 
Neurons  and  Schwann  Cells.  NSTI  Nanotechnology  Conference  and  Expo  -  Nanotech  2011,  June  13-16, 
2011,  Boston,  MA  (in  Abstracts  Volume). 

Abstract.  Dorsal  root  ganglion  (DRG)  neurons  of  the  peripheral  nervous  system  (PNS)  become  damaged 
in  diabetic  and  other  forms  of  neuropathy:  the  pathophysiological  changes  can  induce  a  variety  of  major  and  minor 
complications  in  patients  with  such  neuropathies.  The  molecular  mechanisms  underlying  the  pathophysiology  of 
peripheral  neuropathies  have  not  been  fully  elucidated  and,  in  many  cases,  have  yet  to  be  determined.  Our  limited 
understanding  of  such  pathophysiological  mechanisms  in  molecular  terms  is  largely  attributable  to  (i)  the  inherent 
limitation  of  animal  models  in  vivo  and  their  inaccessibility  to  mechanistic  probing  and  (ii)  the  limited  life-span  of 
primary  culture  models  of  DRG  neurons  and  Schwann  cells  in  vitro  rendering  them  unsuitable  for  more  chronic 
studies. 

To  meet  the  need  for  suitable  cell  culture  models  in  vitro  of  PNS  neural  cells  that  allow  long-term  studies, 
we  have  developed  unique  PNS  neural  cell  culture  models  in  vitro  consisting  of  immortalized  DRG  neurons  and 
Schwann  cells.  Schwann  cells  are  oligodendroglial  cells  of  the  PNS  and  function  to  nourish  and  protect  DRG 
neurons  in  vivo.  They  surround  DRG  neurons  and  this  interaction  is  important  in  protecting  the  neurons  from 
degeneration.  Our  previous  and  on-going  studies  strongly  suggest  that  our  PNS  neural  cell  models  constitute  good 
model  systems  and  allow  the  probing  of  molecular  mechanisms  underlying  peripheral  nerve  damage  and 
dysfunction  consequent  to  diabetic  neuropathy,  and  chemically -induced  peripheral  neuropathy. 

In  our  previous  studies  we  found  that  silicon  dioxide  (Si02)  nanoparticles  induce  differential  cytotoxic 
effects  in  neurons-like  SK-N-SH  neuroblastoma  and  astrocytes -like  U87  astrocytoma  cells.  However,  the  putative 
cytotoxicity  of  Si02  nanoparticles  in  neural  cells  derived  from  the  PNS  is  unknown.  Thus,  a  systematic  investigation 
of  the  putative  cytotoxicity  of  Si02  nanoparticles  in  PNS  neural  cells  not  only  will  elucidate  how  exposure  to  such 
nanoparticles  may  impact  on  the  structure  and  function  of  the  PNS  but  also  will  shed  light  on  pathophysiological 
and  related  molecular  mechanisms  underlying  chemically -induced  peripheral  neuropathy.  Therefore,  we 
hypothesized  that  Si02  nanoparticles  induce  differential  cytotoxicity  in  DRG  neurons  and  Schwann  cells. 

Because  little  is  known  regarding  the  cell  survival  signaling  in  both  DRG  neurons  and  Schwann  cells, 
especially  when  cultured  in  vitro,  we  have  determined  the  expression  of  proteins  involved  in  cell  survival  in  these 
two  cell  models  and  the  effects  of  treatment  with  Si02  nanoparticles  thereon.  Results  of  our  on-going  studies  show 
that  both  cultured  DRG  neurons  and  Schwann  cells  express  detectable  levels  of  ERK  and  p-ERK,  which  are 
signaling  proteins  known  to  be  important  in  regulating  cell  survival/proliferation.  Moreover,  exposure  of  the  two 
PNS  neural  cell  types  to  Si02  nanoparticles  (1,  25,  50  pg/mL)  for  48  hours  induced  alterations  in  their  expression  of 


p-ERK.  Other  studies  are  in  progress  to  determine  the  effects  of  the  nanoparticles  on  cell  survival  signaling 
mechanisms  other  than  ERK. 

Our  results  suggest  one  mechanism  underlying  the  cytotoxicity  of  Si02  nanoparticles  in  PNS  neural  cell  types  may 
be  via  disturbing  their  cell  survival  signaling.  These  findings  have  functional  and  pathophysiological  implications  in 
cell  survival  signaling  in  PNS  neural  cells  and  in  chemically-induced  peripheral  neuropathy. 


22.  Lai  JCK,  Gao  W  &  Leung  SW  (2011)  Effects  of  Chitosan  and  Nanoparticles  on  Survival  of  Schwann  Cells 
and  Dorsal  Root  Ganglion  Neurons.  NSTI  Nanotechnology  Conference  and  Expo  -  Nanotech  2011,  June  13-16, 
2011,  Boston,  MA  (in  Abstracts  Volume). 

Abstract.  Ideally,  a  promising  alternative  for  the  repair  of  substantive  peripheral  nerve  injuries  is  the 
bioartificial  nerve  graft,  comprised  of  biocompatible  materials  pre-seeded  with  neuronal  supporting  cells,  such  as 
Schwann  cells.  In  practice,  the  optimal  bioartificial  nerve  graft  has  yet  to  be  realized.  Nevertheless,  several  groups  of 
biocompatible  materials  have  been  tested  for  their  suitability  for  fabricating  the  bioartificial  nerve  graft.  In  this 
context,  chitosan  has  been  studied  as  a  candidate  material  for  nerve  regeneration  due  to  its  biocompatible  nature. 
Additionally,  nanometal  particles,  which  are  known  to  exert  certain  beneficial  effects  not  previously  expected  on 
biological  systems,  are  also  introduced  into  the  construct  and/or  modification  of  the  bioartificial  nerve  graft. 

Schwann  cells  play  key  roles  in  development  and  regeneration  of  peripheral  neurons.  However,  the 
molecular  mechanisms  underlying  these  functional  roles  of  Schwann  cells  are  poorly  understood.  Because  current 
cell  models  for  investigating  the  mechanisms  underlying  nerve  degeneration  and  regeneration  have  significant 
limitations  because  such  models  involve  primary  cultures  of  peripheral  nervous  system  (PNS)  neural  cells  that  have 
very  limited  life-span.  Consequently,  to  overcome  such  limitations,  we  have  employed  immortalized  Schwann  cells 
(SI 6)  and  dorsal  root  ganglion  (DRG)  neurons  (50  B  11)  to  develop  PNS  neural  cell  models  in  vitro  suitable  for 
nerve  degeneration  and  regeneration  studies.  Results  of  our  on-going  studies  strongly  suggest  that  our  cell  models 
are  suitable  and  can  be  employed  to  attain  such  a  goal. 

Because  chitosan  has  been  considered  as  having  the  potential  to  be  a  candidate  material  suitable  for 
application  in  nerve  regeneration,  we  have  set  out  to  test  the  hypothesis  that  chitosan  in  combination  with  nanometal 
particles  can  be  a  platform  for  further  developing  the  ideal  bioartificial  nerve  graft  as  the  effects  of  chitosan  or 
nanometal  particles  on  PNS  neural  cells  are  largely  unknown. 

We  have  therefore  systematically  examined  the  effects  of  chitosan  film  or  chitosan  in  combination  with 
nanometal  particles  (nanogold  or  nanosilver  particles)  on  the  growth  of  Schwann  cells  (SI 6)  and  DRG  neurons  (50 
B  11).  Results  of  our  on-going  studies  strongly  suggest  that  chitosan  and  chitosan  in  combination  with  nanogold 
particles  have  no  effects  on  the  growth  kinetics  of  Schwann  cells.  However,  chitosan,  and  in  particular,  chitosan  in 
combination  with  nanogold  appeared  to  exert  a  small  negative  impact  on  the  growth  kinetics  of  DRG  neurons.  These 
findings  suggest  that  chitosan  and  chitosan  in  combination  with  nanogold  particles  are  more  biocompatible  with 
Schwann  cells  than  with  DRG  neurons.  On  the  other  hand,  chitosan  in  combination  with  nanosilver  particles 
depressed  the  growth  kinetics  of  both  Schwann  cells  and  DRG  neurons.  Thus,  in  the  context  of  this  type  of 
application,  nanosilver  particles  are  much  less  biocompatible  compared  to  nanogold  particles.  Consequently,  our 
results  suggest  that  chitosan  film  and  chitosan  in  combination  with  nanogold  particles  may  have  significant  potential 
to  be  further  developed  as  suitable  biocompatible  materials  for  the  fabrication  of  the  ideal  bioartificial  nerve  graft. 
Clearly,  this  is  an  interesting  “tissue  engineering  problem”  for  further  investigation. 
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Differential  Cytotoxicity  of  Silicon  Dioxide  Nanoparticles  on  Neural  Cells  Derived  from  Peripheral  Nervous 
System.  International  Conference  on  Materials  for  Advanced  Technologies,  Suntec,  June  26-July  1,  2011,  Singapore 
(in  Abstracts  Volume). 


Abstract. 


Introduction. 

Nanomaterials,  including  nanoparticles,  have  been  increasingly  employed  in  a  variety  of  industries:  thus,  their 
accelerating  industrial  applications  raise  some  concerns  regarding  health  risks  due  to  occupational  and/or  other 
environmental  exposure  to  these  materials.  Nevertheless,  the  putative  environmental  toxicity  of  nanmaterials  is 
unknown  [1,2].  There  is  increasing  evidence  that  cell  model  systems  in  vitro  facilitate  the  high  through-put 
screening  of  putative  toxicity  of  a  variety  of  nanomaterials,  including  nanoparticles,  although  the  use  of  neural  cell 
types  in  such  studies  have  been  extremely  limited  [1,2].  We  have  developed  several  human  neural  cell  models  (e.g., 
the  astrocytes -like  U87  astrocytoma  and  neurons-like  SK-N-SH  neuroblastom  cells)  to  systematically  investigate  the 
putative  cytotoxicity  of  metallic  and  non-metallic  oxide  nanoparticles  [1,2].  Employing  the  models,  we  found  the 
nanoparticles  of  several  metallic  and  non-metallic  oxides,  including  Si02,  exerted  differential  cytotoxic  effects  on 
U87  and  SK-N-SH  cells  [1,2].  Because  the  putative  cytotoxicity  of  these  nanoparticles  on  neural  cells  derived  from 
the  peripheral  nervous  system  (PNS)  is  unknown,  we  have  developed  two  neural  cell  models  derived  from  the  PNS, 
namely  dorsal  root  ganglion  (DRG)  neurons  and  Schwann  cells  and  employed  them  to  systematically  investigate  the 
putative  cytotoxicity  of  nanoparticles  of  several  metallic  and  non-metallic  oxides  [3]. 

Materials  and  Methods. 

DRG  neurons  and  Schwann  cells  were  cultured  as  previously  described  [3].  Both  types  were  treated  with  Si02 
nanoparticles  at  specified  concentrations  at  37°C  for  36  hours.  Then  the  survival  of  the  treated  and  untreated  (i.e., 
control)  cells  were  determined  by  the  MTT  assay  as  previously  described  [3]. 

Results  and  Discussion. 

Results  of  our  ongoing  studies  strongly  suggest  that  treatment  with  Si02  nanoparticles  (1  to  200  pg/mL)  exerted 
differential  cytotoxic  effects  on  PNS  neural  cells  and  that  Schwann  cells,  which  are  prominent  glial  cells  of  the  PNS, 
were  more  susceptible  than  DRG  neurons  to  the  effect  of  Si02  nanoparticles.  That  Schwann  cells  are  susceptible  to 
the  cytoxicity  of  Si02  nanoparticles  is  consistent  with  our  previous  finding  that  these  nanoparticles  also  exert 
cytotoxicity  on  U87  astrocytoma  (astrocytes -like)  cells  [2]. 

In  studies  employing  the  flow  cytometry,  we  noted  the  cytotoxicity  of  Si02  nanoparticles  in  the  two  cell  models  in 
vitro  could  be  attributed,  at  least  in  part,  to  cellular  uptake  of  the  nanoparticles. 

Our  results  strongly  suggest  that  the  DRG  neurons  and  Schwann  cells  constitute  excellent  cell  model  systems  in 
vitro  for  high-throughput  screen  of  cytotoxicity  of  nanoparticles  in  PNS  neural  cells.  Furthermore,  our  results  may 
have  pathophysiological  implications  in  how  exposure  to  Si02  nanoparticles  impacts  on  the  structure  and  function  of 
the  peripheral  nervous  system. 
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Technologies,  Suntec,  June  26-July  1,  2011,  Singapore  (in  Abstracts  Volume). 

Abstract.  Chitosan  has  been  investigated  as  a  candidate  material  for  nerve  regeneration  applications  due  to  its 


biocompatible  nature.  On  the  other  hand,  nanometal  particles,  which  are  known  to  exert  certain  beneficial  effects  not 
previously  expected  on  biological  systems,  are  also  considered  as  part  of  the  composite  material  for  the  construct 
and/or  modification  of  the  bioartificial  nerve  graft.  Nevertheless,  how  these  putatively  biocompatible  materials  may 
interact  with  the  neural  cell  types  derived  from  the  peripheral  nervous  system  (PNS)  is  largely  unknown  because  of 
the  lack  of  appropriate  cell  models.  Consequently,  to  overcome  such  limitations,  we  have  employed  immortalized 
Schwann  cells  (SI 6)  and  dorsal  root  ganglion  (DRG)  neurons  (50  B  11)  to  develop  PNS  neural  cell  models  in  vitro. 
Results  of  our  on-going  studies  strongly  suggest  our  cell  models  are  suitable  for  a  variety  of  tissue  engineering 
applications,  especially  in  the  in  vitro  setting.  We  have  therefore  systematically  investigated  the  effects  of  chitosan 
film  or  chitosan  in  combination  with  nanometal  particles  (nanogold  or  nanosilver  particles)  on  the  growth  of 
Schwann  cells  (S16)  and  DRG  neurons  (50  B  11).  Our  results  demonstrated  chitosan  and  chitosan  in  combination 
with  nanogold  particles  exerted  no  effects  on  the  growth  kinetics  of  Schwann  cells.  However,  chitosan,  and  in 
particular,  chitosan  in  combination  with  nanogold  appeared  to  mildly  inhibit  the  growth  kinetics  of  DRG  neurons. 
These  findings  indicate  chitosan  and  chitosan  in  combination  with  nanogold  particles  are  more  biocompatible  with 
Schwann  cells  than  with  DRG  neurons.  By  contrast,  chitosan  in  combination  with  nanosilver  particles  depressed  the 
growth  kinetics  of  both  Schwann  cells  and  DRG  neurons.  Consequently,  our  results  prompted  us  to  conclude  that 
chitosan  film  and  chitosan  in  combination  with  nanogold  particles  may  have  significant  potential  to  be  further 
developed  as  suitable  biocompatible  materials  for  fabricating  the  ideal  bioartificial  nerve  graft. 


25.  Leung  SW,  Chan  A,  Minsk!  M  &  Lai  JCK  (201 1)  Comparison  of  Elemental  Distribution  in  Rat’s  Brain 
after  Lifelong  Treatment  with  Excessive  Mn^"^  in  Drinking  Water  and  the  Health  Implications.  International  Water 
Convention,  July  4-8,  2011,  Singapore  (Abstract  #  IWA-6218-R1). 

Abstract.  Lifelong  exposure  to  environmental  factors  can  influence  the  risk  of  developing  diseases;  environmental 
stresses  can  ultimately  lead  to  cell  death  and  have  been  thought  to  be  the  cause  of  many  neurological  diseases.  Our 
daily  diet  is  one  of  the  important  environmental  factors  that  can  seriously  affect  the  development  and  proper 
function  of  the  brain.  In  this  study,  we  investigated  how  30  elements  and  electrolytes  that  were  consumed  in  a 
regular  diet  over  a  lifetime  would  affect  the  distribution  of  these  elements  in  the  brain  of  rats.  We  also  investigated 
how  excessive  concentrations  of  contaminant  in  drinking  water,  such  as  Mn,  may  affect  the  accumulation  of 
elements  in  the  brain.  Our  results  indicated  that  increased  consumption  of  Mn  would  enhance  the  retention  of  heavy 
metals  such  Hg  and  Se  in  the  brain  and  is  believed  to  be  pivotal  in  many  neurological  disorders  such  as  Parkinson’s 
and  Alzheimer’s  disease. 


26.  Leung  SW,  Chan  A,  Minsk!  M  &  Lai  JCK  (201 1)  Effects  of  Lifetime  Consumption  of  Excessive  Mn^'^  in 
Drinking  Water  to  Elemental  Distribution  in  Vital  Organs.  International  Water  Convention,  July  4-8,  2011, 
Singapore  (Abstract  #IWA-6243). 

Abstract.  Diet  is  one  of  the  major  environmental  factors  that  can  have  serious  effect  on  our  well-being  in  health. 
The  knowledge  of  how  elements  and  electrolytes  are  accumulated  in  our  body  through  diet  ingestion  is  not  well 
understood,  especially  over  a  prolonged  period.  A  recent  study  has  shown  that  a  cancer  patient  was  having 
intracellular  heavy  metal  accumulations  within  lymph  nodes,  bone  marrow,  and  liver.  In  this  study,  we  investigated 
the  distributions  of  30  metals  and  electrolytes  that  were  consumed  in  a  regular  diet  over  a  lifetime  in  liver,  lung, 
heart,  spleen,  and  kidney  of  healthy  adult  rats;  we  further  compared  the  elemental  distributions  in  these  vital  organs 
with  aged  rats  that  were  treated  with  excessive  Mn^"^  in  the  drinking  water.  Our  results  showed  that  there  were 
differences  in  elemental  accumulations  with  age,  the  differences  were  element  and  organ  specific.  Prolonged 
consumption  of  excessive  Mn^'^  also  affected  elemental  accumulations  within  organs. 


27.  Wright  GL,  Lai  JCK,  Chan  A,  Minski  M  &  Leung  SW  (2011)  Influence  of  Metallomic  Distribution  in 
Brain  by  Prolong  Consumption  of  Contaminant  in  Drinking  Water.  International  Water  Convention,  July  4-8,  2011, 
Singapore  (Abstract  #IWA-6228R1). 


Abstract.  Lifelong  exposure  to  environmental  factors  can  influence  the  risk  of  developing  diseases;  environmental 
stresses  can  ultimately  lead  to  cell  death  and  have  been  thought  to  be  the  cause  of  many  neurological  diseases.  Our 
daily  diet  is  one  of  the  important  environmental  factors  that  can  seriously  affect  the  development  and  proper 
function  of  the  brain.  In  this  study,  we  investigated  how  30  elements  and  electrolytes  that  were  consumed  in  a 
regular  diet  over  a  lifetime  would  affect  the  distribution  of  these  elements  in  seven  regions  of  the  brain  of  rats.  We 
also  investigated  how  excessive  concentrations  of  contaminant  in  drinking  water,  such  as  Mn,  may  affect  the 
accumulation  of  elements  in  the  brain.  Our  results  indicated  that  increased  consumption  of  Mn  would  enhance  the 
retention  of  heavy  metals  such  Hg  and  Se  in  the  brain  that  is  believed  to  be  pivotal  in  many  neurological  disorders 
such  as  Parkinson’s  and  Alzheimer’s  disease. 


28.  Jaiswal  AR,  Lu  S,  Bhushan  A,  Daniels  CK,  Leung  SW,  Lai  JC  (2011)  Silicon  Dioxide  Nanoparticles 
Induce  Mitochondria-Mediated  Cell  Damage  in  Peripheral  Neural  Cells.  Annual  Meeting,  Society  for  Neuroscience, 
November,  2011,  Washington,  DC  (in  Abstracts  Volume). 

Abstract.  The  diverse  applications  of  nanoparticles  in  many  fields  have  been  increasing  exponentially  in 
the  last  decade.  Once  they  enter  the  body  by  inhalation  or  other  routes,  nanoparticles  may  be  toxic  to  one  or  more 
organ  systems:  thus,  exposure  to  these  nanoparticles  may  induce  health  hazards.  Nevertheless,  the  effects  of  their 
exposure  on  the  nervous  system  have  not  been  elucidated.  We  have  therefore  initiated  systematic  studies  to  elucidate 
the  putative  cytotoxicity  of  nanoparticles  on  peripheral  nervous  system,  employing  in  vitro  cell  models  consisting  of 
Schwann  cells  and  dorsal  root  ganglion  (DRG)  neurons.  We  have  examined  the  effects  of  silicon  dioxide 
naoparticles  on  DRG  neurons  and  Schwann  cells.  The  results  from  our  ongoing  studies  demonstrate  that  treatment  of 
DRG  neurons  and  Schwann  cells  with  silicon  dioxide  nanoparticles  induced  a  decrease  in  cell  survival  and  increase 
in  lactate  dehydrogenase  release  from  cells.  The  treatment  also  induced  oxidative  stress  and  altered  mitochondrial 
genome  function.  The  results  from  flow  cytometry  and  microscopy  suggest  there  is  internalization  of  the 
nanoparticles  by  Schwann  cells.  Thus,  results  of  our  ongoing  studies  indicate  silicon  dioxide  nanoparticles  induce 
cytotoxicity  in  neural  cells  of  the  peripheral  nervous  system  and  as  such  may  assume  pathophysiological 
importance. 

29. Assan  D,  Gao  X,  Lai  JCK  &  Leung  SW  (2012)  Characterization  of  High  Performance  Sensors  Modified  with 
Nanoparticles  and  Different  Enzyme  Couplings.  Idaho  Academy  of  Science  54*  Annual  Symposium,  March  22-24, 
2012,  University  Place,  Idaho  Falls,  ID  (in  Abstracts  volume,  p.  9). 

Abstract.  The  idea  of  directly  coupled  enzyme  electrodes  to  measure  low  concentrations  of  specific  chemical 
species,  such  as  glucose  and  peroxide,  has  existed  for  decades.  The  recent  euphoria  of  nanotechnology  has  elevated 
the  development  of  these  fourth  generation  bionanosensors  to  another  horizon  by  using  highly  modified  direct 
enzyme-electrode  couplings  with  nanoparticles.  These  bionanosensors  can  detect  target  species  below  parts  per 
billion  (ppb)  almost  instantly. 

In  our  research  group,  we  investigated  the  performance  of  electrode  sensors  fabricated  with  different 
biocomposite  materials,  including  the  coupling  enzyme  for  a  specific  target  chemical;  this  chemical  can  be  organic 
or  inorganic,  such  as  a  metabolite,  biomarker,  or  environmental  pollutant.  Materials  for  the  biocomposite  layer 
consist  of  polymers,  metal  nanoparticles,  and  enzyme  for  the  coupling  reaction  which  enables  the  high  sensitivity  of 
detection. 

In  this  report,  LDH  (Lactate  dehydrogenase),  GDH  (Glutamate  dehydrogenase),  and  Hemoglobin  were  the 
enzymes  used  to  fabricate  these  high  performance  electrode  sensors.  Various  metabolites  and  environmental 
pollutants  were  used  to  characterize  the  selectivity  and  sensitivity  of  these  sensors  at  pH  7.0.  Concentration  levels 
down  to  lO'^^M  were  tested. 


30.  VK  Idikuda,  Jaiswal  AR,  Wong  YYW,  Bhushan  A,  Leung  SW  &  Lai  JCK  (2012)  Magnesium  Oxide 
Nanoparticles  Induce  Stat-3  Mediated  Apoptosis  in  Schwann  Cells.  Idaho  Academy  of  Science  54*  Annual 
Symposium,  March  22-24,  2012,  University  Place,  Idaho  Falls,  ID  (in  Abstracts  volume,  p.  16). 

Abstract.  Abstract.  Diverse  applications  of  metal  oxide  nanoparticles  in  various  industries  have  been  accelerating  in 
the  last  decade.  Magnesium  oxide  (MgO)  nanoparticles  have  been  employed  in  ceramics,  and  as  adhesive  and 
additive  in  chemical  raw  materials,  leading  to  their  increased  human  exposure,  thereby  posing  potential  health 
hazards.  Because  cytotoxicity  of  MgO  nanoparticles  in  neural  cells  derived  from  the  peripheral  nervous  system  is 
unknown,  we  have  investigated  the  effects  of  MgO  nanoparticles  on  Schwann  cells.  Our  results  indicated  treatment 
with  MgO  for  24  hours  induced  dose-related  cytotoxicity  in  Schwann  cells.  Moreover,  such  treatment  also  induced 
distinct  morphological  changes  in  Schwann  cells  leading  us  to  investigate  the  hypothesis  that  these  nanoparticles 
elicit  inflammatory  responses  in  Schwann  cells.  Consistent  with  this  hypothesis  was  ur  finding  that  the  nanoparticles 
induced  enhanced  expression  of  cytokines  such  as  IL-6  and  PPAR  gamma.  We  then  investigated  the  mode  of  cell 
death  in  Schwann  cells;  our  preliminary  results  show  that  the  cells  undergo  Stat3  mediated  apoptosis  48  hours  after 
treatment  with  the  MgO  nanoparticles.  Thus,  our  finding  may  have  pathophysiological  implications  in  toxicity  of 
MgO  nanoparticles  in  neural  cells  derived  from  the  peripheral  nervous  system. 

31.  Gao  W,  Lai  JCK,  Bhushan  A  &  Leung  SW  (2012)  Cytotoxic  Effects  of  Short  Multi -Wall  Carbon  Nanotubes  in 
Dorsal  Root  Ganglion  (DRG)  Neurons.  Idaho  Academy  of  Science  54th  Annual  Symposium,  March  22-24,  2012, 
University  Place,  Idaho  Falls,  ID  (in  Abstracts  volume,  p.  29). 

Abstract.  Carbon  nanotubes  (CNTs)  have  found  their  way  into  diverse  industrial  and  biomedical 
applications  due  to  their  unique  physico-chemical  properties.  Their  escalating  uses  in  industries  result  in  enhanced 
occupational  human  exposure  to  CNTs.  However,  the  human  health  hazard  of  exposure  to  CNTs  has  not  been 
assessed.  Furthermore,  the  effects  of  CNTs  on  the  nervous  system  and/or  neural  cells  are  virtually  unknown.  In  this 
study,  we  have  investigated  the  putative  cytotoxic  effects  of  both  funtionalized  (i.e.,  carboxylated  and  hydroxylated) 
and  non-functionalized  short  multi-wall  carbon  nanotubes  (SMWCNTs)  on  dorsal  root  ganglion  (DRG)  neurons,  an 
excellent  model  in  vitro  of  neurons  derived  from  the  peripheral  nervous  system  (PNS).  We  found  that  SMWCNTs 
induced  concentration-related  decreases  in  survival  and  growth  of  DRG  neurons,  the  non-functionalized  ones  being 
more  cytotoxic  than  the  functionalized  ones,  especially  at  the  higher  concentrations.  Treatment  of  DRG  neurons 
with  non-functionalized  SMWCNTs  induced  necrotic  damage  and/or  cell  death  in  the  neurons  and  decreased  their 
expression  of  phospho-Akt.  Thus,  our  results  may  have  pathophysiological  implications  in  how  exposure  to 
SMWCNTs  impacts  on  the  structure  and  function  of  the  PNS. 

32. Gao  X,  Assan  D,  Lai  JCK  &  Leung  SW  (2012)  Highly  Modified  Pt  Electrode  Sensor  and  Comparison  of 
Performance  of  the  Electrode  with  Other  Sensors  Made  with  Different  Anchoring  Materials.  Idaho  Academy  of 
Science  54th  Annual  Symposium,  March  22-24,  2012,  University  Place,  Idaho  Falls,  ID  (in  Abstracts  volume,  p. 

29). 


Abstract.  In  our  research  group,  we  are  developing  high  performance  biosensors  that  are  based  on 
electrodes  modified  with  sol-gel  nanoparticles  that  bind  with  different  enzymes  which  can  couple  with  different 
redox  species  for  the  enzymatic  reactions.  Depending  on  the  enzymes,  the  corresponding  enzymatic  reactions  are 
very  selective  and  sensitive;  in  recent  development,  the  detection  is  almost  instantaneous. 

In  previous  studies,  we  reported  the  performance  of  electrode  sensors  that  were  fabricated  with  non-toxic 
biocomposite  materials  anchored  on  various  conductive  materials.  The  biocomposite  materials  are  layers  of 
polymer(s),  nanoparticles,  and  enzyme(s)  that  are  self-assembled  on  the  surface  of  the  conductive  anchor;  the 
anchoring  materials  are  Ag,  Au,  and  glassy  carbon.  Aside  from  the  variations  of  the  biocomposite  layers, 
performance  of  the  electrode  and  the  linking  layer  (linker)  connecting  between  the  electrode  surface  and  the 
enzyme(s)  where  redox  reactions  take  place. 

In  this  study,  we  investigated  the  performance  of  an  electrode  sensor  consisted  of  the  identical  composite 
biomaterial  as  previously  reported  but  was  anchored  with  Pt.  Characteristic  peaks  that  can  be  used  for  speciation 
detection  were  identified.  Performance  of  the  electrode  sensor  was  optimized  and  compared  with  other  electrode 


sensors. 


33.Lu  S,  Bhushan  A,  Leung  SW,  Daniels  CK  &  Lai  JCK  (2012)  Cytotoxic  Effects  of  Four  Metallic  Oxide 
Nanoparticles  on  Dorsal  Root  Ganglion  (DRG)  Neurons.  Idaho  Academy  of  Science  54th  Annual  Symposium, 
March  22-24,  2012,  University  Place,  Idaho  Falls,  ID  (in  Abstracts  volume,  p.  34). 

Abstract.  Metallic  oxide  nanoparticles  are  extensively  used  in  diverse  industries  due  to  their  unusual  but  exploitable 
physico-chemical  properties.  Consequently,  the  environmental  exposure  of  humans  to  these  nanoparticles  is 
accelerating.  However,  the  health  impact  of  exposure  to  such  nanoparticles  are  poorly  understood.  We  found 
nanoparticles  of  several  metallic  and  non-metallic  oxides  exerted  differential  cytotoxic  effects  on  human  U87 
astrocytoma  and  SK-N-SH  neuroblastoma  cells.  Because  such  effects  in  neural  cells  from  the  peripheral  nervous 
system  (PNS)  are  unknown,  we  developed  PNS  neural  cell  models  in  vitro  —  dorsal  root  ganglion  (DRG)  neurons 
and  Schwann  cells  —  to  investigate  such  effects.  Our  results  suggested  that  the  nanoparitcles  investigated  induced 
concentration-  and  time -related  decreases  in  survival  of  DRG  neurons  and  they  exerted  differential  effects  on  their 
expression  of  p-AKT  and  p-ERK.  Thus,  our  findings  may  have  pathophysiological  implications  in  the  impact  of 
exposure  to  such  nanoparticles  on  the  PNS. 


34.  Zhang  Y,  Agharkar  V,  Lai  JCK,  Daniels  CK,  Leung  SW  &  Bhushan  A  (2012)  Short  Multi-Wall  Carbon 
Nanotubes  Induce  Cytotoxicity  on  Pancreatic  Cancer.  Idaho  Academy  of  Science  54th  Annual  Symposium,  March 
22-24,  2012,  University  Place,  Idaho  Falls,  ID  (in  Abstracts  volume,  p.  38). 

Abstract.  Pancreatic  cancer  is  one  of  the  most  aggressive  types  of  cancers  with  poor  prognosis  and  low  survival 
rate.  Thus,  it  is  imperative  to  find  effective  treatments  for  this  cancer.  Carbon  nanotubes  (CNTs)  constitute  one 
novel  and  important  nanomaterial  extensively  investigated  for  potential  biomedical  applications.  Previous  studies 
have  shown  that  CNTs  could  be  utilized  as  drug  delivery  vehicles  and  diagnostic  agents.  In  our  laboratory,  we  have 
shown  that  short  multi- wall  carbon  nanotubes  (SMWCNTs)  can  induce  cytotoxicity  on  several  cancers.  SMWCNTs 
treatments  induced  decreased  expression  of  signaling  proteins  associated  with  cancer  cell  survival  and/or 
proliferation.  However,  the  putative  cytotoxicity  of  SMWCNTs  on  pancreatic  cancer  is  unknown.  Thus,  we 
hypothesized  that  SMWCNTs  can  induce  cytotoxicity  on  PANCl  cells  in  a  dose-related  manner  employing  cell 
survival  assays.  Results  of  ongoing  studies  provide  some  support  for  this  hypothesis.  Other  studies  are  in  progress  to 
determine  the  cell  survival/proliferation  mechanisms  underlying  such  cytotoxicity  effects.  Our  findings  may  have 
implications  of  cytotoxicity  of  SMWCNTs  in  pancreatic  cells  and  in  designing  therapies  for  pancreatic  cancer. 

35.  Idikuda  VK,  Jaiswal  AR,  Wong  YYW,  Leung  SW,  Daniels  CK  &  Lai  JCK  (2012)  Magnesium  Oxide 
Nanoparticles  Induce  Cytotoxic  and  Proinflammatory  Effects  in  Schwann  Cells  and  DRG  Neurons.  Experimental 
Biology  2012,  April  21-25,  2012,  Convention  Center,  San  Diego,  CA  (in  Abstracts  Volume). 

Abstract.  Applications  of  metal  oxide  nanoparticles  in  diverse  fields  have  been  accelerating  in  the  last  decade.  For 
example,  magnesium  oxide  (MgO)  nanoparticles  have  been  employed  in  ceramics,  and  as  adhesive  and  additive  in 
chemical  raw  materials,  leading  to  their  increased  human  exposure,  thereby  posing  potential  health  hazards.  We 
have  therefore  investigated  the  hypothesis  that  MgO  nanoparticles  exert  differential  cytotoxic  effects  on  neural  cells 
in  the  peripheral  nervous  system  employing  cell  models  consisting  of  Schwann  cells  and  dorsal  root  ganglion 
neurons  (DRG)  in  vitro.  Results  of  our  ongoing  studies  revealed  MgO  nanoparticles  exerted  differential  effects  on 
lowering  the  survival  of  Schwann  cells  and  DRG  neurons.  Along  with  their  morphological  changes,  we  also  found 
the  nanoparticles  induced  differential  dose-related  increases  in  expression  of  markers  of  inflammatory  responses 
such  as  IL-6  and  PPAR-y  in  the  two  neural  cell  types.  Thus,  our  results  suggest  that  MgO  nanoparticles  can  induce 
differential  cytotoxic  effects  and  elicit  inflammatory  responses  in  Schwann  cells  and  DRG  neurons  and  as  such  may 
have  implications  in  health  hazard  of  human  exposure  to  the  nanoparticles. 

36.  Gao  X,  Assan  D,  Lai  JCK  &  Leung  SW  (2012)  Comparison  of  Anchoring  Materials  for  High  Performance 
Sensors  Modified  with  Nanoparticles  and  Enzymes.  NSTI  Nanotechnology  Conference  &  Expo  -  Nanotech  2012, 
June  18-21,  Santa  Clara,  CA  (in  Abstracts  volume). 

Abstract.  We  have  previously  developed  some  of  the  most  sensitive  biosensors/electrodes  modified  by  Au 
nanoparticles  and  enzymes  that  are  capable  of  detecting  concentration  levels  below  ppb.  These  sensors  were 
fabricated  with  composite  layers  of  nanomaterials  and  enzymes  anchored  on  conductive  but  non-reactive  materials, 
such  as  glassy  carbon  Au,  Ag,  and  Pt.  Performance  of  these  sensors  varies  depending  on  the  anchoring  materials 


and  as  well  as  the  composition  of  the  biocomposite  materials.  In  this  report,  we  investigated  the  performance  of 
sensors  fabricated  with  identical  biocomposite  materials  and  procedures,  except  the  anchoring  conductive  materials. 
The  anchoring  materials  were  glassy  carbon,  Pt,  Au  and  Ag;  the  biocomposite  layer  consisted  of  polymer/ Au 
nanoparticles/enzyme.  The  enzymes  in  the  biocomposite  layers  are  essential  for  the  target  species  detection  with 
which  enable  the  coupling  (detection)  reactions  occur.  The  enzymes  used  in  this  study  were  LDH,  GDH,  and 
hemoglobin.  The  specific  target  species  for  the  detection  included  lactate,  N02-,  peroxide,  and  NH4+.  We  also 
tested  different  combinations  of  the  biocomposite  layers  for  optimal  performance  of  the  sensors/electrodes.  The 
testing  solutions  were  buffered  with  0.1  M  of  phosphate  at  pH  7.0. 


37.  Lu,  S,  Bhushan  A,  Leung  SW,  Daniels  CK  &  Lai  JCK  (2012)  Cytotoxic  Effects  of  Four  Metallic  Oxide 
Nanoparticles  on  Dorsal  Root  Ganglion  (DRG)  Neurons.  NSTI  Nanotechnology  Conference  &  Expo  -  Nanotech 
2012,  June  18-21,  Santa  Clara,  CA  (in  Abstracts  volume). 

Abstract.  Metallic  oxide  nanoparticles  have  diverse  applications  in  a  variety  of  industries  because  of  their  unusual 
but  exploitable  physico-chemical  and  other  properties.  Consequently,  the  exposure  of  humans  to  these  nanparticles 
is  increasing,  especially  in  the  occupational  environmental  settings.  Even  though  the  health  impact  of  exposure  to 
such  nanoparticles  has  not  been  fully  assessed,  there  is  recent  evidence  based  on  studies  employing  animal  models 
suggesting  that  such  exposure  may  induce  differential  toxicity  in  various  organs.  These  findings  notwithstanding, 
the  cytotoxic  effects  of  metallic  oxide  nanoparticles  on  neural  cells  are  still  poorly  understood. 

We  have  launched  a  series  of  studies  to  systematically  investigate  the  cytotoxic  effects  of  nanoparticles  of 
metallic  and  non-metallic  oxides  in  human  and  other  mammalian  neural  and  non-neural  cell  types.  We  found  that 
such  nanoparticles  exerted  differential  cytotoxic  effects  on  human  astrocytes -like  U87  astrocytoma  and  human 
neurons-like  SK-N-SH  neuroblastoma  cells.  Their  toxic  effects  were  concentration-  and  time-dependent.  Ours  were 
among  the  small  number  of  studies  that  reported  on  the  cytotoxic  effects  of  nanoparticles  of  metallic  and  non- 
metallic  oxides  in  human  and  other  mammalian  neural  cells  from  the  central  nervous  system.  However,  even  less  is 
known  regarding  the  putative  cytotoxicity  of  such  nanparticles  in  neural  cells  derived  from  the  peripheral  nervous 
system  (PNS). 

Because  the  putative  cytotoxicity  of  nanoparticles  of  metallic  and  non-metallic  oxides  in  neural  cells 
derived  from  the  PNS  has  not  been  reportedly  studied,  we  have  developed  two  PNS  neural  cell  models  in  vitro 
consisting  of  dorsal  root  ganglion  (DRG)  neurons  and  Schwann  cells  to  facilitate  the  systematic  investigation  of  the 
putative  cytotoxicity  of  such  nanoparticles  in  PNS  neural  cells. 

We  have  investigated  the  putative  cytotoxic  effects  of  nanoparticles  of  anatase  Ti02,  rutile  Ti02,  Fe203  and 
ZnO  in  dorsal  root  ganglion  (DRG)  neurons.  Results  of  our  ongoing  studies  revealed  that  the  nanoparitcles 
investigated  induced  concentration-  and  time-related  decreases  in  survival  of  DRG  neurons.  The  rank  order  of  the 
potency  of  the  four  types  of  metallic  oxide  nanoparticles  in  inducing  decreases  in  survival  of  DRG  neurons  was: 
ZnO  nanoparticles  >  anatase  Ti02  nanoparticles  >  rutile  Ti02  nanoparticles  ~  Fe203  nanoparticles. 

To  further  elucidate  the  molecular  mechanisms  underlying  the  cytotoxic  effects  of  the  nanoparticles 
investigated,  we  have  assessed  the  expression  signaling  molecules  known  to  be  important  in  regulating  cell  survival 
and/or  proliferation,  namely  AKT  and  p-AKT  and  ERK  and  p-ERK  in  DRG  neurons  treated  with  the  nanoparticles. 
Results  of  our  ongoing  studies  revealed  that  treatment  with  the  four  types  of  nanoparticles  investigated  exerted 
differential  effects  on  the  expression  of  p-AKT  and  p-ERK  proteins  in  DRG  neurons.  Other  studies  are  ongoing  to 
further  elucidate  these  and  other  related  molecular  mechanisms  underlying  the  cytotoxic  effects  of  the  four  types  of 
nanoparticles.  Thus,  our  findings  may  have  pathophysiological  implications  in  the  impact  of  exposure  to  such 
nanoparticles  on  the  structure  and  function  of  the  PNS. 
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Abstract.  Diverse  applications  of  metal  oxide  nanoparticles  in  various  industries  have  been  accelerating  in  the  last 
decade.  Magnesium  oxide  (MgO)  nanoparticles  have  been  employed  in  ceramics,  and  as  adhesive  and  additive  in 
chemical  raw  materials,  leading  to  their  increased  human  exposure,  thereby  posing  potential  health  hazards.  Because 
cytotoxicity  of  MgO  nanoparticles  in  neural  cells  derived  from  the  peripheral  nervous  system  is  unknown,  we  have 
investigated  the  effects  of  MgO  nanoparticles  on  Schwann  cells.  Our  results  indicated  treatment  with  MgO 
nanoparticles  for  24  hours  induced  dose-related  cytotoxicity  in  Schwann  cells.  Moreover,  such  treatment  also 
induced  distinct  morphological  changes  in  Schwann  cells  leading  us  to  investigate  the  hypothesis  that  these 
nanoparticles  elicit  inflammatory  responses  in  Schwann  cells.  Consistent  with  this  hypothesis  was  our  finding  that 
the  nanoparticles  induced  enhanced  expression  of  cytokines  such  as  IL-6.  Thus,  our  findings  may  have 
pathophysiological  implications  in  toxicity  of  MgO  nanoparticles  in  neural  cells  derived  from  the  peripheral  nervous 
system. 
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Abstract.  Because  of  their  unique  physico-chemical  properties,  carbon  nanotubes  (CNTs)  have  found  their  way  into 
diverse  industrial  and  biomedical  applications,  including  but  not  limited  to  fabrication  of  sensors,  electrodes, 
catalysts,  actuators,  transistors  and  capacitors.  Their  escalating  uses  in  multiple  industries  result  in  humans  being 
more  and  more  exposed  to  CNTs,  especially  in  the  workplace  where  they  are  found.  However,  the  human  health 
hazard  of  exposure  to  CNTs  has  not  been  assessed  even  though  there  have  been  recent  studies  employing  animal 
models  indicating  that  various  types  of  CNTs  can  induce  toxicity  to  different  organs  and  tissues.  Nevertheless,  the 
effects  of  CNTs  on  the  nervous  system  and/or  neural  cells  are  virtually  unknown. 

We  have  initiated  a  series  of  studies  to  systematically  investigate  the  putative  cytotoxicity  of  a  variety  of 
nanomaterials,  including  CNTs.  Because  the  putative  neurotoxicity  of  CNTs  has  not  been  reportedly  studied,  we 
have  developed  several  neural  cell  models  in  vitro  to  facilitate  such  cytotoxicity  studies.  In  this  study,  we  have 
investigated  the  putative  cytotoxic  effects  of  both  funtionalized  and  non-functionalized  short  multi-wall  carbon 
nanotubes  (SMWCNTs). 

We  have  examined  the  effects  two  functionalized,  namely  carboxylated  and  hydroxy lated,  SMWCNTs  as 
well  as  non-functionalized  SMWCNTs  on  dorsal  root  ganglion  (DRG)  neurons,  which  constitute  an  excellent  model 
in  vitro  of  neurons  derived  from  the  peripheral  nervous  system  (PNS).  We  hypothesized  that  treatment  with  CNTs 
induces  a  dose-related  decrease  in  the  viability  of  DRG  neurons  and  functionalization  of  CNTs  modulates  the 
cytotoxicity  profile  of  CNTs. 

Our  results  demonstrated  that  treatment  with  SMWCNTs  induced  concentration -related  decreases  in 
survival  and  growth  of  DRG  neurons,  the  non-functionalized  ones  being  more  cytotoxic  than  the  functionalized 
ones,  especially  at  the  higher  treatment  concentrations.  Treatment  of  DRG  neurons  with  non-functionalized 
SMWCNTs  enhanced  their  release  of  lactate  dehydrogenase  into  the  medium,  suggesting  that  SMWCNTs  induced 
necrotic  damage  and/or  cell  death  in  DRG  neurons.  Moreover,  treatment  of  DRG  neurons  with  non-functionalized 
SMWCNTs  resulted  in  their  decreased  expression  of  phospho-Akt,  a  known  signal  of  cell  survival  and  proliferation. 
Thus,  ours  is  the  first  study  that  demonstrates  SMWCNTs  are  cytotoxic  to  neural  cells.  Eurthermore,  our  results  may 
have  pathophysiological  implications  in  how  exposure  to  SMWCNTs  impact  on  the  structure  and  function  of  the 
PNS. 
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Abstract.  Surfactants  play  a  key  role  on  bodily  functions  at  molecular  level,  such  as  cell  signaling  and  signal 
transmission.  Their  importance  in  cell  survival  is  well  recognized,  but  the  surfactant  effect  on 
intermolecular/interfacial  mass  transport  is  not  well  understood  and  the  available  information  of  the  subject  is  very 
limited  quantitatively.  In  this  report,  we  systemically  studied  the  effect  of  surfactants  on  intercellular  transport  of 
DNA,  proteins,  and  some  key  electrolytes  with  an  artificial  cellular  system  constructed  with  a  semipermeable 
membrane.  The  permeabilities  of  these  biomolecules  and  electrolytes  across  the  semipermeable  membranes  in  the 
artificial  cell  system  were  measured.  Results  of  this  study  provide  quantitative  understanding  of  intermolecular 
interfacial  mass  transport  that  is  important  in  the  design  of  many  fore-coming  applications  of  biotechnology. 


